Standard benchmarking provides the run times for given programs on given machines, but fails to provide insight as to why those results were obtained (either in terms of machine or program characteristics), and fails to provide run times for that program on some other machine, or some other programs on that machine. We have developed a machineindependent model of program execution to characterize both machine performance and program execution. By merging these machine and program characterizations, we can estimate execution time for arbitrary machine/program combinations. Our technique allows us to identify those operations, either on the machine or in the programs, which dominate the benchmark results. This information helps designers in improving the performance of future machines, and users in tuning their applications to better utilize the performance of existing machines. Here we apply our methodology to characterize benchmarks and
|
302
|
Performance of Various Computers Using Standard Linear Equations Software, (Linpack Benchmark Report
– Dongarra
- 1998
|
|
291
|
Compiler transformations for high-performance computing
– BACON, GRAHAM, et al.
- 1994
|
|
172
|
A static performance estimator to guide data partitioning decisions
– BALASUNDARAM, Fox, et al.
- 1991
|
|
140
|
The Livermore Fortran kernels: a computer test of the numerical performance range
– McMahon
- 1986
|
|
105
|
An overview of the PTRAN analysis system for multiprocessing
– Allen, Burke, et al.
- 1988
|
|
105
|
An empirical study of FORTRAN programs
– Knuth
- 1971
|
|
83
|
Determining average program execution times and their variance
– Sarkar
- 1989
|
|
75
|
Supercomputer performance evaluation and the Perfect Benchmarks
– CYBENKO, KIPP, et al.
- 1990
|
|
60
|
Machine characterization BASed on an abstract high level machine
– Saavedra-Barrera, Smith, et al.
- 1989
|
|
59
|
A synthetic benchmark
– Curnow, Wichmann
- 1976
|
|
47
|
CPU performance evaluation and execution time prediction using narrow spectrum benchmarking
– Saavedra-Barrera
- 1992
|
|
29
|
Automating program analysis
– Hickey, Cohen
- 1988
|
|
28
|
Cache performance of the SPEC benchmark suite
– Gee, Hill, et al.
- 1991
|
|
22
|
The ParaScope editor: An interactive parallel programming tool
– Balasundaram, Kennedy, et al.
- 1989
|
|
17
|
Dhrystone benchmark: rationale for version 2 and measurement rules
– Weicker
- 1988
|
|
14
|
Computer benchmarking: Paths and pitfalls
– DONGARRA, MARTIN, et al.
- 1987
|
|
14
|
Discrete Markov analysis of computer programs
– Ramamoorthy
- 1965
|
|
13
|
Toward Real-Time Performance Benchmarks for Ada
– Clapp, Duchesneau, et al.
- 1986
|
|
13
|
Cache performance of the integer SPEC benchmarks on a RISC
– Pnevmatikatos, Hill
- 1990
|
|
11
|
Dynamic characteristics of loops
– Kobayashi
- 1984
|
|
8
|
Machine characterization and benchmark performance prediction
– Saavedra-Barrera
- 1988
|
|
7
|
Benchmarking and The Abstract Machine Characterization Model
– Saavedra-Barrera, Smith
- 1990
|
|
6
|
SPEC Newsletter: Benchmark Results
– SPEC
- 1990
|
|
5
|
Understanding Supercomputer Benchmarks", Datamation
– Worlton
- 1984
|
|
4
|
An Analytical Look at Linear Performance Models
– Ponder
- 1990
|
|
3
|
Micro Analysis of Computer System Performance
– Beizer
- 1978
|
|
3
|
TLB Performance of the SPEC Benchmark Suite", paper in preparation, draft of
– Gee, Smith
- 1992
|
|
3
|
Microbenchmarking and Performance Prediction for Parallel Computers
– Worley, Smith
- 1995
|
|
1
|
The NAS Kernel Benchmark Program", NASA
– Bailey, Barton
- 1985
|
|
1
|
Some Causes of Variability in CPU Time
– Currah
- 1975
|
|
1
|
Fortran Execution Time Benchmark", paper in preparation, Version 29
– Doduc
- 1989
|
|
1
|
Dynamic Profile of Instruction Sequences for the IBM System /370
– Kobayashi
- 1983
|
|
1
|
An Instruction Timing Model of CPU Performance ", The fourth
– Peuto, Shustek
- 1977
|
|
1
|
CPU Performance Evaluation and Execution Time Time Prediction Using Narrow Spectrum Benchmarking
– Saavedra-Barrera
- 1992
|
|
1
|
Benchmarking Optimizing Compilers", submitted for publication, USC
– Saavedra, Smith
- 1992
|
|
1
|
Measuring Cache and TLB Performance", in preparation
– Saavedra, Smith
- 1992
|
|
1
|
SPEC Newsletter", a: Vol.2, Issue 2
– SPEC
- 1989
|
|
1
|
Benchmarking Optimizing Compilers
– Saavedra, Smith
- 1995
|
|
1
|
Measuring Cache and TLB Performance
– Saavedra, Smith
- 1995
|
