See this document in CiteSeerX!

Using Benchmarking to Advance Research: A Challenge to Software Engineering (2003)  (Make Corrections)  (2 citations)
Susan Elliott Sim, Steve Easterbrook, Richard C. Holt



  Home/Search   Context   Related

 
View or download:
toronto.edu/~simsu...cse03challenge.ps
toronto.edu/~sme/p...se03challenge.pdf
Cached:  PS.gz  PS  PDF   Image  Update  Help

From:  plg.uwaterloo.ca/~holt/c...papers (more)
(Enter author homepages)

Rate this article: (best)
  Comment on this article  
(Enter summary)

Abstract: Benchmarks have been used in computer science to compare the performance of computer systems, information retrieval algorithms, databases, and many other technologies. The creation and widespread use of a benchmark within a research area is frequently accompanied by rapid technical progress and community building. These observations have led us to formulate a theory of benchmarking within scientific disciplines. Based on this theory, we challenge software engineering research to become more... (Update)

Cited by:   More
Comparative Evaluation: Implications from the Multidisciplinary.. - Wasson   (Correct)
Refactoring: Emerging Trends and Open Problems - Mens, Van Deursen (2003)   (Correct)

Active bibliography (related documents):   More   All
0.5:   A Study on the Current State of the Art in.. - Kollmann.. (2002)   (Correct)
0.5:   UMLsec: Extending UML for Secure Systems Development - Jürjens (2002)   (Correct)
0.5:   The Use of Dynamic Segment Scoring for Language-Independent.. - Pack, Weinstein   (Correct)

Similar documents based on text:   More   All
0.3:   Browsing and Searching Software Architectures - Sim, Clarke, Holt, Cox (1999)   (Correct)
0.3:   Towards a Standard Schema for C/C++ - Ferenc, Sim, Holt, al. (2001)   (Correct)
0.3:   Archetypal Source Code Searches: A Survey of Software.. - Sim, Clarke, Holt (1998)   (Correct)

BibTeX entry:   (Update)

S. E. Sim, S. Easterbrook, and R. C. Holt. Using benchmarking to advance research: A challenge to software engineering. In Proc. Int'l Conf. Software Engineering, 2003. http://citeseer.ist.psu.edu/sim03using.html   More

@misc{ sim03using,
  author = "S. Sim and S. Easterbrook and R. Holt",
  title = "Using benchmarking to advance research: A challenge to software engineering",
  text = "S. E. Sim, S. Easterbrook, and R. C. Holt. Using benchmarking to advance
    research: A challenge to software engineering. In Proc. Int'l Conf. Software
    Engineering, 2003.",
  year = "2003",
  url = "citeseer.ist.psu.edu/sim03using.html" }
Citations (may not include all citations):
223   The Structure of Scientific Revolutions (context) - Kuhn - 1996
94   The Benchmark Handbook: For Database and Transaction Process.. (context) - Gray - 1991
63   GXL: Toward a Standard Exchange Format - Holt, Winter et al. - 2000
47   An Empirical Study of Static Call Graph Extractors - Murphy, Notkin et al. - 1998
32   SPEC CPU (context) - Henning
27   Should Computer Scientists Experiment More (context) - Tichy - 1998
26   Feasibility of Model Checking Software Requirements: A Case .. - Sreemani, Atlee - 1996
22   Evaluating Architectural Extractors (context) - Armstrong, Trudeau - 1998
16   The Goal Question Metric Approach (context) - Basili, Caldiera et al. - 1994
11   Requirements and Specification Exemplars (context) - Feather, Fickas et al. - 1997
11   Connecting Architecture Reconstruction Frameworks - Bowman, Godfrey et al. - 1999
10   An Evaluation of Reverse Engineering Tool Capabilities (context) - Bellay, Gall - 1998
9   Towards a Standard Schema for C/C (context) - Ferenc, Sim et al. - 2001
8   Evaluating software engineering methods and tools. Parts 1 t.. (context) - Kitchenham
7   SFI: A Feature Integration Tool - Plath, Ryan - 1999
7   A Structured Demonstration of Program Comprehension Tools - Sim, Storey - 2000
5   Towards a Software Evolution Benchmark - Demeyer, Mens et al. - 2002
3   Experimental Design and Analysis in Software Engineering, Pa.. (context) - Pfleeger
2   On Using a Benchmark to Evaluate C++ Extractors (context) - Sim, Holt et al.
2   A Generic Framework for Formalizing UML (context) - McUmber, Cheng - 2001
2   A Structured Demonstration of Five Program Comprehension Too.. - Sim, Storey et al. - 2000
2   Overview of the Eighth Text REtrieval Conference (TREC-8 - Voorhees, Harman - 2000

Documents on the same site (http://plg.uwaterloo.ca/~holt/cv/papers.html):   More
The Ramp-Up Problem in Software Projects: A Case Study of How.. - Sim, Holt (1998)   (Correct)
Algorithms for Managing the Evolution of Software Designs - Spiros Mancoridis   (Correct)
Design Maintenance: Unexpected Architectural.. - Carmichael, Tzerpos.. (1995)   (Correct)

Online articles have much greater impact   More about CiteSeer.IST   Add search form to your site   Submit documents   Feedback  

CiteSeer.IST - Copyright Penn State and NEC