See this document in CiteSeerX!

Toward meaningful test collections for information  (Make Corrections)  
integration benchmarking Peter Bailey GPO Box 664 Canberra ACT 2601 AUSTRALIA ...



  Home/Search   Context   Related

 
View or download:
es.csiro.au/pubs/bailey_iiweb.pdf
Cached:  PS.gz  PS  PDF   Image  Update  Help

From:  es.csiro.au/publications.shtml (more)
(Enter author homepages)

Rate this article: (best)
  Comment on this article  
(Enter summary)

Abstract: Meaningful comparison of algorithms for search, extraction and aggregation across heterogeneous sources will require welldesigned benchmarks, preferably based on freely available test collections. In this paper, we discuss issues which will inevitably arise during the construction of such benchmarks. We argue that the creation of benchmarks requires careful consideration of the evaluation methods. These go hand-in-hand with the selection of an appropriate test collection. Conversely, selection... (Update)

Active bibliography (related documents):   More   All
0.5:   Automatic Data Fusion with HumMer - Alexander Bilke Jens (2005)   (Correct)
0.3:   Personalizing Search via Automated Analysis of Interests.. - Teevan, Dumais, Horvitz (2005)   (Correct)
0.3:   Informative Term Selection for Automatic Query Expansion - Claudio Carpineto Fondazione   (Correct)

Similar documents based on text:
0.0:   Unknown -   (Correct)

BibTeX entry:   (Update)

@misc{ peter-toward,
  author = "Integration Benchmarking Peter",
  title = "Toward Meaningful Test Collections for Information",
  url = "citeseer.ist.psu.edu/759566.html" }
Citations (may not include all citations):
585   Extensible markup language (context) - Bray, Paoli et al. - 2004
74   Computer Science Department (context) - web, repository - 2003
41   Overview of TREC-8 web track - Hawking, Voorhees et al. - 1998
14   Engineering a multi-purpose test collection for web retrieva.. - Bailey, Craswell et al. - 2003
3   and Craswell (context) - Hawking - 2005
2   and Hawking (context) - Craswell, Bailey - 1999
2   Thalia: Test harness for the assessment of legacy informatio.. (context) - Hammer, Stonebraker et al. - 2005
2   and Hawking (context) - Craswell - 2004
1   Distributed IR for digital libraries (context) - Larson - 2003
1   XML element retrieval and heterogeneous retrieval: In pursui.. (context) - Larson - 2005
1   Do TREC web collections look like the web (context) - Soboroff - 2002
1   Server selection methods in hybrid portal search - Hawking, Thomas - 2005
1   Summary of the SIGIR (context) - Soboroff, Voorhees et al. - 2003
1   The Lowell Report (context) - Gray, Schek et al. - 2003
1   Personal Information Retrieval (context) - Thomas - 2005
1   Question answering in TREC - Voorhees - 2005
http://inex.is.informatik.uni-duisburg.de/

Documents on the same site (http://es.csiro.au/publications.shtml):   More
Aglets: a good idea for Spidering? - Craswell, Haines, Humphreys..   (Correct)
Query-Independent Evidence in Home - Page Finding Trystan   (Correct)
Overview of the TREC-2002 Web Track - Nick Craswell And   (Correct)

Online articles have much greater impact   More about CiteSeer.IST   Add search form to your site   Submit documents   Feedback  

CiteSeer.IST - Copyright Penn State and NEC