Results 1 - 10 of 13,625

IR evaluation methods for retrieving highly relevant documents

by Kalervo Järvelin, Jaana Kekäläinen , 2000
"... This paper proposes evaluation methods based on the use of non-dichotomous relevance judgements in IR experiments. It is argued that evaluation methods should credit IR methods for their ability to retrieve highly relevant documents. This is desirable from the user point of view in moderu large IR e ..."
Abstract - Cited by 414 (5 self) - Add to MetaCart
This paper proposes evaluation methods based on the use of non-dichotomous relevance judgements in IR experiments. It is argued that evaluation methods should credit IR methods for their ability to retrieve highly relevant documents. This is desirable from the user point of view in moderu large IR

Evaluation by Highly Relevant Documents

by Ellen Voorhees - In Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval , 2001
"... Given the size of the web, the search engine industry has argued that engines should be evaluated by their ability to retrieve highly relevant pages rather than all possible relevant pages. To explore the role highly relevant documents play in retrieval system evaluation, assessors for the TREC-9 we ..."
Abstract - Cited by 89 (3 self) - Add to MetaCart
Given the size of the web, the search engine industry has argued that engines should be evaluated by their ability to retrieve highly relevant pages rather than all possible relevant pages. To explore the role highly relevant documents play in retrieval system evaluation, assessors for the TREC-9

On Identifying Representative Relevant Documents

by Fiana Raiber, Oren Kurland
"... Using relevance feedback can significantly improve the effectiveness of ad hoc (query-based) retrieval. However, retrieval performance can significantly vary with respect to the given set of relevant documents. Our goal is to establish a quantitative analysis of what makes a relevant document a good ..."
Abstract - Cited by 2 (0 self) - Add to MetaCart
Using relevance feedback can significantly improve the effectiveness of ad hoc (query-based) retrieval. However, retrieval performance can significantly vary with respect to the given set of relevant documents. Our goal is to establish a quantitative analysis of what makes a relevant document a

Evaluation by Highly Relevant Documents

by unknown authors
"... ABSTRACT Given the size of the web, the search engine industry has argued that engines should be evaluated by their ability to retrieve highly relevant pages rather than all possible relevant pages. To explore the role highly relevant documents play in retrieval system evaluation, assessors for the ..."
Abstract - Add to MetaCart
ABSTRACT Given the size of the web, the search engine industry has argued that engines should be evaluated by their ability to retrieve highly relevant pages rather than all possible relevant pages. To explore the role highly relevant documents play in retrieval system evaluation, assessors

Distribution of Relevant Documents in Domain-level

by Aggregates For Topic, Vassilis Plachouras , 2004
"... In this paper, we study the distribution of relevant documents in aggregates, formed by grouping the retrieved documents according to their domain. For each aggregate, we take into account its size, and a measure of the correlation between its incoming and outgoing hyperlinks. We report on a prelimi ..."
Abstract - Add to MetaCart
In this paper, we study the distribution of relevant documents in aggregates, formed by grouping the retrieved documents according to their domain. For each aggregate, we take into account its size, and a measure of the correlation between its incoming and outgoing hyperlinks. We report on a

Less is More -- Probabilistic Models for Retrieving Fewer Relevant Documents

by Harr Chen, et al. , 2006
"... Traditionally, information retrieval systems aim to maximize the number of relevant documents returned to a user within some window of the top. For that goal, the probability ranking principle, which ranks documents in decreasing order of probability of relevance, is provably optimal. However, there ..."
Abstract - Cited by 148 (1 self) - Add to MetaCart
Traditionally, information retrieval systems aim to maximize the number of relevant documents returned to a user within some window of the top. For that goal, the probability ranking principle, which ranks documents in decreasing order of probability of relevance, is provably optimal. However

STUDIES ON RELEVANT DOCUMENT RETRIEVAL AND SUMMARIZATION

by unknown authors , 1995
"... ii The goal of this dissertation is to develop methods for supporting and enhancing intellectual activities. For this purpose, firstly, we propose a method for retrieving relevant documents. Secondly, we propose a summarization method for multiple articles. Thirdly, we investigate a method of acquir ..."
Abstract - Add to MetaCart
ii The goal of this dissertation is to develop methods for supporting and enhancing intellectual activities. For this purpose, firstly, we propose a method for retrieving relevant documents. Secondly, we propose a summarization method for multiple articles. Thirdly, we investigate a method

Identifying and Ranking Relevant Document Elements

by unknown authors
"... A method of indexing and searching structured documents for element retrieval is discussed. Documents are indexed using a modified inverted file retrieval system. Modified postings include pointers into a collection-wide document structure tree (the corpus tree) describing the structure of every doc ..."
Abstract - Add to MetaCart
document in the collection. Retrieval topics are converted into Boolean queries. Queries are used to identify relevant documents. Documents are then ranked using Okapi BM25 and finally relevant elements are identified using coverage. Search results are presented sorted first by document then coverage

Identifying and Ranking Relevant Document Elements

by unknown authors
"... A method of indexing and searching structured documents for element retrieval is discussed. Documents are indexed using a modified inverted file retrieval system. Modified postings include pointers into a collection-wide document structure tree (the corpus tree) describing the structure of every doc ..."
Abstract - Add to MetaCart
document in the collection. Retrieval topics are converted into Boolean queries. Queries are used to identify relevant documents. Documents are then ranked using Okapi BM25 and finally relevant elements are identified using coverage. Search results are presented sorted first by document then coverage

Relevant Document Distribution Estimation Method for Resource Selection

by Luo Si, Jamie Callan , 2003
"... Prior research under a variety of conditions has shown the CORI algorithm to be one of the most effective resource selection algorithms, but the range of database sizes studied was not large. This paper shows that the CORI algorithm does not do well in environments with a mix of "small" an ..."
Abstract - Cited by 120 (17 self) - Add to MetaCart
descriptions. Experiments demonstrate that the database size estimates are more accurate for large databases than estimates produced by a competing method; the new resource ranking algorithm is always at least as effective as the CORI algorithm; and the new algorithm results in better document rankings than
Results 1 - 10 of 13,625