Active Feedback – UIUC TREC-2003 HARD Experiments
Download:
pdf
unknown authors
http://sifaka.cs.uiuc.edu/xshen/research_files/trec2003_af.pdf
Add To MetaCart
Abstract:
In this paper, we report our experiments on the HARD (High Accuracy Retrieval from Documents) Track in TREC 2003. We focus on active feedback, i.e., how to intelligently propose questions for relevance feedback in order to maximize accuracy improvement in the second run. We proposed and empirically evaluated three different methods, i.e., top-k, gapped top-k, and k-cluster centroid, to extract a fixed number of text units (e.g. passage or document) for feedback. The results show that presenting the top k documents for user feedback is often not as beneficial for learning as presenting more diversified documents. 1
Citations
| 277 | A sequential algorithm for training text classifiers – Lewis, Gale - 1994 |
| 212 | Optimizing search engines using clickthrough data – Joachims - 2002 |
| 178 | Divergence Measures Based on the Shannon Entropy – Lin - 1991 |
| 144 | Document language models, query models, and risk minimization for information retrieval – Lafferty, Zhai - 2001 |
| 88 | Toward optimal active learning through sampling estimation of error reduction – Roy, McCallum - 2001 |
| 62 | Implicit Feedback for Inferring User Preference: A Bibliography. SIGIR Forum 37(2 – Kelly, Teevan - 2003 |
| 46 | Model-based feedback in the KL-divergence retrieval model – Zhai, Lafferty - 2001 |
| 22 | Active learning for parameter estimation in Bayesian networks – Tong, Koller - 2000 |
| 12 | Exploiting Query History for Document Ranking in Interactive Information Retrieval – Shen, Zhai - 2003 |
| 5 | Exploration and exploitation in adaptive filtering based on Bayesian active learning – Zhang, Xu, et al. - 2003 |
