A General Language Model for Information Retrieval

A General Language Model for Information Retrieval (1999)

Cached

Download Links

[ciir.cs.umass.edu]

Other Repositories/Bibliography

DBLP

by Fei Song , W. Bruce Croft

Venue:	In Proceedings of the 1999 ACM SIGIR Conference on Research and Development in Information Retrieval
Citations:	152 - 10 self

Versions

Version History

Metadata Version 3

User correction supplied by SystemCorrections

Datum	Value	Source
TITLE	A General Language Model for Information Retrieval	user correction - Legacy Corrections
AUTHOR NAME	Fei Song	user correction - Legacy Corrections
AUTHOR AFFIL	Dept. of Computing and Info. Science; University of Guelph; Guelph, Ontario	user correction - Legacy Corrections
AUTHOR ADDR	Canada N1G 2W1	user correction - Legacy Corrections
AUTHOR NAME	W. Bruce Croft	user correction - Legacy Corrections
ABSTRACT	Statistical language modeling has been successfully used for speech recognition, part-of-speech tagging, and syntactic parsing. Recently, it has also been applied to information retrieval. According to this new paradigm, each document is viewed as a language sample, and a query as a generation process. The retrieved documents are ranked based on the probabilities of producing a query from the corresponding language models of these documents. In this paper, we will present a new language model for information retrieval, which is based on a range of data smoothing techniques, including the Good-Turing estimate, curve-fitting functions, and model combinations. Our model is conceptually simple and intuitive, and can be easily extended to incorporate probabilities of phrases such as word pairs and word triples. The experiments with the Wall Street Journal and TREC4 data sets showed that the performance of our model is comparable to that of INQUERY and better than that of another language model for information retrieval. In particular, word pairs are shown to be useful in improving the retrieval performance.	SVM HeaderParse 0.1
YEAR	1999	INFERENCE
VENUE	In Proceedings of the 1999 ACM SIGIR Conference on Research and Development in Information Retrieval	INFERENCE
VENUE TYPE	CONFERENCE	INFERENCE
PAGES	279--280	INFERENCE
CITATIONS	12 found	ParsCit 1.0