DMCA
A method for disambiguating word senses in a large corpus (1992)
| Venue: | Computers and the Humanities |
| Citations: | 270 - 14 self |
BibTeX
@INPROCEEDINGS{Gale92amethod,
author = {William A. Gale and Kenneth W. Church and David Yarowsky},
title = {A method for disambiguating word senses in a large corpus},
booktitle = {Computers and the Humanities},
year = {1992},
pages = {26--415}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Word sense disambiguation has been recognized as a major problem in natural language processing research for over forty years. Both quantitive and qualitative methods have been tried, but much of this work has been stymied by difficulties in acquiring appropriate lexical resources, such as semantic networks and annotated corpora. In particular, much of the work on qualitative methods has had to focus on ‘‘toy’’ domains since currently available semantic networks generally lack broad coverage. Similarly, much of the work on quantitative methods has had to depend on small amounts of hand-labeled text for testing and training. We have achieved considerable progress recently by taking advantage of a new source of testing and training materials. Rather than depending on small amounts of hand-labeled text, we have been making use of relatively large amounts of parallel text, text such as the Canadian Hansards, which are available in multiple languages. The translation can often be used in lieu of hand-labeling. For example, consider the polysemous word sentence, which has two major senses: (1) a judicial sentence, and (2), a syntactic sentence. We can collect a number of sense (1) examples by extracting instances that are translated as peine, and we can collect a number of sense (2) examples by extracting instances that are translated as
Keyphrases
large corpus hand-labeled text qualitative method small amount considerable progress quantitative method forty year new source available semantic network appropriate lexical resource toy domain polysemous word sentence major sens natural language processing research large amount canadian hansard parallel text word sense disambiguation multiple language semantic network broad coverage judicial sentence syntactic sentence major problem
