DMCA
Using a large set of EAGLES-compliant morpho-syntactic descriptors as a tagset for probabilistic tagging (2000)
Cached
Download Links
| Venue: | In Proceedings of the International Conference on Language Resources and Evaluation LREC 2000 |
| Citations: | 19 - 4 self |
BibTeX
@INPROCEEDINGS{Tufiş00usinga,
author = {Dan Tufiş},
title = {Using a large set of EAGLES-compliant morpho-syntactic descriptors as a tagset for probabilistic tagging},
booktitle = {In Proceedings of the International Conference on Language Resources and Evaluation LREC 2000},
year = {2000},
pages = {1105--1112}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
The paper presents one way of reconciling data sparseness with the requirement of high accuracy tagging in terms of fine-grained tagsets. For lexicon encoding, EAGLES elaborated a set of recommendations aimed at covering multilingual requirements and therefore resulted in a large number of features and possible values. Such an encoding, used for tagging purposes, would lead to very large tagsets. For instance, our EAGLES-compliant lexicon required a set of about 1000 morpho-syntactic description codes (MSDs) which after considering some systematic syncretic phenomena, was reduced to a set of 614 MSDs. Building reliable language models (LMs) for this tagset would require unrealistically large training data (hand annotated/validated). Our solution was to design a hidden reduced tagset and use it in building various LMs. The underlying tagger uses these LMs to tag a new text in as many variants as LMs are available. The tag differences between these variants are processed by a combiner which chooses the most likely tags. In the end, the tagged text is subject to a conversion process that maps the tags from the reduced tagset onto the more informative tags from the large tagset. We describe this processing chain and provide a detailed evaluation of the results. Large tagsets and tiered tagging The paper discusses experiments and results concerned with tagging highly inflectional languages, based on multiple register diversified language models (LMs). The
Keyphrases
eagles-compliant morpho-syntactic descriptor probabilistic tagging large set large tagsets multiple register building reliable language model possible value large number high accuracy informative tag data sparseness eagles-compliant lexicon language model various lm likely tag large tagset many variant multilingual requirement lexicon encoding detailed evaluation morpho-syntactic description code tagged text tag difference fine-grained tagsets processing chain inflectional language systematic syncretic phenomenon new text conversion process underlying tagger
