Abstract

This paper presents a statistical parser for natural language that obtains a parsing accuracy--roughly 87% precision and 86% recall--which surpasses the best previously published results on the Wall St. Journal domain. The parser itself requires very little human intervention, since the information it uses to make parsing decisions is specified in a concise and simple manner, and is combined in a fully automatic way under the maximum entropy framework.

Citations

1654	B.: Building a large annotated corpus of english: The Penn treebank - Marcus, Marcinkiewicz, et al. - 1993
846	A Maximum Entropy Approach to Natural Language Processing - Berger, Pietra, et al. - 1996
396	New Statistical Parser Based on Bigram Lexical De-pendencies - Collins - 2006
287	Statistical Decision-Tree Models for Parsing - Magerman - 1995
184	A Procedure for Quantitatively Comparing the Syntactic Coverage of English Grammars - Black - 1991
45	Decision Tree Parsing Using a Hidden Derivation Model - Jelinek - 1994
35	Adaptive language modeling using the maximum entropy principle.” Human Language Technology - Lau, Rosenfeld, et al. - 1993
35	A Maximum Entropy Part of Speech Tagger - Ratnaparkhi - 1996
28	Generalized iterative scaling for log-linear models’, Annals of Mathematical Statistics 43, 1470–1480. 79 Déjean, H. (2000), Theory refinement and natural language learning - Darroch, Ratcliff - 1972