Algorithms for Deterministic Incremental Dependency Parsing

DMCA

Algorithms for Deterministic Incremental Dependency Parsing (2008)

Cached

Download Links

Other Repositories/Bibliography

DBLP

by Joakim Nivre

Venue:	Computational Linguistics
Citations:	116 - 20 self

BibTeX

@ARTICLE{Nivre08algorithmsfor,
    author = {Joakim Nivre},
    title = {Algorithms for Deterministic Incremental Dependency Parsing},
    journal = {Computational Linguistics},
    year = {2008}
}

OpenURL

Abstract

Parsing algorithms that process the input from left to right and construct a single derivation have often been considered inadequate for natural language parsing because of the massive ambiguity typically found in natural language grammars. Nevertheless, it has been shown that such algorithms, combined with treebank-induced classifiers, can be used to build highly accurate disambiguating parsers, in particular for dependency-based syntactic representations. In this article, we first present a general framework for describing and analyzing algorithms for deterministic incremental dependency parsing, formalized as transition systems. We then describe and analyze two families of such algorithms: stack-based and list-based algorithms. In the former family, which is restricted to projective dependency structures, we describe an arc-eager and an arc-standard variant; in the latter family, we present a projective and a nonprojective variant. For each of the four algorithms, we give proofs of correctness and complexity. In addition, we perform an experimental evaluation of all algorithms in combination with SVM classifiers for predicting the next parsing action, using data from thirteen languages. We show that all four algorithms give competitive accuracy, although the non-projective list-based algorithm generally outperforms the projective algorithms for languages with a non-negligible proportion of non-projective constructions. However, the projective algorithms often produce comparable results when combined with the technique known as pseudo-projective parsing. The linear time complexity of the stack-based algorithms gives them an advantage with respect to efficiency both in learning and in parsing, but the projective list-based algorithm turns out to be equally efficient in practice. Moreover, when the projective algorithms are used to implement pseudo-projective parsing, they sometimes become less efficient in parsing (but not in learning) than the non-projective list-based algorithm. Although most of the algorithms have been partially described in the literature before, this is the first comprehensive analysis and evaluation of the algorithms within a unified framework. 1.

Keyphrases

projective algorithm deterministic incremental dependency pseudo-projective parsing non-projective list-based algorithm competitive accuracy latter family nonprojective variant list-based algorithm former family deterministic incremental dependency parsing experimental evaluation single derivation dependency structure general framework comparable result massive ambiguity stack-based algorithm projective list-based algorithm thirteen language dependency-based syntactic representation first comprehensive analysis transition system accurate disambiguating parser next parsing action non-negligible proportion linear time complexity arc-standard variant natural language parsing treebank-induced classifier natural language grammar non-projective construction unified framework svm classifier

DMCA