Syntactic Features for Evaluation of Machine Translation
Abstract:
Automatic evaluation of machine translation, based on computing n-gram similarity between system output and human reference translations, has revolutionized the development of MT systems. We explore the use of syntactic information, including constituent labels and head-modifier dependencies, in computing similarity between output and reference. Our results show that adding syntactic information to the evaluation metric improves both sentence-level and corpus-level correlation with human judgments. 1
Citations
| 442 | Head-Driven Statistical Models for Natural Language Parsing – Collins - 1999 |
| 115 | 2002. Convolution kernels for natural language – Collins, Duffy |
| 96 | Automatic evaluation of machine translation quality using n-gram co-occurrence statistics – Doddington - 2002 |
| 35 | A Smorgasbord of Features for Statistical Machine Translation – Och, Gildea, et al. - 2004 |
| 16 | Confidence estimation for machine translation – Blatz, Fitzgerald, et al. - 2003 |
| 9 | A learning approach to improving sentence-level MT evaluation – Kulesza, Shieber - 2004 |
| 7 | language models for machine translation – Syntax-based |
