Improving Chinese tokenization with linguistic filters on statistical lexical acquisition (1994)
Cached
Download Links
- [www.ece.ust.hk]
- [www.ee.ust.hk]
- [acl.ldc.upenn.edu]
- [aclweb.org]
- [www.ee.ust.hk]
- [www.cs.ust.hk]
- DBLP
Other Repositories/Bibliography
by
Dekai Wu
| Venue: | In Proceedings of the Fourth Conference on Applied Natural Language Processing |
| Citations: | 33 - 13 self |
BibTeX
@INPROCEEDINGS{Wu94improvingchinese,
author = {Dekai Wu},
title = {Improving Chinese tokenization with linguistic filters on statistical lexical acquisition},
booktitle = {In Proceedings of the Fourth Conference on Applied Natural Language Processing},
year = {1994},
pages = {180--181}
}
Years of Citing Articles
Bookmark
 |
 |
 |
 |
 |
 |
OpenURL
Abstract
The first step in Chinese NLP is to tokenize or segment character sequences into words, since the text contains no word delimiters. Recent heavy activity in this area has shown the biggest stumbling block to be words that are absent from the lexicon, since successful tokenizers to date have been based on dictionary lookup (e.g., Chang & Chen 1993;
Citations
| 63 | Aligning a parallel English-Chinese corpus statistically with lexical criteria - WU - 1994 |
| 41 | Statistical augmentation of a Chinese machine-readable dictionary - Fung, Wu - 1994 |
| 21 | Statistical models for word segmentation and unknown resolution - Chiang, Chang, et al. - 1992 |
| 17 | A preliminary study on unknown word problem in chinese word segmentation - Lin, Ming-Yu, et al. - 1993 |
| 16 | HMM-based part-of-speech tagging for Chinese corpora - Chang, Chen - 1993 |
| 9 | A stochastic word segmentation algorithm for a Mandarin text-to-speech system - Sproat, Shih, et al. - 1994 |
| 8 | The BDC Chinese-English electronic dictionary (version 2.0). Behavior Design Corporation - BDC - 1992 |
