DMCA
Semantic similarity based on corpus statistics and lexical taxonomy (1997)
| Venue: | Proc of 10th International Conference on Research in Computational Linguistics, ROCLING’97 |
| Citations: | 872 - 0 self |
BibTeX
@INPROCEEDINGS{Jiang97semanticsimilarity,
author = {Jay J. Jiang and David W. Conrath},
title = {Semantic similarity based on corpus statistics and lexical taxonomy},
booktitle = {Proc of 10th International Conference on Research in Computational Linguistics, ROCLING’97},
year = {1997}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
This paper presents a new approach for measuring semantic similarity/distance between words and concepts. It combines a lexical taxonomy structure with corpus statistical information so that the semantic distance between nodes in the semantic space constructed by the taxonomy can be better quantified with the computational evidence derived from a distributional analysis of corpus data. Specifically, the proposed measure is a combined approach that inherits the edge-based approach of the edge counting scheme, which is then enhanced by the node-based approach of the information content calculation. When tested on a common data set of word pair similarity ratings, the proposed approach outperforms other computational models. It gives the highest correlation value (r = 0.828) with a benchmark based on human similarity judgements, whereas an upper bound (r = 0.885) is observed when human subjects replicate the same task. 1.
Keyphrases
semantic similarity corpus statistic lexical taxonomy computational evidence corpus data common data set edge-based approach new approach node-based approach correlation value distributional analysis combined approach semantic space human similarity judgement semantic distance semantic similarity distance information content calculation computational model human subject word pair similarity rating corpus statistical information upper bound lexical taxonomy structure
