DMCA
The third PASCAL recognizing textual entailment challenge (2007)
Cached
Download Links
| Venue: | In Proceedings of the ACLPASCAL Workshop on Textual Entailment and |
| Citations: | 131 - 17 self |
BibTeX
@INPROCEEDINGS{Giampiccolo07thethird,
author = {Danilo Giampiccolo and Bernardo Magnini and Ido Dagan and Bill Dolan},
title = {The third PASCAL recognizing textual entailment challenge},
booktitle = {In Proceedings of the ACLPASCAL Workshop on Textual Entailment and},
year = {2007}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
This paper presents the Third PASCAL Recognising Textual Entailment Challenge (RTE-3), providing an overview of the dataset creating methodology and the submitted systems. In creating this year’s dataset, a number of longer texts were introduced to make the challenge more oriented to realistic scenarios. Additionally, a pool of resources was offered so that the participants could share common tools. A pilot task was also set up, aimed at differentiating unknown entailments from identified contradictions and providing justifications for overall system decisions. 26 participants submitted 44 runs, using different approaches and generally presenting new entailment models and achieving higher scores than in the previous challenges. 1.1 The RTE challenges The goal of the RTE challenges has been to create a benchmark task dedicated to textual entailment – recognizing that the meaning of one text is entailed, i.e. can be inferred, by another 1. In the recent years, this task has raised great interest since applied semantic inference concerns
Keyphrases
textual entailment challenge third pascal year dataset unknown entailment different approach great interest pilot task new entailment model recent year benchmark task semantic inference concern previous challenge realistic scenario textual entailment share common tool overall system decision
