Recognizing structure in Web pages using similarity queries (1999) [31 citations — 6 self]
|
Popular Tags
No tags have been applied to this document.
BibTeX | Add To MetaCart
@INPROCEEDINGS{Cohen99recognizingstructure,author = {William W. Cohen},
title = {Recognizing structure in Web pages using similarity queries},
booktitle = {In AAAI-99},
year = {1999},
pages = {59--66}
}
Years of Citing Articles
Abstract:
We present general-purpose methods for recognizing certain types of structure in HTML documents. The methods are implemented using WHIRL, a \soft " logic that incorporates a notion of textual similarity developed in the information retrieval community. In an experimental evaluation on 82 Web pages, the structure ranked rst by our method is \meaningful"|i.e., a structure that was used in a hand-coded \wrapper", or extraction program, for the page|nearly 70 % of the time. This improves on a value of 50 % obtained by an earlier method. With appropriate background information, the structure-recognition methods we describe can also be used to learn a wrapper from examples, or for maintaining a wrapper as a Web page changes format. In these settings, the top-ranked structure is meaningful nearly 85 % of the time.
