Citation Context

... areas, including record linkage [Winkler 1999], merge-purge [Hernández and Stolfo 1998], data deduplication [Sarawagi and Bhamidipaty 2002], name matching [Bilenko et al. 2003], just to name a few. [=-=Elmagarmid et al. 2007-=-] is a recent survey on this topic. Similarity functions are the key to the near duplicate detection task. For text documents, edit distance [Ukkonen 1983] and Jaccard similarity on q-grams [Gravano e...

Citation Context

...ink maintenance protocol endpoints use the free soaplib13 library for the exchange of SOAP messages. 6 Related Work There is a large body of related work on record linkage [7] and duplicate detection =-=[9]-=- within the database community as well as on ontology matching [10] in the knowledge representation community. Silk builds on this work by implementing similarity metrics and aggregation functions tha...

Citation Context

... in the Product Name field, but refer to the same product. Our goal is to find all such duplicate records. There has been significant work in developing automated algorithms for entityresolution (see =-=[11]-=- for arecent survey). Abasic machine-basedtechniqueis tocomputeapre-defined Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee p...

Citation Context

...le, CSV, reified format together with meta-information such as confidence score and creation date). 5. RELATED WORK There is a large body of related work on record linkage [5] and duplicate detection =-=[4]-=- within the database community as well as on ontology matching [6] in the knowledge representation community. Silk builds on this work by implementing similarity metrics and aggregation functions that...

Citation Context

...o detect clusters of similar items. Michalowski et al. [11] utilise secondary sources to determine equivalences. A recent survey summarising many of duplicate record detection methods can be found in =-=[4]-=-. The SemTag effort as described in [3] assigns identifiers to Web pages. The authors describe a simple algorithm to disambiguate entities and provide a large-scale effort at tagging and assigning top...

Citation Context

...science and database communities refer to the same process as data or field matching [12], data integration [13], data scrubbing or cleaning [14], [15], data cleansing [16], duplicate detection [17], =-=[18]-=-, information integration [19], entity resolution [20], [21], [22], reference reconciliation [23], or as the merge/purge problem [24]. In commercial processing of business mailing lists and customer d...

Citation Context

...ht of these demands a variety of approaches have been proposed for record matching: probabilistic (e.g., [17, 21, 34, 32]), learning [12, 27, 30], distance-based [19], and rule-based [3, 20, 23] (see =-=[14]-=- for a recent survey). No matter what approach to use, one often needs to decide what Permission to copy without fee all or part of this material is granted provided that the copies are not made or di...

Citation Context

...er, it is known that coloring a 3-colorable graph is hard even with an unbounded number of colors [31]. VI. RELATED WORK Our work is orthogonal to most of the large body of work on deduplication (see =-=[32]-=- for an extensive survey). A significant part of the work on deduplication has focused on string similarity measures. This includes work on basic string similarity measures such as edit distance and v...