DMCA
Scalable join processing on very large rdf graphs (2009)
| Venue: | In SIGMOD Conference |
| Citations: | 84 - 5 self |
BibTeX
@INPROCEEDINGS{Neumann09scalablejoin,
author = {Thomas Neumann and Gerhard Weikum},
title = {Scalable join processing on very large rdf graphs},
booktitle = {In SIGMOD Conference},
year = {2009},
pages = {627--640}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
With the proliferation of the RDF data format, engines for RDF query processing are faced with very large graphs that contain hundreds of millions of RDF triples. This paper addresses the resulting scalability problems. Recent prior work along these lines has focused on indexing and other physical-design issues. The current paper focuses on join processing, as the fine-grained and schema-relaxed use of RDF often entails star- and chain-shaped join queries with many input streams from index scans. We present two contributions for scalable join processing. First, we develop very light-weight methods for sideways in-formation passing between separate joins at query run-time, to provide highly effective filters on the input streams of joins. Second, we improve previously proposed algorithms for join-order optimization by more accurate selectivity esti-mations for very large RDF graphs. Experimental studies with several RDF datasets, including the UniProt collection, demonstrate the performance gains of our approach, outper-forming the previously fastest systems by more than an order of magnitude.
Keyphrases
scalable join processing large rdf graph rdf query processing accurate selectivity esti-mations uniprot collection light-weight method rdf data format recent prior work schema-relaxed use rdf triple several rdf datasets scalability problem join-order optimization input stream sideways in-formation passing large graph query run-time join processing performance gain index scan current paper experimental study effective filter chain-shaped join query separate join physical-design issue
