Results 1 - 10
of
17
Streams on Wires – A Query Compiler for FPGAs
- Proc. VLDB Endowment
"... Taking advantage of many-core, heterogeneous hardware for data processing tasks is a difficult problem. In this paper, we consider the use of FPGAs for data stream processing as coprocessors in many-core architectures. We present Glacier, a component library and compositional compiler that transform ..."
Abstract
-
Cited by 19 (7 self)
- Add to MetaCart
(Show Context)
Taking advantage of many-core, heterogeneous hardware for data processing tasks is a difficult problem. In this paper, we consider the use of FPGAs for data stream processing as coprocessors in many-core architectures. We present Glacier, a component library and compositional compiler that transforms continuous queries into logic circuits by composing library components on an operator-level basis. In the paper we consider selection, aggregation, grouping, as well as windowing operators, and discuss their design as modular elements. We also show how significant performance improvements can be achieved by inserting the FPGA into the system’s data path (e.g., between the network interface and the host CPU). Our experiments show that queries on the FPGA can process streams at more than one million tuples per second and that they can do this directly from the network, removing much of the overhead of transferring the data to a conventional CPU. 1.
Purely Relational FLWORs
- XIME-P
, 2005
"... We report on a compilation procedure that derives relational algebra plans from arbitrarily nested XQuery FLWOR blocks. While recent research was able to develop relational encodings of trees which may turn RDBMSs into highly efficient XPath and XML Schema processors, here we describe relational enc ..."
Abstract
-
Cited by 15 (8 self)
- Add to MetaCart
(Show Context)
We report on a compilation procedure that derives relational algebra plans from arbitrarily nested XQuery FLWOR blocks. While recent research was able to develop relational encodings of trees which may turn RDBMSs into highly efficient XPath and XML Schema processors, here we describe relational encodings of nested iteration, variables, and the item sequences to which variables are bound. The developed techniques are purely relational in more than one sense: (a) we rely on a standard (or rather: classical) algebra that is readily supported by relational engines, and (b) we use relational concepts like functional and multivalued dependencies to significantly simplify the emitted plans. This work blends well with the mentioned tree encodings and thus contributes a further important building block to investigations into XQuery processors based on relational database technology.
eXrQuy: Order Indifference in XQuery
- IN PROC. OF THE 23TH INT’L CONFERENCE ON DATA ENGINEERING (ICDE
, 2007
"... There are more spots than immediately obvious in XQuery expressions where order is immaterial for evaluation— this affects most notably, but not exclusively, expressions in the scope of unordered { } and the argument of fn:unordered (). Clearly, performance gains are lurking behind such expression c ..."
Abstract
-
Cited by 14 (7 self)
- Add to MetaCart
(Show Context)
There are more spots than immediately obvious in XQuery expressions where order is immaterial for evaluation— this affects most notably, but not exclusively, expressions in the scope of unordered { } and the argument of fn:unordered (). Clearly, performance gains are lurking behind such expression contexts but the prevalent impact of order on the XQuery semantics reaches deep into any compliant XQuery processor, making it non-trivial to set this potential free. Here, we describe how the relational XQuery compiler Pathfinder uniformly exploits such order indifference in a purely algebraic fashion: Pathfinder-emitted plans faithfully implement the required XQuery order semantics but (locally) ignore order wherever this is admitted.
Dependable Cardinality Forecasts for XQuery
- In VLDB
, 2008
"... ABSTRACT Though inevitable for effective cost-based query rewriting, the derivation of meaningful cardinality estimates has remained a notoriously hard problem in the context of XQuery. By basing the estimation on a relational representation of the XQuery syntax, we show how existing cardinality es ..."
Abstract
-
Cited by 9 (4 self)
- Add to MetaCart
(Show Context)
ABSTRACT Though inevitable for effective cost-based query rewriting, the derivation of meaningful cardinality estimates has remained a notoriously hard problem in the context of XQuery. By basing the estimation on a relational representation of the XQuery syntax, we show how existing cardinality estimation techniques for XPath and proven relational estimation machinery can play together to yield dependable forecasts for arbitrary XQuery (sub)expressions. Our approach benefits from a light-weight form of data flow analysis. Abstract domain identifiers guide our query analyzer through the estimation process and allow for informed decisions even in case of deeply nested XQuery expressions. A variant of projection paths [14] provides a versatile interface into which existing techniques for XPath cardinality estimation can be plugged in seamlessly. We demonstrate an implementation of this interface based on data guides. Experiments show how our approach can equally cope with both, structureand value-based queries. It is robust with respect to intermediate estimation errors, from which we typically found our implementation to recover gracefully.
An Extended Preorder Index for Optimising XPath Expressions
- Proceedings of 3rd XSym, LNCS
, 2005
"... Abstract. Many of the problems with native XML databases relate to query performance and subsequently, it can be difficult to convince traditional database users of the benefits of using semi- or unstructured databases. Presently, there still lacks an index structure providing efficient support for ..."
Abstract
-
Cited by 6 (4 self)
- Add to MetaCart
(Show Context)
Abstract. Many of the problems with native XML databases relate to query performance and subsequently, it can be difficult to convince traditional database users of the benefits of using semi- or unstructured databases. Presently, there still lacks an index structure providing efficient support for structural queries and the traditional data-centric and content queries. This paper presents an extended index structure based on the preorder traversal rank and the level (or depth) rank of each node in a document tree. The extended index fully supports the navigation of all XPath axes while efficiently supporting data-centric queries. The ability to start path traversals from arbitrary nodes in a document tree also enables the extended index to support the evaluation of path traversals embedded in XQuery expressions. Furthermore, an encoding technique is presented where properties of the level ranking may be exploited to provide efficient and optimised level-based XPath evaluations. 1
A Unifying Framework for Behavior-based Trust Models
"... Abstract. Trust models have been touted to facilitate cooperation among unknown entities. Existing behavior-based trust models typically include a fixed evaluation scheme to derive the trustworthiness of an entity from knowledge about its behavior in previous interactions. This paper in turn propose ..."
Abstract
-
Cited by 2 (0 self)
- Add to MetaCart
(Show Context)
Abstract. Trust models have been touted to facilitate cooperation among unknown entities. Existing behavior-based trust models typically include a fixed evaluation scheme to derive the trustworthiness of an entity from knowledge about its behavior in previous interactions. This paper in turn proposes a framework for behavior-based trust models for open environments with the following distinctive characteristic. Based on a relational representation of behavior-specific knowledge, we propose a trust-policy algebra allowing for the specification of a wide range of trust-evaluation schemes. A key observation is that the evaluation of the standing of an entity in the network of peers requires centrality indices, and we propose a first-class operator of our algebra for computation of centrality measures. This paper concludes with some preliminary performance experiments that confirm the viability of our approach. 1
Recursion in xquery: put your distributivity safety belt on
- In EDBT ’09: Proceedings of the 12th International Conference on Extending Database Technology
, 2009
"... ABSTRACT We introduce a controlled form of recursion in XQuery, an inflationary fixed point operator, familiar from the context of relational databases. This operator imposes restrictions on the expressible types of recursion, but it is sufficiently versatile to capture a wide range of interesting ..."
Abstract
-
Cited by 2 (0 self)
- Add to MetaCart
(Show Context)
ABSTRACT We introduce a controlled form of recursion in XQuery, an inflationary fixed point operator, familiar from the context of relational databases. This operator imposes restrictions on the expressible types of recursion, but it is sufficiently versatile to capture a wide range of interesting use cases, including Regular XPath and its core transitive closure operator. While the optimization of general user-defined recursive functions in XQuery appears elusive, we describe how inflationary fixed points can be efficiently evaluated, provided that the recursive XQuery expressions are distributive. We test distributivity syntactically and algebraically, and provide experimental evidence that XQuery processors can benefit substantially from this mode of evaluation.
Pathfinder: A Relational Query Optimizer Explores XQuery Terrain
- In Proc. of the 2007 BTW Conference (Datenbanksysteme für Business, Technologie und Web
, 2007
"... Relational encodings of the static aspects of the XQuery data model, i.e., tabular representations for XML documents and ordered sequences of items, are widely used today. Since 2002, the Pathfinder and MonetDB/XQuery companion projects [BGvK + 06] pursue the primary goal to also embrace the complet ..."
Abstract
-
Cited by 1 (1 self)
- Add to MetaCart
(Show Context)
Relational encodings of the static aspects of the XQuery data model, i.e., tabular representations for XML documents and ordered sequences of items, are widely used today. Since 2002, the Pathfinder and MonetDB/XQuery companion projects [BGvK + 06] pursue the primary goal to also embrace the complete dynamic semantics of XQuery (expression evaluation and runtime aspects) with the help of relational database systems. In earlier work [GT04], we have shown that relational algebra makes for a suitable target language in an XQuery compiler. This purely relational approach to XQuery inherits the scalability advantages of the underlying relational database back-end and makes proven optimization techniques immediately applicable to the construction of XQuery processors. MonetDB/XQuery, an open-source system that implements this approach, is found among the fastest and most scalable XQuery processors available today [BGvK + 06]. This is a demonstration of the relational optimizer of Pathfinder 1, the query compiler behind MonetDB/XQuery. To account for the significant size and unusual shape of the relational query plans (see Figure 1) derived from input XQuery expressions, Pathfinder implements various optimization techniques in a peephole-style fashion and provides support for graph-shaped plans from the ground up. 2 Relational Query Optimization in an XQuery Compiler Pathfinder’s XQuery compiler turns incoming XQuery expressions into relational query plans according to the loop-lifting compilation strategy we devised in [GT04]. In a nutshell, loop-lifting trades iteration (esp. the XQuery FLWOR construct) for efficient bulkoriented processing. The compiler emits expressions of a relational algebra whose operators have been chosen to match the actual capabilities of modern SQL query engines. A few representative operators are shown in Table 1 (note that non-standard operators like the XPath step join ¢ are synonyms for relational “micro-plans ” with an optimized implementation in Pathfinder’s back-end database system MonetDB). 1 MonetDB/XQuery and Pathfinder are available via
unknown title
"... We report on a compilation procedure that derives relational algebra plans from arbitrarily nested XQuery FLWOR blocks. While recent research was able to develop relational encodings of trees which may turn RDBMSs into highly efficient XPath and XML Schema processors, here we describe relational enc ..."
Abstract
- Add to MetaCart
(Show Context)
We report on a compilation procedure that derives relational algebra plans from arbitrarily nested XQuery FLWOR blocks. While recent research was able to develop relational encodings of trees which may turn RDBMSs into highly efficient XPath and XML Schema processors, here we describe relational encodings of nested iteration, variables, and the item sequences to which variables are bound. The developed techniques are purely relational in more than one sense: (a) we rely on a standard (or rather: classical) algebra that is readily supported by relational engines, and (b) we use relational concepts like functional and multivalued dependencies to significantly simplify the emitted plans. This work blends well with the mentioned tree encodings and thus contributes a further important building block to investigations into XQuery processors based on relational database technology. 1.