What’s different: Distributed, continuous monitoring of duplicate-resilient aggregates on data streams

What’s different: Distributed, continuous monitoring of duplicate-resilient aggregates on data streams (2006)

Cached

Download Links

by Graham Cormode

Venue:	In ICDE
Citations:	19 - 6 self

Versions

Version History

Metadata Version 1

Datum	Value	Source
TITLE	What’s different: Distributed, continuous monitoring of duplicate-resilient aggregates on data streams	INFERENCE
AUTHOR NAME	Graham Cormode	SVM HeaderParse 0.2
AUTHOR AFFIL	Bell Laboratories	SVM HeaderParse 0.2
ABSTRACT	Emerging applications in sensor systems and network-wide IP traffic analysis present many technical challenges. They need distributed monitoring and continuous tracking of events. They have severe resource constraints not only at each site in terms of per-update processing time and archival space for highspeed streams of observations, but also crucially, communication constraints for collaborating on the monitoring task. These elements have been addressed in a series of recent works. A fundamental issue that arises is that one cannot make the “uniqueness ” assumption on observed events which is present in previous works, since widescale monitoring invariably encounters the same events at different points. For example, within the network of an Internet Service Provider packets of the same flow will be observed in different routers; similarly, the same individual will be observed by multiple mobile sensors in monitoring wild animals. Aggregates of interest on such distributed environments must be resilient to duplicate observations. We study such duplicate-resilient aggregates that measure the extent of the duplication—how many unique observations are there, how many observations are unique—as well as standard holistic aggregates such as quantiles and heavy hitters over the unique items. We present accuracy guaranteed, highly communication-efficient algorithms for these aggregates that work within the time and space constraints of high speed streams. We also present results of a detailed experimental study on both real-life and synthetic data. 1	SVM HeaderParse 0.2
YEAR	2006	INFERENCE
VENUE	In ICDE	INFERENCE
VENUE TYPE	CONFERENCE	INFERENCE
PAGES	57	INFERENCE
CITATIONS	2 found	ParsCit 1.0