DMCA
Resource-aware mining with variable granularities in data streams
| Venue: | In SDM 2004 |
| Citations: | 8 - 0 self |
BibTeX
@INPROCEEDINGS{Teng_resource-awaremining,
author = {Wei-guang Teng and Ming-syan Chen and Philip S. Yu},
title = {Resource-aware mining with variable granularities in data streams},
booktitle = {In SDM 2004},
year = {}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
For data stream applications, both approximation and adaptability are important issues for effective mining. We explore in this paper a fundamental problem that how the limited resources, e.g., memory space and computation power, can be well utilized to produce accurate estimates. Two important features for tracking mined patterns with properly utilized resources are examined. The first issue is temporal granularity which refers to the phenomenon that as time advances, people are more interested in recent events, meaning that more resources can be utilized to explore more recent data with finer granularities. Second, with the mining task of discovering frequent temporal patterns, more resources are expected to be allocated to the processing of those borderline patterns whose statistics, e.g., occurrence frequencies, are close to the specified thresholdsoastohaveproperfrequentitemsetidentification. This feature is called mining with support count granularity. Consequently, algorithm RAM-DS (Resource-Aware Mining for Data Streams) is designed to not only reduce the memory required for data storage but also retain good approximation of target time series. Experimental results have shown that the memory required for storing significant wavelet coefficients is very small and the quality of approximation is stable when performing incremental data updates, indicating that algorithm RAM-DS is feasible and suitable for adaptive mining in data streams. 1
Keyphrases
data stream resource-aware mining variable granularity algorithm ram-ds first issue utilized resource data storage adaptive mining finer granularity temporal granularity computation power frequent temporal pattern recent event mining task occurrence frequency good approximation fundamental problem data stream application incremental data update limited resource accurate estimate significant wavelet coefficient important feature target time series borderline pattern support count granularity important issue memory space recent data effective mining experimental result time advance
