MetaCartSign in to MyCiteSeer

Include Citations | Advanced Search | Help

Include Citations | Advanced Search | Help

  Self-similarity in file systems (1998) [22 citations — 1 self]

Download:
Download as a PDF | Download as a PS
by Steven D. Gribble, Gurmeet Singh Manku, Eric A. Brewer, Timothy J. Gibson, Ethan L. Miller
In Proceedings of ACM SIGMETRICS ’98
http://www.cs.berkeley.edu/~gribble/papers/selfsim-fs.ps.gz
Add To MetaCart

Abstract:

This paper demonstrates that high-level file system events are self-similar in nature through the analysis of three sets of traces that span timescales of milliseconds through months, and that differ in the trace collection method, the filesystems being traced, and the chronological times of the tracing. Two sets of detailed, short-term file system trace data are analyzed; both are shown to have consistent Hurst parameters (a measure of self-similarity) for all file system traffic as well as individual classes of file system events. Longterm file system trace data (of a much coarser granularity) is then analyzed to demonstrate that high variability and selfsimilarity persist across timescales of many months. Using the short-term trace data, we then show that sources of file system traffic exhibit ON/OFF source behaviour, which is characterized by highly variably lengthed bursts of activity, followed by similarly variably lengthed periods of inactivity. This ON/OFF behaviour is used to motivate a simple technique for synthesizing a stream of events that exhibit the same self-similar behaviour as the file system traces. 1

Citations

1387 On the Self-Similar Nature of Ethernet Traffic (Extended Version – Leland, Taqqu, et al. - 1994
1118 Wide area traffic: The failure of Poisson modeling – Paxson, Floyd - 1995
678 The design and implementation of a log-structured file system – Rosenblum, Ousterhout - 1991
640 A Scheme for Real-time Channel Establishment in Wide Area Networks – Ferrari, Verma - 1990
516 Self-similarity through high-variability: Statistical analysis of Ethernet LAN traffic at the source level – Willinger, Taqqu, et al. - 1997
381 Measurements of a distributed file system – Baker, Hartman, et al. - 1991
206 The HP AutoRAID Hierarchical Storage System – Wilkes, Golding, et al. - 1995
203 Long–range dependence in variable–bit–rate video traffic – Beran, Sherman, et al. - 1995
151 A Comparison of File System Workloads – Roselli, Lorch, et al. - 2000
87 Improving the performance of logstructured file systems with adaptive methods – Matthews, Roselli, et al. - 1997
79 Fast approximation of self similar network traffic – Paxson - 1995
78 editors. Chaos and Fractals: New Frontiers of Sciences – Peitgen, Jiirgens, et al. - 1992
72 A Quantitative Analysis of Cache Policies for Scalable Network File Systems – Dahlin, Mather, et al. - 1994
69 A Trace-Driven Analysis – Ousterhout, Costa, et al. - 1991
65 Heuristic cleaning algorithms in log-structured file systems – Blackwell, Harris, et al. - 1995
62 Explaining World Wide Web Traffic Self-Similarity – Crovella, Bestavros - 1995
53 Using renewal processes to generate long-range dependence and high variability – Taqqu, Levy - 1986
49 Computer experiments with fractional Gaussian noises – Mandelbrot, Wallis - 1969
35 Self-similar error clusters in communication sys-tems and the concept of conditional stationarity – MANDELBROT - 1965
27 Chaos and Order in the Capital Markets – Peters - 2000
14 Strips displaying empirical distributions: I. textured dot strips. Bellcore Technical Memorandum – Tukey, Tukey - 1990
12 Sugihara G: Fractals – A User’s Guide for The Natural Sciences – Hastings - 1993
11 File Layout and File System Performance – Smith, Seltzer - 1994
8 Long-term file activity patterns in a unix workstation environment – Gibson, Miller - 1998
7 The QQ-Estimator and Heavy Tails – Kratz, Resnick - 1995
5 Using the Sprite File System Traces – Hartman - 1993
4 Self-similar ("fractal") traffic in atm networks – Georganas - 1994
2 Modelling telecommunications systems that have power-tail (bursty, chaotic, heavy-tail, self-similar, etc.) trafc – Lipsky - 1996
1 The Fractal Nature of Geometry – Mandelbrot - 1983
1 What if the noise is the pattern – Adams - 1995