by Peter Scheuermann, Gerhard Weikum, Peter Zabback
http://www-dbs.cs.uni-sb.de/public_html/papers/paper.ps.Z
Add To MetaCart
Abstract:
Parallel disk systems provide opportunities for high performance I/O by supporting efficiently intra-request and inter-request parallelism. We review briefly the components of an intelligent file manager that performs striping on an individual file basis and achieves load balancing by judicious file allocation and dynamic redistribution of the data. The main part of the paper discusses our "disk cooling " procedure for dynamic redistribution of data which is based on reallocation of file fragments. We show that this heuristic method achieves excellent load balance in the presence of evolving access patterns. We report on two sets of experiments: a synthetic experiment which exhibits a self-similar skew in the data access patterns and a trace-based experiment where we study the impact of the file fragment size on the cooling procedure. 1
Citations
|
375
|
Measurements of a Distributed File System
– Baker, Hartman, et al.
- 1991
|
|
292
|
The Art of Computer Programming, Vol. 3: Sorting and Searching
– Knuth
- 1973
|
|
257
|
RAID: High-performance, reliable secondary storage
– Chen, Lee, et al.
- 1994
|
|
170
|
Disk Striping
– Salem, H
- 1986
|
|
136
|
Synchronized disk interleaving
– Kim
- 1986
|
|
132
|
Maximizing performance in a striped disk array
– Chen, Patterson
- 1990
|
|
116
|
Multi-Disk Management Algorithms
– Livny, Khoshafian, et al.
- 1987
|
|
89
|
Data Placement in Bubba
– Copeland
- 1988
|
|
68
|
Parity Striping of Disc Arrays: Low-Cost Reliable Storage with Acceptable Throughput
– Gray, Horst, et al.
- 1990
|
|
68
|
An Analytic Performance Model for Disk Arrays
– Lee, Katz
- 1993
|
|
62
|
Continuous retrieval of multimedia data using parallelism
– Ghandeharizadeh, Ramos
- 1993
|
|
55
|
Quickly generating billion-record synthetic databases
– Gray, Sundaresan, et al.
- 1994
|
|
53
|
Principles of delay-sensitive multimedia data storage and retreival
– Gemmell, Christodoulakis
- 1992
|
|
38
|
Data partitioning and load balancing in parallel disk systems
– Scheuermann, Weikum, et al.
- 1996
|
|
38
|
Dynamic File Allocation in Disk Arrays
– Weikum, Scheuermann
- 1991
|
|
24
|
The placement optimization program: a practical solution to the disk file assignment problem
– Wolf
- 1989
|
|
22
|
Multi-resolution video representation for parallel disk arrays
– Chiueh, Katz
- 1993
|
|
16
|
Adaptive load balancing in disk arrays
– Scheuermann, Weikum, et al.
- 1993
|
|
12
|
Tuning of Striping Units in Disk-Array-Based File Systems
– Weikum, Zabback
- 1992
|
|
9
|
CSIM Reference Manual (Revision 16
– Schwetman
- 1992
|
|
6
|
Performance analysis of a dual striping strategy for replicated disk arrays
– Merchant, Yu
- 1993
|
|
1
|
I/O Parallelism in Database Systems
– Zabback
- 1994
|
