MetaCartSign in to MyCiteSeer

Include Citations | Advanced Search | Help

Include Citations | Advanced Search | Help

  Configuring and Scheduling An Eager-Writing Disk Array for a Transaction Processing Workload

Download:
Download as a PDF | Download as a PS
by Olph Y. Wang
http://lambda.cs.yale.edu/~arvind/papers/mimd_ew.ps
Add To MetaCart

Abstract:

Transaction processing applications such as those exemplified by the TPC-C benchmark are among the most demanding I/O applications for conventional storage systems. Two complementary techniques exist to improve the performance of these systems. Eager-writing allows the free block that is closest to a disk head to be selected for servicing a write request, and mirroring allows the replica that is closest to be selected for servicing a read request. Applied individually, the e#ectiveness of each of these techniques is limited. An eagerwriting disk array (EW-Array) combines these two complementary techniques. In such a system, eager-writing enables low-cost replica propagation so that the system can provide excellent performance for both read and write operations while maintaining a high degree of reliability. To fully realize the potential of an EW-Array, we must answer at least two key questions. First, since both eager-writing and mirroring rely on extra capacity to deliver performance improvements, how do we satisfy competing resource demands given a fixed amount of total disk space? Second, since eager-writing allows data to be dynamically located, how do we exploit this high degree of location independence in an intelligent disk scheduler? In this paper, we address these two key questions and compare the resulting EW-Array prototype performance against that of conventional approaches. The experimental results demonstrate that the eagerwriting disk array is an e#ective approach to providing scalable performance for an important class of transaction processing applications.

Citations

656 The design and implementation of a log-structured file system – Rosenblum, Ousterhout - 1992
194 Disk Scheduling Revisited – Seltzer, Chen, et al. - 1990
162 Non-Volatile Memory for Fast, Reliable File Systems – Baker, Asami, et al. - 1992
158 An Implementation of a Log-Structured File System for – Seltzer, Bostic, et al. - 1993
141 Disk scheduling algorithms based on rotational position – Jacobson, Wilkes - 1991
131 Disk Shadowing – Bitton, Gray - 1988
100 File system logging versus clustering: A performance comparison – Seltzer, Smith, et al. - 1995
91 Chained declustering: a new availability strategy for multiprocessor database machines – Hsiao, DeWitt - 1990
67 Towards Higher Disk Head Utilization: Extracting Free Bandwidth From Busy Disk Drives – Lumb, Schindler, et al. - 2000
63 DCD -- disk caching disk: A new approach for boosting I/O performance – Hu, Yang - 1996
56 Loge: a self-organizing disk controller – English, Stepanov - 1992
56 Virtual Log Based File Systems for a Programmable Disk – Wang, Anderson, et al. - 1999
52 Parity logging overcoming the small write problem in redundant disk arrays – Stodolsky, Gibson, et al. - 1993
52 Trading capacity for performance in a disk array – Yu, Gum, et al. - 2000
40 Distorted mirrors – Orji, Solworth - 1993
37 Mime: A high performance parallel storage device with strong recovery guarantees – Chao, English, et al. - 1992
30 RAPIDCache —a Reliable and Inexpensive Write Cache for High Performance Storage Systems – Hu, Yang, et al. - 2002
26 Floating Parity and Data Disk Arrays – Menon, Roche, et al. - 1993
22 Attribute-managed storage – Golding, Shriver, et al. - 1995
21 Transaction Monitoring in Encompass: Reliable Distributed Transaction Processing – Borr - 1981
21 Disk Mirroring with Alternating Deferred Updates – Polyzois, Bhide, et al. - 1993
12 Chained Declustering: A New Availability Strategy for Multiprocessor Database Machines – Hsiao, DeWitt - 1990
9 Emerging Trends in Data Storage on Magnetic Hard Disk Drives – Growchowski - 1998
5 Method and Apparatus for Logging Journal Data Using a Log Write Ahead Data Set. U.S. Patent 4507751 issued to IBM – Gawlick, Gray, et al. - 1985
4 Implementing Long Lived Transactions Using Log Record Forwarding – Hagmann, Garcia-Molina - 1991
2 Disk Dual Copy Methods and Their Performance – Dishon, Lui - 1988
2 RAPIDCache—A Reliable and Inexpensive Write Cache for Disk I/O Systems – Hu, Yang, et al. - 1999
2 Trail: Write Optimized Disk Storage System. http://www.ecsl.cs.sunysb.edu/trail.html – Huang, Chiueh