DMCA
Evaluation of Distributed Recovery in Large-Scale Storage Systems (2004)
Cached
Download Links
| Venue: | IN PROCEEDINGS OF THE 13TH IEEE INTERNATIONAL SYMPOSIUM ON HIGH PERFORMANCE DISTRIBUTED COMPUTING (HPDC |
| Citations: | 40 - 9 self |
BibTeX
@INPROCEEDINGS{Xin04evaluationof,
author = {Qin Xin and Ethan L. Miller and Thomas J. E. Schwarz},
title = {Evaluation of Distributed Recovery in Large-Scale Storage Systems},
booktitle = {IN PROCEEDINGS OF THE 13TH IEEE INTERNATIONAL SYMPOSIUM ON HIGH PERFORMANCE DISTRIBUTED COMPUTING (HPDC},
year = {2004},
pages = {172--181},
publisher = {}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Storage clusters consisting of thousands of disk drives are now being used both for their large capacity and high throughput. However, their reliability is far worse than that of smaller storage systems due to the increased number of storage nodes. RAID technology is no longer sufficient to guarantee the necessary high data reliability for such systems, because disk rebuild time lengthens as disk capacity grows. In this paper, we present FAst Recovery Mechanism (FARM), a distributed recovery approach that exploits excess disk capacity and reduces data recovery time. FARM works in concert with replication and erasure-coding redundancy schemes to dramatically lower the probability of data loss in large-scale storage systems. We have examined essential factors that influence system reliability, performance, and costs, such as failure detections, disk bandwidth usage for recovery, disk space utilization, disk drive replacement, and system scales, by simulating system behavior under disk failures. Our results show the reliability improvement from FARM and demonstrate the impacts of various factors on system reliability. Using our techniques, system designers will be better able to build multi-petabyte storage systems with much higher reliability at lower cost than previously possible.
Keyphrases
large-scale storage system distributed recovery disk capacity necessary high data reliability reliability improvement storage node system designer data loss disk drive distributed recovery approach disk drive replacement storage cluster fast recovery mechanism system reliability erasure-coding redundancy scheme disk bandwidth usage storage system system scale influence system reliability essential factor multi-petabyte storage system large capacity high throughput excess disk capacity disk failure disk rebuild time various factor reduces data recovery time raid technology failure detection disk space utilization
