DMCA
Pergamum: Replacing tape with energy efficient, reliable, disk-based archival storage (2008)
Cached
Download Links
| Venue: | IN FAST-2008: 6TH USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES |
| Citations: | 64 - 14 self |
BibTeX
@INPROCEEDINGS{Storer08pergamum:replacing,
author = {Mark W. Storer and Kevin M. Greenan and Ethan L. Miller and Kaladhar Voruganti},
title = {Pergamum: Replacing tape with energy efficient, reliable, disk-based archival storage},
booktitle = {IN FAST-2008: 6TH USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES},
year = {2008},
pages = {1--16},
publisher = {}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
As the world moves to digital storage for archival purposes, there is an increasing demand for reliable, lowpower, cost-effective, easy-to-maintain storage that can still provide adequate performance for information retrieval and auditing purposes. Unfortunately, no current archival system adequately fulfills all of these requirements. Tape-based archival systems suffer from poor random access performance, which prevents the use of inter-media redundancy techniques and auditing, and requires the preservation of legacy hardware. Many diskbased systems are ill-suited for long-term storage because their high energy demands and management requirements make them cost-ineffective for archival purposes. Our solution, Pergamum, is a distributed network of intelligent, disk-based, storage appliances that stores data reliably and energy-efficiently. While existing MAID systems keep disks idle to save energy, Pergamum adds NVRAM at each node to store data signatures, metadata, and other small items, allowing deferred writes, metadata requests and inter-disk data verification to be performed while the disk is powered off. Pergamum uses both intra-disk and inter-disk redundancy to guard against data loss, relying on hash tree-like structures of algebraic signatures to efficiently verify the correctness of stored data. If failures occur, Pergamum uses staggered rebuild to reduce peak energy usage while rebuilding large redundancy stripes. We show that our approach is comparable in both startup and ongoing costs to other archival technologies and provides very high reliability. An evaluation of our implementation of Pergamum shows that it provides adequate performance.
Keyphrases
replacing tape energy efficient disk-based archival storage archival purpose adequate performance storage appliance high reliability information retrieval digital storage long-term storage management requirement easy-to-maintain storage data loss algebraic signature archival technology tape-based archival system inter-disk data verification legacy hardware maid system inter-disk redundancy many diskbased system energy usage hash tree-like structure large redundancy stripe metadata request data signature deferred writes auditing purpose poor random access performance high energy demand inter-media redundancy technique current archival system small item ongoing cost distributed network
