Storage management and caching in PAST, a large-scale, persistent peer-to-peer storage utility

DMCA

Storage management and caching in PAST, a large-scale, persistent peer-to-peer storage utility (2001)

Cached

Download Links

Other Repositories/Bibliography

DBLP

by Antony Rowstron , Peter Druschel

Citations:

805 - 23 self

BibTeX

@INPROCEEDINGS{Rowstron01storagemanagement,
    author = {Antony Rowstron and Peter Druschel},
    title = {Storage management and caching in PAST, a large-scale, persistent peer-to-peer storage utility},
    booktitle = {},
    year = {2001},
    pages = {188--201},
    publisher = {}
}

OpenURL

Abstract

This paper presents and evaluates the storage management and caching in PAST, a large-scale peer-to-peer persistent storage utility. PAST is based on a self-organizing, Internetbased overlay network of storage nodes that cooperatively route file queries, store multiple replicas of files, and cache additional copies of popular files. In the PAST system, storage nodes and files are each assigned uniformly distributed identifiers, and replicas of a file are stored at nodes whose identifier matches most closely the file’s identifier. This statistical assignment of files to storage nodes approximately balances the number of files stored on each node. However, non-uniform storage node capacities and file sizes require more explicit storage load balancing to permit graceful behavior under high global storage utilization; likewise, non-uniform popularity of files requires caching to minimize fetch distance and to balance the query load. We present and evaluate PAST, with an emphasis on its storage management and caching system. Extensive tracedriven experiments show that the system minimizes fetch distance, that it balances the query load for popular files, and that it displays graceful degradation of performance as the global storage utilization increases beyond 95%.

Keyphrases

storage management persistent peer-to-peer storage utility storage node popular file query load fetch distance file query global storage utilization past system graceful behavior high global storage utilization evaluate past explicit storage load file size large-scale peer-to-peer persistent storage utility file identifier identifier match store multiple replica caching system additional copy non-uniform storage node capacity non-uniform popularity extensive tracedriven experiment graceful degradation overlay network statistical assignment

DMCA