Loosely-coupled distributed systems have significant scale and cost advantages over more traditional architectures, but the availability of the nodes in these systems varies widely. Availability modeling is crucial for predicting per-machine resource burdens and understanding emergent, system-wide phenomena. We present new techniques for predicting availability and test them using traces taken from three distributed systems. We then describe three applications of availability prediction. The first, availability-guided replica placement, reduces object copying in a distributed data store while increasing data availability. The second shows how availability prediction can improve routing in delay-tolerant networks. The third combines availability prediction with virus modeling to improve forecasts of global infection dynamics. 1
|
682
|
A measurement study of peer-to-peer file sharing systems
– Saroiu, Gummadi, et al.
- 2002
|
|
664
|
Adaptive Filter Theory
– Haykin
- 1991
|
|
521
|
Combining branch predictors
– McFarling
- 1993
|
|
403
|
Numerical Recipes in C
– Press, Teukolsky, et al.
- 1992
|
|
201
|
Feasibility of a Serverless Distributed File System Deployed on an Existing Set of Desktop PCs
– Bolosky, Douceur, et al.
- 2000
|
|
165
|
An analysis of Internet content delivery systems
– Saroiu, Gummadi, et al.
- 2002
|
|
161
|
Understanding availability
– Bhagwan, Savage, et al.
|
|
147
|
A delay-tolerant network architecture for challenged internets
– Fall
- 2003
|
|
144
|
Code-Red: a case study on the spread and victims of an Internet worm
– Moore, Shannon, et al.
- 2002
|
|
125
|
Routing in a Delay Tolerant Network
– Jain, Fall, et al.
- 2004
|
|
98
|
Operating system support for planetary-scale network services
– Bavier, Bowman, et al.
- 2004
|
|
86
|
Epidemic spreading in scale-free networks
– PASTOR-SATORRAS, 2001b
|
|
78
|
Directed-graph Epidemiological Models of Computer Viruses
– Kephart, White
- 1991
|
|
69
|
High availability, scalable storage, dynamic peer neetworks: Pick two
– Blake, Rodrigues
- 2003
|
|
68
|
Total recall: System support for automated availability management
– Bhagwan, Tati, et al.
- 2004
|
|
51
|
The case for efficient file access pattern modeling
– Kroeger, Long
- 1999
|
|
45
|
Controlling the cost of reliability in peer-to-peer overlays
– Mahajan, Castro, et al.
- 2003
|
|
44
|
A longitudinal survey of internet host reliability
– Long, Muri, et al.
- 1995
|
|
34
|
Performance Measurements of Automatic Prefetching
– Griffioen, Appleton
- 1995
|
|
33
|
Epidemic spreading in real networks: An eigenvalue viewpoint
– WANG, CHAKRABARTI, et al.
- 2003
|
|
31
|
Experiences with predicting resource performance on-line in computational grid settings
– Wolski
|
|
29
|
Replication Strategies for Highly Available Peer-to-peer Storage Systems
– Bhagwan, Savage, et al.
- 2002
|
|
29
|
Optimizing File Availability in a Secure Serverless Distributed File System
– Douceur, Wattenhofer
- 2001
|
|
23
|
Modeling Machine Availability in Enterprise and Wide-area Distributed Computing Environments
– NURMI, BREVIK, et al.
- 2005
|
|
18
|
Large-Scale Simulation of Replica Placement Algorithms for a Serverless Distributed File System
– Douceur, Wattenhofer
- 2001
|
|
17
|
M: "Approximate entropy as a measure of system complexity
– Pincus
- 1991
|
|
6
|
Is remote host availability governed by a universal law
– DOUCEUR
- 2003
|
|
6
|
Availability in global peer-to-peer storage systems
– Schwarz, Xin, et al.
- 2004
|
|
5
|
Measurement-based availability analysis of Unix systems in a distributed environment
– Simache, Kaâniche
- 2001
|
|
3
|
Studying e-mail graphs for intelligence monitoring and analysis in the absence of semantic information
– Drineas, Krishnamoorthy, et al.
- 2004
|
|
3
|
Modeling users’ mobility among WiFi access points
– Kim, Kotz
- 2005
|
|
3
|
Chord: A scalabale peer-to-peer lookup service for Internet applications
– Stoica, Morris, et al.
- 2001
|
|
1
|
miChord: decoupling object lookup from placement in DHT-Based Overlays. http://www.loai-naamani.com/Academics/miChord.htm
– Chen, Naamani, et al.
|
|
1
|
A Border Gateway
– Duvall
- 2006
|
|
1
|
All-pairs PlanetLab Ping Data. http://www.pdos.lcs.mit.edu/˜strib/pl app
– Stribling
|
