Download:
|
by Huican Zhu, Tao Yang, Qi Zheng, David Watson, Oscar H. Ibarra, Terence Smith
Procecedings of the Seventh High Performance Distributed Computing
http://www.cs.ucsb.edu/TRs/Docs/TRCS98-20.ps
Add To MetaCart
Abstract:
This paper investigates load balancing strategies for clustered Alexandria digital library (ADL) servers. The ADL system, which provides on-line information searching and browsing of spatially-referenced materials through the World Wide Web, involves intensive database I/O and heterogeneous CPU activities. Clustering servers can improve the scalability of the ADL system in response to a large number of simultaneous access requests. One difficulty addressed is that clustered workstation nodes may be non-uniform in terms of CPU and I/O speeds. An optimization scheme is proposed in this paper to dynamically monitor the resource availability, use a low-cost communication strategy for updating load information among nodes, and schedule requests based on both I/O and computation load indices. Since the accurate cost estimation for processing database-searching requests is difficult, a sampling and prediction scheme is used to identify the relative efficiency of nodes for satisfying I/O and CPU demands of these requests. A set of experiments using the ADL traces have been conducted to verify the effectiveness of the proposed strategies. 1
Citations
|
345
|
Adaptive load sharing in homogeneous distributed systems
– Eager, Lazowska, et al.
- 1986
|
|
124
|
Improving Web Server Performance by Caching Dynamic Data
– Iyengar, Challenger
- 1997
|
|
114
|
Trace-Driven Simulation Study of Dynamic Load Balancing
– Zhou, “A
- 1988
|
|
109
|
A scalable HTTP server: The NCSA prototype
– Katz, Butler, et al.
- 1994
|
|
72
|
ONE-IP: Techniques for hosting a service on a cluster of machines
– Damani, Chung, et al.
- 1997
|
|
60
|
Query size estimation by adaptive sampling
– Lipton, Naughton
- 1995
|
|
43
|
A scalable and highly available system for serving dynamic data at frequently accessed web sites
– Challenger, Dantzig, et al.
- 1998
|
|
42
|
Cooperative caching of dynamic content on a distributed web server
– Holmedahl, Smith, et al.
- 1998
|
|
41
|
A digital library for geographically referenced materials
– Smith, Andresen, et al.
- 1996
|
|
36
|
Probability, Stochastic Processes, and Queueing theory
– Nelson
- 1995
|
|
25
|
Scheduling algorithms for distributed web servers
– Colajanni, Yu, et al.
- 1997
|
|
21
|
SWEB: Towards a Scalable WWW Server on MultiComputers
– Andresen, Yang, et al.
- 1996
|
|
19
|
Scheduling Optimization for Resource-Intensive Web Requests on Server Clusters
– Zhu, Smith, et al.
- 1999
|
|
15
|
A Scalable HTTP
– Katz, Butler, et al.
- 1994
|
|
10
|
Performance impact of scheduling discipline on adaptive load sharing in homogeneous distributed systems
– Dandamudi
- 1995
|
|
9
|
Dynamic processor scheduling with client resources for fast multi-resolution WWW image browsing
– Andresen, Yang, et al.
- 1997
|
|
9
|
A scheduling framework for web server clusters with intensive dynamic content processing
– Zhu, Smith, et al.
- 1998
|
|
9
|
The WWW prototype of the Alexandria Digital Library
– Andresen
- 1995
|
|
6
|
The Art of Computer Systems Performance
– JAIN
- 1991
|
|
5
|
A Compact Storage Scheme for Fast Wavelet-based Subregion Retrieval
– Poulakidas, Srinivasan, et al.
- 1997
|
|
4
|
The Magicrouter, an Application of Fast
– Anderson, Patterson, et al.
- 1996
|
|
3
|
gateway interface. http://hoohoo.ncsa.uiuc.edu/cgi/intro.html
– Common
|