MetaCartSign in to MyCiteSeer

Include Citations | Advanced Search | Help

Include Citations | Advanced Search | Help

  Adaptive load sharing for clustered digital library servers (1998) [22 citations — 6 self]

Download:
Download as a PDF | Download as a PS
by Huican Zhu, Tao Yang, Qi Zheng, David Watson, Oscar H. Ibarra, Terence Smith
Procecedings of the Seventh High Performance Distributed Computing
http://www.cs.ucsb.edu/TRs/Docs/TRCS98-20.ps
Add To MetaCart

Abstract:

This paper investigates load balancing strategies for clustered Alexandria digital library (ADL) servers. The ADL system, which provides on-line information searching and browsing of spatially-referenced materials through the World Wide Web, involves intensive database I/O and heterogeneous CPU activities. Clustering servers can improve the scalability of the ADL system in response to a large number of simultaneous access requests. One difficulty addressed is that clustered workstation nodes may be non-uniform in terms of CPU and I/O speeds. An optimization scheme is proposed in this paper to dynamically monitor the resource availability, use a low-cost communication strategy for updating load information among nodes, and schedule requests based on both I/O and computation load indices. Since the accurate cost estimation for processing database-searching requests is difficult, a sampling and prediction scheme is used to identify the relative efficiency of nodes for satisfying I/O and CPU demands of these requests. A set of experiments using the ADL traces have been conducted to verify the effectiveness of the proposed strategies. 1

Citations

345 Adaptive load sharing in homogeneous distributed systems – Eager, Lazowska, et al. - 1986
124 Improving Web Server Performance by Caching Dynamic Data – Iyengar, Challenger - 1997
114 Trace-Driven Simulation Study of Dynamic Load Balancing – Zhou, “A - 1988
109 A scalable HTTP server: The NCSA prototype – Katz, Butler, et al. - 1994
72 ONE-IP: Techniques for hosting a service on a cluster of machines – Damani, Chung, et al. - 1997
60 Query size estimation by adaptive sampling – Lipton, Naughton - 1995
43 A scalable and highly available system for serving dynamic data at frequently accessed web sites – Challenger, Dantzig, et al. - 1998
42 Cooperative caching of dynamic content on a distributed web server – Holmedahl, Smith, et al. - 1998
41 A digital library for geographically referenced materials – Smith, Andresen, et al. - 1996
36 Probability, Stochastic Processes, and Queueing theory – Nelson - 1995
25 Scheduling algorithms for distributed web servers – Colajanni, Yu, et al. - 1997
21 SWEB: Towards a Scalable WWW Server on MultiComputers – Andresen, Yang, et al. - 1996
19 Scheduling Optimization for Resource-Intensive Web Requests on Server Clusters – Zhu, Smith, et al. - 1999
15 A Scalable HTTP – Katz, Butler, et al. - 1994
10 Performance impact of scheduling discipline on adaptive load sharing in homogeneous distributed systems – Dandamudi - 1995
9 Dynamic processor scheduling with client resources for fast multi-resolution WWW image browsing – Andresen, Yang, et al. - 1997
9 A scheduling framework for web server clusters with intensive dynamic content processing – Zhu, Smith, et al. - 1998
9 The WWW prototype of the Alexandria Digital Library – Andresen - 1995
6 The Art of Computer Systems Performance – JAIN - 1991
5 A Compact Storage Scheme for Fast Wavelet-based Subregion Retrieval – Poulakidas, Srinivasan, et al. - 1997
4 The Magicrouter, an Application of Fast – Anderson, Patterson, et al. - 1996
3 gateway interface. http://hoohoo.ncsa.uiuc.edu/cgi/intro.html – Common