Clustering support with a single-system image view for large-scale Web servers is important to improve the system scalability in processing a large number of concurrent requests from Internet, especially when dynamic content generation using CGI or other protocols becomes increasingly popular. This paper studies a two-level scheduling framework with a master/slave architecture for clustering Web servers. Such an architecture has advantages in dynamic resource recruitment, fail-over management and it can also improve server performance compared to a flat architecture. The key methods we propose to make this architecture efficient are the separation of static and dynamic content processing, low overhead remote execution, and reservation-based scheduling which considers both I/O and CPU utilization. This paper provides a comparison of several scheduling approaches using experimental evaluation and analytic modeling. The results show that proper optimization in resource management can lead to over 65 % performance improvement for a fixed number of nodes, and can achieve more substantial improvement when considering idle resource recruitment. 1
|
799
|
Condor - A Hunter of Idle Workstations
– Litzkow, Livny, et al.
- 1988
|
|
535
|
PVM: Parallel Virtual Machine: A Users’ Guide and Tutorial for Networked Parallel Computing
– Geist, Beguelin, et al.
- 1994
|
|
310
|
Clusterbased scalable network services
– Fox, Gribble, et al.
- 1997
|
|
276
|
LMbench: Portable tools for performance analysis
– McVoy, Staelin
- 1996
|
|
236
|
NetSolve: A Network Server for Solving Computational Science Problems, Int’l
– Casanova, Dongarra
- 1997
|
|
148
|
Quantitative System Performance: Computer System Analysis Using Queueing Network models
– Lazowska, Zahorjan, et al.
- 1984
|
|
124
|
Improving Web Server Performance by Caching Dynamic Data
– Iyengar, Challenger
- 1997
|
|
117
|
the NOW team, “A Case for NOW (Networks of Workstations
– Anderson, Culler, et al.
|
|
109
|
A scalable HTTP server: The NCSA prototype
– Katz, Butler, et al.
- 1994
|
|
72
|
ONE-IP: Techniques for hosting a service on a cluster of machines
– Damani, Chung, et al.
- 1997
|
|
60
|
The Utility of Exploiting Idle Workstations for Parallel Computation
– Acharya, Edjlali, et al.
- 1997
|
|
52
|
Task Assignment in a Distributed System: Improving Performance by Unbalancing Load
– Crovella, Harchol-Balter, et al.
- 1998
|
|
46
|
Analysis of task assignment policies in scalable distributed Web-server systems
– COLAJANNI, YU, et al.
- 1998
|
|
42
|
Cooperative caching of dynamic content on a distributed web server
– Holmedahl, Smith, et al.
- 1998
|
|
37
|
WebStone: the first generation in HTTP server benchmarking
– Trent, Sake
- 1995
|
|
32
|
An Analysis of Web Server Performance
– Iyengar, MacNair, et al.
- 1997
|
|
27
|
Webglimpse: Combining browsing and searching
– MANBER, SMITH, et al.
- 1997
|
|
22
|
Adaptive load sharing for clustered digital library servers
– Zhu, Yang, et al.
- 2000
|
|
21
|
SWEB: Towards a Scalable WWW Server on MultiComputers
– Andresen, Yang, et al.
- 1996
|
|
19
|
Scalability issues for high performance digital libraries on the world wide web
– Andreson, Yang, et al.
- 1996
|
|
14
|
Digital's Web Proxy Traces. ftp://ftp.digital.com/pub/DEC/traces/proxy/webtraces.html
– Kroeger, Mogul, et al.
- 1996
|
|
13
|
Building a world-wide virtual machine based on Web and HPCC technologies
– Dincer, Fox
- 1996
|
|
12
|
SMART UNIX SVR4 Support for Multimedia Applications
– Lam
|
|
3
|
The Inktomi Technology Behind HotBot, a White Paper. http://www.inktomi.com
– Corporation
- 1996
|
|
3
|
Gateway Interface. http://booboo.ncsa.uiuc.edu/cgi
– Common
- 1995
|
|
3
|
UNIX SVR4 Support for Multimedia Applications
– SMART
- 1997
|
|
2
|
Revised version appeared in
– Andresen, Carver, et al.
- 1995
|
|
2
|
Yahoo! Investor Relations
– Inc
- 1998
|
|
1
|
Zeus Web Server v3. http://www.zeustech.net
– Technology
- 1998
|