MetaCartSign in to MyCiteSeer

Include Citations | Advanced Search | Help

Include Citations | Advanced Search | Help

  A scheduling framework for web server clusters with intensive dynamic content processing (1998) [9 citations — 3 self]

Download:
Download as a PDF | Download as a PS
by Huican Zhu, Ben Smith, Tao Yang
Proceedings of the 1999 ACM SIGMETRICS Conference
http://www.cs.ucsb.edu/TRs/Docs/TRCS98-29.ps
Add To MetaCart

Abstract:

Clustering support with a single-system image view for large-scale Web servers is important to improve the system scalability in processing a large number of concurrent requests from Internet, especially when dynamic content generation using CGI or other protocols becomes increasingly popular. This paper studies a two-level scheduling framework with a master/slave architecture for clustering Web servers. Such an architecture has advantages in dynamic resource recruitment, fail-over management and it can also improve server performance compared to a flat architecture. The key methods we propose to make this architecture efficient are the separation of static and dynamic content processing, low overhead remote execution, and reservation-based scheduling which considers both I/O and CPU utilization. This paper provides a comparison of several scheduling approaches using experimental evaluation and analytic modeling. The results show that proper optimization in resource management can lead to over 65 % performance improvement for a fixed number of nodes, and can achieve more substantial improvement when considering idle resource recruitment. 1

Citations

799 Condor - A Hunter of Idle Workstations – Litzkow, Livny, et al. - 1988
535 PVM: Parallel Virtual Machine: A Users’ Guide and Tutorial for Networked Parallel Computing – Geist, Beguelin, et al. - 1994
310 Clusterbased scalable network services – Fox, Gribble, et al. - 1997
276 LMbench: Portable tools for performance analysis – McVoy, Staelin - 1996
236 NetSolve: A Network Server for Solving Computational Science Problems, Int’l – Casanova, Dongarra - 1997
148 Quantitative System Performance: Computer System Analysis Using Queueing Network models – Lazowska, Zahorjan, et al. - 1984
124 Improving Web Server Performance by Caching Dynamic Data – Iyengar, Challenger - 1997
117 the NOW team, “A Case for NOW (Networks of Workstations – Anderson, Culler, et al.
109 A scalable HTTP server: The NCSA prototype – Katz, Butler, et al. - 1994
72 ONE-IP: Techniques for hosting a service on a cluster of machines – Damani, Chung, et al. - 1997
60 The Utility of Exploiting Idle Workstations for Parallel Computation – Acharya, Edjlali, et al. - 1997
52 Task Assignment in a Distributed System: Improving Performance by Unbalancing Load – Crovella, Harchol-Balter, et al. - 1998
46 Analysis of task assignment policies in scalable distributed Web-server systems – COLAJANNI, YU, et al. - 1998
42 Cooperative caching of dynamic content on a distributed web server – Holmedahl, Smith, et al. - 1998
37 WebStone: the first generation in HTTP server benchmarking – Trent, Sake - 1995
32 An Analysis of Web Server Performance – Iyengar, MacNair, et al. - 1997
27 Webglimpse: Combining browsing and searching – MANBER, SMITH, et al. - 1997
22 Adaptive load sharing for clustered digital library servers – Zhu, Yang, et al. - 2000
21 SWEB: Towards a Scalable WWW Server on MultiComputers – Andresen, Yang, et al. - 1996
19 Scalability issues for high performance digital libraries on the world wide web – Andreson, Yang, et al. - 1996
14 Digital's Web Proxy Traces. ftp://ftp.digital.com/pub/DEC/traces/proxy/webtraces.html – Kroeger, Mogul, et al. - 1996
13 Building a world-wide virtual machine based on Web and HPCC technologies – Dincer, Fox - 1996
12 SMART UNIX SVR4 Support for Multimedia Applications – Lam
3 The Inktomi Technology Behind HotBot, a White Paper. http://www.inktomi.com – Corporation - 1996
3 Gateway Interface. http://booboo.ncsa.uiuc.edu/cgi – Common - 1995
3 UNIX SVR4 Support for Multimedia Applications – SMART - 1997
2 Revised version appeared in – Andresen, Carver, et al. - 1995
2 Yahoo! Investor Relations – Inc - 1998
1 Zeus Web Server v3. http://www.zeustech.net – Technology - 1998