MetaCartSign in to MyCiteSeer

Include Citations | Advanced Search | Help

Include Citations | Advanced Search | Help

  Final report for ELEC520 Scalability in Web Servers: A Distributed Approach

Download:
Download as a PDF | Download as a PS
by Cristian Coarfa, Zhelyko Chakareski, Vikram Kanodia
http://www.owlnet.rice.edu/~comp520/project/report-final/lard-dist-finalrep.ps
Add To MetaCart

Abstract:

With the explosion in WWW traffic, Web server performance is becoming increasingly important. We consider a cluster-based network server in which all incoming requests are distributed among a number of backend machines. Specifically we make use of the content aware distribution of requests (as proposed in [1]). This scheme takes into account the content of the requested document to achieve high locality in the back end's main memory cache. We propose a new distributed architecture for a cluster based web server, with a switch based frontend. The switch performs a layer-four switching (Varghese et al [2]) and directs the incoming packets to one of the backends without regard to content. To make use of the locality in the main memory cache at the backends we introduce a centralized dispatcher. The backend which receives a request communicates with the centralised dispatcher to decide whether it or some other backend in the cluster should handle the request. Subsequently, it might handoff the TCP connection to another backend or decide to process the request itself. In our architecture the costly handoff operation si distributed among the backends which increase the scalability of the cluster. To test the efficacy of our proposed scheme, we performed trace driven simulations and compare the cluster throughput and cluster scalability of our scheme with scalability and throughput of the scheme proposed in [1]. The results show that our scheme achieves a greater degree of scalability than the scheme in [1], without any loss of throughput. 1

Citations

240 Locality-aware Request Distribution in Cluster-based Network Servers – Pai, Aron, et al. - 1998
176 Exploring the bounds of web latency reduction from caching and prefetching – Kroeger, Long, et al. - 1997
124 Improving Web Server Performance by Caching Dynamic Data – Iyengar, Challenger - 1997
3 Varghese et al. Fast Scalable Level Four Switching – Srinivisan - 1998