by Hani Jamjoom, Chun-ting Chou, Kang G. Shin
in Proceedings of IEEE Infocom
http://www.eecs.umich.edu/~jamjoom/publications/../publications/jamjoom-infocom-04.pdf
Add To MetaCart
Abstract:
Abstract — With the proliferation of Internet services, many solutions have emerged to provide Quality-of-Service (QoS) guarantees when the demands for the hosted services exceed the server’s capacity. In this paper, we take an analytical approach to answering key questions in the design and performance of application-level QoS techniques, especially those that are based on the multi-threading or multi-processing abstraction. Key to our analysis is the integration of the effects of concurrency into the interactions between multi-threaded services. To this end, we extend traditional time-sharing models to develop the multithreaded round-robin (MTRR) servers, a more accurate model of operation of typical multi-threaded Internet services. For this model, we first develop powerful, yet computationally-efficient, mathematical relationships that describe the performance (in terms of throughput and response time) of multi-threaded services. We then apply optimization techniques to derive the optimal allocation of threads given specific QoS objective functions. Using realistic workloads on a typical web server, we show the efficacy and accuracy of the proposed new methodology. Index Terms — Queueing theory, system design I.
Citations
|
1267
|
Data Networks
– Bertsekas, Gallager
- 1992
|
|
557
|
Generating Representative Web Workloads for Network and Server Performance Evaluation
– Barford, Crovella
- 1998
|
|
354
|
Web Server Workload Characterization: The Search for Invariants
– Arlitt, Williamson
- 1996
|
|
342
|
Resource Containers: A New Facility for Resource Management in Server Systems
– Banga, Druschel, et al.
- 1999
|
|
251
|
An Engineering Approach to Computer Networking
– Keshav
- 1997
|
|
242
|
Stochastic Modeling and the Theory of Queues
– Wolff
- 1989
|
|
236
|
SEDA: An architecture for wellconditioned, scalable internet services
– Welsh, Culler, et al.
- 2001
|
|
120
|
TCP Behavior of a Busy Internet Server: Analysis and Improvements
– Seshan, Balakrishnan, et al.
- 1998
|
|
119
|
Web server support for tiered services
– Bhatti, Friedrich
- 1999
|
|
99
|
Defending Against Denial of Service Attacks in Scout
– Spatscheck, Peterson
- 1999
|
|
97
|
Analysis of Polling Systems
– Takagi
- 1986
|
|
88
|
A feedback control approach for guaranteeing relative delays in web servers
– Lu, Abdelzaher, et al.
- 2001
|
|
58
|
Real-Time Systems
– Krishna, Shin
- 1997
|
|
56
|
Web content adaptation to improve server overload behavior
– Abdelzaher, Bhatti
- 1999
|
|
54
|
Connection-level analysis and modeling of network traffic
– Sarvotham, Riedi, et al.
- 2001
|
|
49
|
Application-Level Differentiated Services for Web Servers
– Eggert, Heidemann
- 1999
|
|
49
|
Kernel mechanisms for service differentiation in overloaded web servers
– Voigt, Tewari, et al.
- 2001
|
|
35
|
Adaptive algorithms for managing a distributed data processing workload
– Aman, Eilert, et al.
- 1997
|
|
32
|
Retrofitting Quality of Service into a Time-Sharing Operating System
– Bruno, Brustoloni, et al.
- 1999
|
|
27
|
Time-shared systems: A theoretical treatment
– Kleinrock
- 1967
|
|
17
|
A Survey of QoS
– Aurrecoechea, Campbell, et al.
- 1998
|
|
9
|
Supporting Quality of Service
– Pandey, Barnes, et al.
- 1998
|
|
8
|
Online Response Time Optimization of Apache Web Server
– Liu, Sha, et al.
- 2003
|
|
3
|
Eve: A Scalable Network Client Emulator
– Jamjoom, Shin
- 2003
|
|
2
|
Adaptive Packet Filters
– Reumann, Jamjoom, et al.
- 2001
|
|
1
|
Characteristics of TCP Connection Arrivals, ser. SelfSimilar Network Traffic and Performance Evaluation
– Feldmann
|
|
1
|
Queueing Systems, Volume II: Computer Applications
– Klienrock
- 1976
|
|
1
|
Integrated CPU and Network
– Lakshman, Yavatkar, et al.
- 1997
|
|
1
|
Providing a Dierentiated Quality of Service in a World Wide Web Server,” to Appear in Performance Evaluation Review
– Vasiliou, Hanan
|
