The demand for bandwidth in computer networks has been growing at a steady pace for the last several years, and a significant portion of that traffic is for the World Wide Web. At the same time, a large fraction of Internet users continue to rely on slow "last mile " links (such as modems and wireless links). We present a transparent proxy system that uses deltas and compression to increase the performance of web traffic over slow links. By using compression, the average transfer time for HTML objects can be reduced by a factor of 2.3, while using deltas can reduce the transfer time by a factor of 6.0. The techniques used by this system, if utilized by other proxies and/or web servers, could also be used to reduce the amount of web traffic that traverses a network. 1
|
401
|
Cost-Aware WWW Proxy Caching Algorithms
– Cao, Irani
- 1997
|
|
206
|
System Design Issues for Internet Middleware Services: Deduction from a Large Client Trace
– Gribble, Brewer
- 1997
|
|
199
|
Potential benefits of delta-encoding and data compression for HTTP
– Mogul, Douglis, et al.
- 1997
|
|
199
|
Removal Policies in Network Caches for World-Wide Web Documents
– Williams, Abrams, et al.
- 1996
|
|
188
|
Rate of Change and other Metrics: a Live Study of the World Wide Web
– Douglis, Feldmann, et al.
- 1997
|
|
155
|
The Case for Persistent-connection HTTP
– Mogul
- 1995
|
|
90
|
Webexpress: a system for optimizing web browsing in a wireless environment
– Housel, Lindquist
- 1996
|
|
83
|
Optimistic deltas for WWW latency reduction
– Banga, Douglis, et al.
- 1997
|
|
76
|
Web proxy caching: the devil is in the details
– Cáceres, Douglis, et al.
- 1998
|
|
54
|
Towards a better understanding of web resources and server responses for improved caching
– Wills, C, et al.
- 1999
|
|
41
|
Berkeley DB
– Olson, Bostic, et al.
- 1999
|
|
22
|
Improving the WWW: Caching or Multicast
– Rodriguez, Biersack, et al.
- 1998
|
|
21
|
Analysis of HTTP performance problems
– Spero
- 1994
|
|
19
|
Achieving load balance and effective caching in clustered Web servers
– BUNT, EAGER, et al.
- 1999
|
|
14
|
Versioned file archiving, compression, and distribution
– MacDonald
- 1999
|
|
13
|
Distributing Frequently-Changing Documents in the Web: Multicasting or Hierarchical Caching
– Rodriguez, Ross, et al.
- 1998
|
|
8
|
GZIP file format specification version 4.3,.” RFC
– Deutsch
- 1952
|
|
8
|
Obraczka, "Analysis of HTTP Performance," USC/Information Sciences Institute
– Touch, Heidemann, et al.
|
|
3
|
Cluster Based Scalable Network Services
– Fox, Gribble, et al.
- 1997
|
|
3
|
Using predictive prefetching to improve www latency
– Padmanabhan, Mogul
- 1996
|
|
2
|
Arlitt, Stephane Perret, "Enhancment and Validation of Squid's Cache Replacement Policy". HP Labratories
– Dilley, Martin
|
|
2
|
Simple Hit-Metering and Usage-Limiting for HTTP", Network Working Group
– Mogul, Leach
|
|
2
|
Improving HTTP latency". Available from http://www.ncsa.edu/SDG/IT94/Proceedings/DDay/mogul/HTTPLatency.html
– Mogul
|
|
2
|
et al. "Network Performance Effects
– Nielsen, Gettys, et al.
- 1997
|
|
1
|
et al. "Performance of Web Proxy Caching in Heterogeneous Bandwidth Environments
– Feldmann, Caceres, et al.
- 1999
|
|
1
|
et at. "Web Prefetching Between Low-Bandwidth Clients and Proxies: Potential and Performance
– Fan, Cao, et al.
- 1999
|
|
1
|
Program Source for Xdelta. ftp://ftp.xcf.berkeley.edu/pub/xdelta
– MacDonald
- 1998
|
|
1
|
Delta Compression for Storage and Transport
– MacDonald
|
|
1
|
Douglis, et al. "Delta encoding in HTTP", IETF Internet Draft, Network Working Group. Available as "draft-mogul-http-delta-04.txt" from ftp.isi.edu
– Mogul, Krishnamurthy, et al.
|