Download:
by Yin Zhang, Matthew Roughan, Carsten Lund, David Donoho
IEEE/ACM Trans. Netw
http://internal.maths.adelaide.edu.au/people/mroughan/Papers/ToN_2005.pdf
Add To MetaCart
Abstract:
Abstract — Traffic matrices are required inputs for many IP network management tasks, such as capacity planning, traffic engineering and network reliability analysis. However, it is difficult to measure these matrices directly in large operational IP networks, so there has been recent interest in inferring traffic matrices from link measurements and other more easily measured data. Typically, this inference problem is ill-posed, as it involves significantly more unknowns than data. Experience in many scientific and engineering fields has shown that it is essential to approach such ill-posed problems via “regularization”. This paper presents a new approach to traffic matrix estimation using a regularization based on “entropy penalization”. Our solution chooses the traffic matrix consistent with the measured data that is information-theoretically closest to a model in which source/destination pairs are stochastically independent. It applies to both point-to-point and point-to-multipoint traffic matrix estimation. We use fast algorithms based on modern convex optimization theory to solve for our traffic matrices. We evaluate our algorithm with real backbone traffic and routing data, and demonstrate that it is fast, accurate, robust, and flexible. Index Terms — Traffic matrix estimation, information theory, minimum mutual information, regularization, traffic engineering,
Citations
|
441
|
Atomic decomposition by basis pursuit
– Chen, Donoho, et al.
- 1999
|
|
266
|
Measuring ISP topologies with Rocketfuel
– Spring, Mahajan, et al.
- 2004
|
|
174
|
Deriving traffic demands for operational IP networks: Methodology and experience
– Feldmann, Greenberg, et al.
- 2001
|
|
162
|
Rank-deficient and discrete ill-posed problems
– Hansen
- 1998
|
|
144
|
Ill-posed problems in early vision
– Bertero, Poggio, et al.
- 1988
|
|
128
|
Network tomography : Estimating sourcedestination traffic intensities from link data
– Vardi
- 1996
|
|
96
|
NetScope: Traffic Engineering for IP Networks
– Feldmann, Greenberg, et al.
- 2000
|
|
86
|
Regularization tools: a MATLAB package for analysis and solution of discrete ill-posed problems
– Hansen
- 1994
|
|
81
|
Traffic Matrix Estimation: Existing Techniques and New Directions
– Medina, Taft, et al.
- 2002
|
|
77
|
Fast accurate computation of large-scale ip traffic matrices from link loads
– Zhang, Roughan, et al.
- 2003
|
|
66
|
An information-theoretic approach to traffic matrix estimation
– Zhang, Roughan, et al.
- 2003
|
|
62
|
Geophysical inverse theory
– Parker
- 1994
|
|
55
|
Bayesian inference on network traffic using link count data
– Tebaldi, West
- 1998
|
|
44
|
Time-varying Network Tomography
– Wiel, Cao, et al.
- 1999
|
|
42
|
The Axioms of Maximum Entropy
– Skilling
- 1988
|
|
38
|
Inferring Link Weights using End-to-End Measurements
– Mahajan, Spring, et al.
- 2002
|
|
37
|
Solving ill-conditioned and singular linear systems: A tutorial on regularization
– Neumaier
- 1998
|
|
26
|
Maximum Pseudo Likelihood Estimation in Network Tomography
– Liang, Yu
- 2003
|
|
22
|
Traffic engineering with estimated traffic matrices
– Roughan, Thorup, et al.
- 2003
|
|
20
|
A scalable method for estimating network traffic matrices from link counts.” preprint
– Cao, Wiel, et al.
|
|
19
|
A Case Study of OSPF Behavior in a Large Enterprise Network
– Shaikh, Isett, et al.
- 2002
|
|
18
|
Relative information
– Jumarie
- 1990
|
|
15
|
The Measurement Manifesto
– Varghese, Estan
- 2003
|
|
12
|
A taxonomy of IP traffic matrices
– Medina, Fraleigh, et al.
- 2002
|
|
7
|
Inverse problems in astronomy: a guide to inversion strategies of remotely sensed data (Adam Hilger
– Craig, Brown
- 1986
|
|
4
|
Rocketfuel: An ISP topology mapping engine.” http://www.cs.washigton. edu/research/networking/rocketfuel
– Spring, Mahajan, et al.
- 2005
|
|
2
|
Statistical Decision Theory and Related Topics III, volume 2, chapter Constrained regularization for ill posed linear operator equations, with applications in meteorology and medicine
– Wahba
- 1982
|
|
2
|
Regularization tools (for Matlab).http: //www.imm.dtu.dk/˜pch/Regutools/index.html
– Hansen
|
|
1
|
How well do I need to know my traffic matrix? applications in capacity planning and traffic engineering,” in INternet TraffIc MATrices Estimation (INTIMATE
– Maghbouleh
|