Ants and Reinforcement Learning: A Case Study in Routing in Dynamic Networks

Ants and Reinforcement Learning: A Case Study in Routing in Dynamic Networks (1998)

Cached

Download Links

Other Repositories/Bibliography

DBLP

by Devika Subramanian , Peter Druschel , Johnny Chen

Venue:	In IJCAI (2
Citations:	61 - 0 self

Versions

Version History

Metadata Version 3

User correction supplied by SystemCorrections

Datum	Value	Source
TITLE	Ants and Reinforcement Learning: A Case Study in Routing in Dynamic Networks	user correction - Legacy Corrections
AUTHOR NAME	Devika Subramanian	user correction - Legacy Corrections
AUTHOR AFFIL	Department of Computer Science; Rice University	user correction - Legacy Corrections
AUTHOR ADDR	Houston, Texas 77005	user correction - Legacy Corrections
AUTHOR NAME	Peter Druschel	user correction - Legacy Corrections
AUTHOR AFFIL	Department of Computer Science; Rice University	user correction - Legacy Corrections
AUTHOR ADDR	Houston, Texas 77005	user correction - Legacy Corrections
AUTHOR NAME	Johnny Chen	user correction - Legacy Corrections
ABSTRACT	We investigate two new distributed routing algorithms for data networks based on simple biological "ants" that explore the network and rapidly learn good routes, using a novel variation of reinforcement learning. These two algorithms are fully adaptive to topology changes and changes in link costs in the network, and have space and computational overheads that are competitive with traditional packet routing algorithms: although they can generate more routing traffic when the rate of failures in a network is low, they perform much better under higher failure rates. Both algorithms are more resilient than traditional algorithms, in the sense that random corruption of routing state has limited impact on the computation of paths. We present convergence theorems for both of our algorithms drawing on the theory of non-stationary and stationary discrete-time Markov chains over the reals. We present an extensive empirical evaluation of our algorithms on a simulator that is widely used in the c...	user correction - Legacy Corrections
YEAR	1998	user correction - Legacy Corrections
VENUE	In IJCAI (2	INFERENCE
VENUE TYPE	CONFERENCE	INFERENCE
PAGES	832--838	INFERENCE
CITATIONS	5 found	ParsCit 1.0