This paper establishes new criteria for stability and for instability of multiclass network models under a given stationary policy. It also extends previous results on the approximation of the solution to the average cost optimality equations through an associated
uid model: It is shown that an optimized network possesses a
uid limit model which is itself optimal with respect to a total cost criterion. A general framework for constructing control algorithms for multiclass queueing networks is proposed based on these general results. Network sequencing and routing problems are considered as special cases. The following aspects of the resulting feedback regulation policies are developed in the paper: (i) The policies are stabilizing, and are in fact geometrically ergodic for a Markovian model. (ii) Numerical examples are given. In each case it is shown that the feedback regulation policy closely resembles the average-cost optimal policy. (iii) A method is proposed for reducing variance in simulation for a network controlled using a feedback regulation policy.
|
361
|
Markov Decision Processes
– Puterman
- 1994
|
|
139
|
On positive Harris recurrence of multiclass queueing networks: A unified approach via fluid limit models
– Dai
- 1995
|
|
84
|
Dynamic instabilities and stabilization methods in distributed real-time scheduling of manufacturing systems
– Kumar, Seidman
- 1990
|
|
81
|
Applying a new device in the optimization of exponential queuing systems
– Lippman
- 1975
|
|
69
|
Instability of FIFO queueing networks
– Bramson
- 1994
|
|
57
|
Stability and convergence of moments for multiclass queueing networks via fluid limit models
– DAI, MEYN
- 1995
|
|
56
|
Performance bounds for queueing networks and scheduling policies
– Kumar, Kumar
- 1994
|
|
44
|
Optimization of multiclass queueing networks: Polyhedral and nonlinear characterizations of achievable performance
– Paschaladis, Tsitsiklis
- 1994
|
|
43
|
Optimal control of two interacting service stations
– Hajek
- 1984
|
|
42
|
Duality and linear programs for stability and performance analysis of queueing networks and scheduling policies
– Kumar, Meyn
- 1996
|
|
37
|
2001. Dynamic scheduling of a system with two parallel servers in heavy traffic with resource pooling: Asymptotic optimality of a threshold policy
– Bell, Williams
|
|
35
|
Planning queueing simulations
– Whitt
- 1989
|
|
34
|
Dynamic routing in open queueing networks: Brownian models, cut constraints and resource pooling,” Queueing Systems
– Kelly, Laws
- 1993
|
|
30
|
Stability of generalized Jackson networks
– Meyn, Down
- 1994
|
|
27
|
Lyapunov functions for semimartingale reflecting Brownian motions
– Dupuis, Williams
- 1994
|
|
25
|
Brownian Models of Open Processing Networks: Canonical Representation of Workload
– Harrison
|
|
25
|
Efficient scheduling policies to reduce mean and variance of cycle time in semiconductor plants
– Lu, Ramaswamy, et al.
|
|
24
|
Optimal control of a queueing system with two heterogeneous servers
– Lin, PR
- 1984
|
|
23
|
Fluctuation smoothing policies are stable for stochastic reentrant lines. Discrete Event Dynamical Systems
– Kumar, Kumar
- 1996
|
|
17
|
Value iteration and optimization of multiclass queueing networks, Queueing Systems Theory and Applications
– Chen, Meyn
- 1999
|
|
15
|
Fluid network models: Linear programs for control and performance bounds
– Eng, Humphrey, et al.
- 1996
|
|
14
|
Scheduling networks of queues: Heavy trac analysis of a two-station closed network
– Harrison, Wein
- 1990
|
|
14
|
The policy improvement algorithm for Markov decision processes
– Meyn
- 1997
|
|
11
|
The delay of open markovian queueing networks: Uniform functional bounds, heavy trac pole multiplicities, and stability
– Humes, Ou, et al.
- 1997
|
|
11
|
A new algorithm for state-constrained separated continuous linear programming
– Luo, Bertsimas
- 1998
|
|
10
|
Stochastic monotonicity in general queueing networks
– Shanthikumar, Yao
- 1989
|
|
9
|
Performance bounds for scheduling queueing networks
– Ou, Wein
- 1992
|
|
8
|
Variance reduction via an approximating Markov process
– Henderson
- 1997
|
|
7
|
A fluid heuristic for minimizing makespan in job shops
– Dai, Weiss
- 2002
|
|
7
|
The BIGSTEP approach to management in stochastic processing networks
– Harrison
- 1996
|
|
7
|
Stability and optimization of multiclass queueing networks and their fluid models
– Meyn
- 1997
|
|
6
|
Variance reduction for simulation in multiclass queueing networks
– Henderson, Meyn
- 1999
|
|
5
|
Discrete networks: Bottlenecks analysis and approximations
– Chen, Mandelbaum
- 1991
|
|
5
|
Brownian models of heterogeneous customer populations
– Harrison
- 1988
|
|
5
|
Heavy trac resource pooling in parallel-server systems
– Harrison, Lopez
- 1999
|
|
5
|
On optimal draining of re-entrant lines
– Weiss
- 1995
|
|
4
|
Queueing simulation in heavy tra#c
– Asmussen
- 1992
|
|
4
|
Forms of optimal solutions for separated continuous linear programs
– Pullan
- 1995
|
|
4
|
On the ergodicity of stohastic processes describing the operation of open queueing networks
– Rybko, Stolyar
- 1992
|
|
4
|
A note on the optimal control of two interacting service stations
– Xu, Chen
- 1993
|
|
2
|
Asymptotic optimality of Tracking-Policies in stochastic networks
– Bäuerle
- 2000
|
|
1
|
Queueing Networks with Shared Service Resources
– Armony, Bambos
- 1999
|
|
1
|
A Methodology for Dynamic Control Policy Design for Stochastic Processing Networks via Fluid Models
– Maglaras
- 1997
|
