Results 1  10
of
44
Dynamic Scheduling of a System with Two Parallel Servers in Heavy Traffic with Resource Pooling: Asymptotic Optimality of a Threshold Policy
 Annals of Applied Probability
, 1999
"... This paper concerns a dynamic scheduling problem for a queueing system that has two streams of arrivals to infinite capacity buffers and two (nonidentical) servers working in parallel. One server can only process jobs from one buffer, whereas the other server can process jobs from either buffer. Th ..."
Abstract

Cited by 118 (6 self)
 Add to MetaCart
(Show Context)
This paper concerns a dynamic scheduling problem for a queueing system that has two streams of arrivals to infinite capacity buffers and two (nonidentical) servers working in parallel. One server can only process jobs from one buffer, whereas the other server can process jobs from either buffer. The service time distribution may depend on the buffer being served and the server providing the service. The system manager dynamically schedules waiting jobs onto available servers. We consider a parameter regime in which the system satisfies both a heavy traffic condition and a resource pooling condition. Our cost function is a mean cumulative discounted cost of holding jobs in the system, where the (undiscounted) cost per unit time is a linear function of normalized (with heavy traffic scaling) queue length. We first review the analytic solution of the Brownian control problem (formal heavy traffic approximation) for this system. We "interpret" this solution by proposing a threshold contro...
Brownian models of open processing networks: Canonical representation of workload
 Ann. Appl. Probab
, 2003
"... ar ..."
(Show Context)
Contact centers with a callback option and realtime delay information
 Operations Research
, 2004
"... doi 10.1287/opre.1030.0088 ..."
(Show Context)
On Dynamic Scheduling of a Parallel Server System with Complete Resource Pooling
 In Analysis of Communication Networks: Call Centres, Traffic and Performance
, 2000
"... scientific noncommercial use only for individuals, with permission from the authors. We consider a parallel server queueing system consisting of a bank of buffers for holding incoming jobs and a bank of flexible servers for processing these jobs. Incoming jobs are classified into one of several dif ..."
Abstract

Cited by 71 (5 self)
 Add to MetaCart
(Show Context)
scientific noncommercial use only for individuals, with permission from the authors. We consider a parallel server queueing system consisting of a bank of buffers for holding incoming jobs and a bank of flexible servers for processing these jobs. Incoming jobs are classified into one of several different classes (or buffers). Jobs within a class are processed on a firstinfirstout basis, where the processing of a given job may be performed by any server from a given (classdependent) subset of the bank of servers. The random service time of a job may depend on both its class and the server providing the service. Each job departs the system after receiving service from one server. The system manager seeks to minimize holding costs by dynamically scheduling waiting jobs to available servers. We consider a parameter regime in which the system satisfies both a heavy traffic and a complete resource pooling condition. Our cost function is an expected cumulative discounted cost of holding jobs in the system, where the (undiscounted) cost per unit time is a linear function of normalized (with heavy traffic scaling) queue length. In a prior work [40], the second author proposed a continuous review threshold control policy for use in such a parallel server system. This policy was advanced as an “interpretation ” of the analytic solution to an associated Brownian control problem (formal heavy
Sequencing and routing in multiclass queueing networks part I: Feedback regulation
 SIAM J. Control Optim
"... Abstract. Part II continues the development of policy synthesis techniques for multiclass queueing networks based upon a linear fluid model. The following are shown: (i) A relaxation of the fluid model based on workload leads to an optimization problem of lower dimension. An analogous workloadrelax ..."
Abstract

Cited by 55 (12 self)
 Add to MetaCart
(Show Context)
Abstract. Part II continues the development of policy synthesis techniques for multiclass queueing networks based upon a linear fluid model. The following are shown: (i) A relaxation of the fluid model based on workload leads to an optimization problem of lower dimension. An analogous workloadrelaxation is introduced for the stochastic model. These relaxed control problems admit pointwise optimal solutions in many instances. (ii) A translation to the original fluid model is almost optimal, with vanishing relative error as the networkload ρ approaches one. It is pointwise optimal after a short transient period, provided a pointwise optimal solution exists for the relaxed control problem. (iii) A translation of the optimal policy for the fluid model provides a policy for the stochastic networkmodel that is almost optimal in heavy traffic, over all solutions to the relaxed stochastic model, again with vanishing relative error. The regret is of order  log(1 − ρ).
Queueing dynamics and maximal throughput scheduling in switched processing systems. Queueing systems
"... Abstract. We study a processing system comprised of parallel queues, whose individual service rates are specified by a global service mode (configuration). The issue is how to switch the system between various possible service modes, so as to maximize its throughput and maintain stability under the ..."
Abstract

Cited by 49 (14 self)
 Add to MetaCart
Abstract. We study a processing system comprised of parallel queues, whose individual service rates are specified by a global service mode (configuration). The issue is how to switch the system between various possible service modes, so as to maximize its throughput and maintain stability under the most workloadintensive input traffic traces (arrival processes). Stability preserves the job inflow–outflow balance at each queue on the traffic traces. Two key families of service policies are shown to maximize throughput, under the mild condition that traffic traces have longterm average workload rates. In the first family of cone policies, the service mode is chosen based on the system backlog state belonging to a corresponding cone. Two distinct policy classes of that nature are investigated, MaxProduct and FastEmpty. In the second family of batch policies (BatchAdapt), jobs are collectively scheduled over adaptively chosen horizons, according to an asymptotically optimal, robust schedule. The issues of nonpreemptive job processing and nonnegligible switching times between service modes are addressed. The analysis is extended to cover feedforward networks of such processing systems/nodes. The approach taken unifies and generalizes prior studies, by developing a general tracebased modeling framework (samplepath approach) for addressing the queueing stability problem. It treats the queueing structure as a deterministic dynamical system and analyzes directly its evolution trajectories. It does not require any probabilistic superstructure, which is
Performance Evaluation and Policy Selection in Multiclass Networks
, 2002
"... This paper concerns modelling and policy synthesis for regulation of multiclass queueing networks. A 2parameter network model is introduced to allow independent modelling of variability and mean processingrates, while maintaining simplicity of the model. Policy synthesis is based on consideration ..."
Abstract

Cited by 46 (26 self)
 Add to MetaCart
This paper concerns modelling and policy synthesis for regulation of multiclass queueing networks. A 2parameter network model is introduced to allow independent modelling of variability and mean processingrates, while maintaining simplicity of the model. Policy synthesis is based on consideration of more tractable workload models, and then translating a policy from this abstraction to the discrete network of interest. Translation is made possible through the use of safetystocks that maintain feasibility of workload trajectories. This is a wellknown approach in the queueing theory literature, and may be viewed as a generic approach to avoid deadlock in a discreteevent dynamical system. Simulation is used to evaluate a given policy, and to tune safetystock levels. These simulations are accelerated through a variance reduction technique that incorporates stochastic approximation to tune the variance reduction. The search for appropriate safetystock levels is coordinated through a cutting plane algorithm. Both the policy synthesis and the simulation acceleration rely heavily on the development of approximations to the value function through fluid model considerations.
Asymptotic optimality of maximum pressure policies in stochastic processing networks
 Annals of Applied Probability
, 2008
"... We consider a class of stochastic processing networks. Assume that the networks satisfy a complete resource pooling condition. We prove that each maximum pressure policy asymptotically minimizes the workload process in a stochastic processing network in heavy traffic. We also show that, under each q ..."
Abstract

Cited by 43 (5 self)
 Add to MetaCart
We consider a class of stochastic processing networks. Assume that the networks satisfy a complete resource pooling condition. We prove that each maximum pressure policy asymptotically minimizes the workload process in a stochastic processing network in heavy traffic. We also show that, under each quadratic holding cost structure, there is a maximum pressure policy that asymptotically minimizes the holding cost. A key to the optimality proofs is to prove a state space collapse result and a heavy traffic limit theorem for the network processes under a maximum pressure policy. We extend a framework of Bramson [Queueing Systems Theory Appl. 30 (1998) 89–148] and Williams [Queueing Systems Theory Appl. 30 (1998b) 5–25] from the multiclass queueing network setting to the stochastic processing network setting to prove the state space collapse result and the heavy traffic limit theorem. The extension can be adapted to other studies of stochastic processing networks.
Value Iteration and Optimization of Multiclass Queueing Networks
 Queueing Systems
, 1997
"... . This paper considers in parallel the scheduling problem for multiclass queueing networks, and optimization of Markov decision processes. It is shown that the value iteration algorithm may perform poorly when the algorithm is not initialized properly. The most typical case where the initial value f ..."
Abstract

Cited by 41 (12 self)
 Add to MetaCart
(Show Context)
. This paper considers in parallel the scheduling problem for multiclass queueing networks, and optimization of Markov decision processes. It is shown that the value iteration algorithm may perform poorly when the algorithm is not initialized properly. The most typical case where the initial value function is taken to be zero may be a particularly bad choice. In contrast, if the value iteration algorithm is initialized with a stochastic Lyapunov function, then the following hold (i): A stochastic Lyapunov function exists for each intermediate policy, and hence each policy is regular (a strong stability condition). (ii): Intermediate costs converge to the optimal cost. (iii): Any limiting policy is average cost optimal. It is argued that a natural choice for the initial value function is the value function for the associated deterministic control problem based upon a fluid model, or the approximate solution to Poisson's equation obtained from the LP of Kumar and Meyn. Numerical studi...