Abstract

We review techniques for optimizing stochastic discrete-event systems via simulation. We discuss both the discrete parameter case and the continuous parameter case, but concentrate on the latter which has dominated most of the recent research in the area. For the discrete parameter case, we focus on the techniques for optimization from a finite set: multiple-comparison procedures and ranking-and-selection procedures. For the continuous parameter case, we focus on gradient-based methods, including perturbation analysis, the likelihood ratio method, and frequency domain experimentation. For illustrative purposes, we compare and contrast the implementation of the techniques for some simple discrete-event systems such as the (s, S) inventory system and the GI/G/1 queue. Finally, we speculate on future directions for the field, particularly in the context of the rapid advances being made in parallel computing.

Citations

659	Parallel discrete event simulation - Fujimoto - 1990
502	A stochastic approximation method - Robbins, Monro - 1951
343	Empirical model-building and response surfaces - BOX, DRAPER - 2007
310	Adaptive Algorithms and Stochastic Approximations - BENVENISTE, Métivier, et al. - 1990
242	Stochastic Approximation Methods for Constrained and Unconstrained Systems - Kushner, Clark - 1978
134	Discrete event systems: Sensitivity analysis and stochastic optimization by the score function method - Rubinstein, Shapiro - 1993
129	Gradient estimation via perturbation analysis - Glasserman - 1991
125	Stochastic estimation of the maximum of a regression function - Kiefer, Wolfowitz - 1952
117	Analysis of Recursive Stochastic Algorithms - Ljung - 1977
116	Discrete-Event System Simulation - Banks, Carson, et al. - 2001
103	Statistical Tools for Simulation Practitioners - Kleijnen - 1987
62	A single-sample multiple decision procedure for ranking means of normal populations with known variances - Bechhofer, Mar - 1954
61	Simulation Modeling and Analysis, 2 nd Edition - Law, Kelton - 2000
51	Likelihood ratio gradient estimation for stochastic systems - Glynn, W - 1990
43	Likelihood ratio gradient estimation: an overview - Glynn - 1987
43	Sensitivity analysis for simulations via likelihood ratios - Reiman, Weiss - 1989
36	Perturbation Analysis: The State of the Art and Research Issues Explained via the GI/G/1 - Suri - 1989
32	Stochastic Approximation - Wasan - 1969
30	Stochastic approximation for Monte Carlo optimization - Glynn - 1986
28	Accelerated stochastic approximation - Kesten - 1958
27	Retrospective simulation response optimization - Healy, Schruben - 1991
25	An overview of derivative estimation - L’Ecuyer - 1991
25	Sensitivity analysis via likelihood ratios - Reiman, Weiss - 1986
24	A gradient technique for general buffer storage design in a production line - Ho, Eyler, et al.
24	Stochastic optimization by simulation: Convergence proofs for the GI/G/1 queue in steady-state - L’ECUYER, W - 1994
22	Some guidelines and guarantees for common random numbers - Glasserman, Yao - 1992
22	Optimization of Stochastic Systems via Simulation - Glynn - 1989
22	Monte Carlo Optimization, Simulation and Sensitivity of Queueing Networks - Rubinstein - 1986
22	Asymptotic distribution of stochastic approximation procedures - Sacks - 1957
22	Massively parallel and distributed simulation of a class of discrete event systems: A different perspective - Vakili - 1992
21	New method of stochastic approximation type - Polyak - 1990
20	Discrete Event Dynamics Systems and Perturbation Analysis - Ho, Cao - 1991
20	Response surface methodology: 1966-1988 - Myers, Khuri, et al. - 1989
20	Perturbation analysis gives strongly consistent sensitivity estimates for the M/G/1 queue, Management Sci 34 - Suri, Zazanis - 1988
19	Optimization of stochastic systems - Glynn, W - 1986
18	Perturbation analysis for the design of flexible manufacturing system flow controllers - Caramanis, Liberopoulos - 1992
18	Convergence of a stochastic approximation algorithm for the GI/G/1 queue using infinitesimal perturbation analysis - Fu - 1990
18	A standard clock technique for efficient simulation - Vakili - 1991
17	On a Stochastic Approximation Method - CHUNG - 1954
17	Perturbation analysis of discrete-event dynamic systems - Ho, Cao - 1991
16	On the pathwise computation of derivatives with respect to the rate of a point process: the phantom RPA method,” Queueing Syst - Brémaud, Vázquez-Abad - 1992
16	Analysis of Parallel, Replicated Simulations under a Completion Time Constraint - Glynn, Heidelberger - 1991
15	Stochastic approximations and nonlinear regression - Albert, Gardner - 1967
15	Response Surfaces - Khuri, Cornell - 1987
15	Stochastic optimization by simulation: Numerical experiments with the M/M/1 queue in steady state - L'Ecuyer, Giroux, et al. - 1994
15	An experimental procedure for simulation response surface model identification - L, Schruben, et al. - 1987
14	Extensions and Generalizations of Smoothed Perturbation Analysis in a Generalized Semi-Markov Process Framework - Fu, Hu - 1992
14	Sensitivity analysis and performance extrapolation for computer simulation models - Rubinstein - 1989
14	Almost sure approximations for the Robbins-Monro and KieferWolfowitz processes with dependent noises - Ruppert - 1982
13	A unified view of the - L’Ecuyer - 1990