EXTENSIONS AND GENERALIZATIONS OF SMOOTHED PERTURBATION ANALYSIS IN A GENERALIZED SEMI-MARKOV PROCESS FRAMEWORK

被引:31
作者
FU, MC [1 ]
HU, JQ [1 ]
机构
[1] BOSTON UNIV,DEPT MFG,BOSTON,MA 02215
关键词
D O I
10.1109/9.256367
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Smoothed perturbation analysis is a technique for estimating derivatives of performance measures of a stochastic discrete-event system. The key idea is the use of conditional expectation to "smooth" certain discontinuities which prevent the use of infinitesimal perturbation analysis. The source of these discontinuities may be the performance measure or the underlying stochastic processes. Previous work has considered special classes of performance measures under a structural condition on the system called the commuting condition. The resulting estimators are very attractive, in that they can be easily estimated from a single sample path (or simulation) of the system. However, most multiclass queueing networks, as well as systems as simple as the GI/G/1/K queue, cannot be handled. Under a generalized semi-Markov process (GSMP) framework allowing a wide class of performance measures for systems that do not necessarily satisfy the commuting condition, we derive two derivative estimators (a left-hand derivative estimator and a right-hand derivative estimator, equal in expectation) and prove their unbiasedness. However, the gain in generality comes at a cost, in that the derivative estimator contains terms which may not be easily estimated from a single sample path, and thus may require additional simulation. The framework is such that upon application of the commuting condition and restriction to certain classes of performance measures, we readily recover as special cases of our estimators the estimators of previous researchers.
引用
收藏
页码:1483 / 1500
页数:18
相关论文
共 18 条
[1]   CONVERGENCE OF PARAMETER SENSITIVITY ESTIMATES IN A STOCHASTIC EXPERIMENT [J].
CAO, XR .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1985, 30 (09) :845-853
[2]   ONLINE SENSITIVITY ANALYSIS OF MARKOV-CHAINS [J].
CASSANDRAS, CG ;
STRICKLAND, SG .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1989, 34 (01) :76-86
[3]   ON CHOOSING THE CHARACTERIZATION FOR SMOOTHED PERTURBATION ANALYSIS [J].
FU, MC ;
HU, JQ .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1991, 36 (11) :1331-1336
[4]  
FU MC, IN PRESS MANAGEMENT
[5]  
FU MC, IN PRESS QUEUEING SY
[6]  
FU MC, 1990 P AM CONTR C, P1040
[7]   STRUCTURAL CONDITIONS FOR PERTURBATION ANALYSIS DERIVATIVE ESTIMATION - FINITE-TIME PERFORMANCE INDEXES [J].
GLASSERMAN, P .
OPERATIONS RESEARCH, 1991, 39 (05) :724-738
[8]   SMOOTHED PERTURBATION ANALYSIS FOR A CLASS OF DISCRETE-EVENT SYSTEMS [J].
GLASSERMAN, P ;
GONG, WB .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1990, 35 (11) :1218-1230
[9]  
GLASSERMAN P., 1991, PROBAB ENG INFORM SC, V5, P391
[10]  
GLASSERMAN P, 1991, GRADIENT ESTIMATION