The achievable region approach to the optimal control of stochastic systems

被引:34
作者
Dacre, M
Glazebrook, K [1 ]
Niño-Mora, J
机构
[1] Univ Newcastle Upon Tyne, Dept Stat, Newcastle Upon Tyne NE1 7RU, Tyne & Wear, England
[2] Univ Pompeu Fabra, Barcelona, Spain
关键词
achievable region; Gittins index; linear programming; load balancing; multiclass queuing systems; performance space; stochastic optimization; threshold policy;
D O I
10.1111/1467-9868.00202
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The achievable region approach seeks solutions to stochastic optimization problems by characterizing the space of all possible performances (the achievable region) of the system of interest and optimizing the overall system-wide performance objective over this space. This is radically different from conventional formulations based on dynamic programming. The approach is explained with reference to a simple two-class queuing system. Powerful new methodologies due to the authors and co-workers are deployed to analyse a general multiclass queuing system with parallel servers and then to develop an approach to optimal load distribution across a network of interconnected stations. Finally, the approach is used for the first time to analyse a class of intensity control problems.
引用
收藏
页码:747 / 776
页数:30
相关论文
共 42 条
[1]  
[Anonymous], ANAL SYNTHESIS COMPU
[2]   Performance evaluation of scheduling control of queueing networks: Fluid model heuristics [J].
Atkins, D ;
Chen, H .
QUEUEING SYSTEMS, 1995, 21 (3-4) :391-413
[3]  
BERTSEKAS DP, 1995, NONLINEAR PROGRAMMIN
[4]   BRANCHING BANDITS AND KLIMOVS PROBLEM - ACHIEVABLE REGION AND SIDE CONSTRAINTS [J].
BERTSIMAS, D ;
PASCHALIDIS, IC ;
TSITSIKLIS, JN .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1995, 40 (12) :2063-2075
[5]   Conservation laws, extended polymatroids and multiarmed bandit problems; A polyhedral approach to indexable systems [J].
Bertsimas, D ;
Nino-Mora, J .
MATHEMATICS OF OPERATIONS RESEARCH, 1996, 21 (02) :257-306
[6]   The achievable region method in the optimal control of queueing systems; Formulations, bounds and policies [J].
Bertsimas, D .
QUEUEING SYSTEMS, 1995, 21 (3-4) :337-389
[7]   REARRANGEMENT, MAJORIZATION AND STOCHASTIC SCHEDULING [J].
CHANG, CS ;
YAO, DD .
MATHEMATICS OF OPERATIONS RESEARCH, 1993, 18 (03) :658-684
[8]   OPTIMAL INTENSITY CONTROL OF A QUEUING SYSTEM WITH STATE-DEPENDENT CAPACITY LIMIT [J].
CHEN, H ;
YAO, DD .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1990, 35 (04) :459-464
[9]   A CHARACTERIZATION OF WAITING TIME PERFORMANCE REALIZABLE BY SINGLE-SERVER QUEUES [J].
COFFMAN, EG ;
MITRANI, I .
OPERATIONS RESEARCH, 1980, 28 (03) :810-821
[10]  
DARCE MJ, 1999, IN PRESS APPROACH LO