GENERALIZED SEMI-MARKOV DECISION-PROCESSES

被引:8
作者
DOSHI, BT
机构
关键词
D O I
10.2307/3213089
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Various authors have derived the necessary and sufficient conditions for optimality in semi-Markov decision processes in which the state remains constant between jumps. Similar results are presented here for a generalized semi-Markov decision process in which the state varies between jumps according to a Markov process with continuous sample paths. These results are specialized to a general storage model and an application to the service rate control in a GI/G/1 queue is indicated.
引用
收藏
页码:618 / 630
页数:13
相关论文
共 14 条
[1]   CONTINUOUS TIME MARKOVIAN SEQUENTIAL CONTROL PROCESSES [J].
CHITGOPE.SS .
SIAM JOURNAL ON CONTROL, 1969, 7 (03) :367-&
[2]  
Doshi B. T., 1976, Stochastic Processes & their Applications, V4, P55, DOI 10.1016/0304-4149(76)90026-0
[3]   OPTIMAL-CONTROL OF SERVICE RATE IN AN M-G-1 QUEUING SYSTEM [J].
DOSHI, BT .
ADVANCES IN APPLIED PROBABILITY, 1978, 10 (03) :682-701
[4]   CONTINUOUS TIME CONTROL OF MARKOV-PROCESSES ON AN ARBITRARY STATE SPACE - DISCOUNTED REWARDS [J].
DOSHI, BT .
ANNALS OF STATISTICS, 1976, 4 (06) :1219-1235
[5]  
DOSHI BT, 1978, GENERALIZED SEMIMARK
[6]  
DOSHI BT, 1976, MARKOV DECISION PROC
[7]  
Dynkin E., 1965, MARKOV PROCESSES, VI
[8]   MARKOV-RENEWAL PROGRAMMING .2. INFINITE RETURN MODELS, EXAMPLE [J].
JEWELL, WS .
OPERATIONS RESEARCH, 1963, 11 (06) :949-971
[9]   OPTIMAL SERVICE-RATE SELECTION IN AN MGI QUEUE [J].
MITCHELL, B .
SIAM JOURNAL ON APPLIED MATHEMATICS, 1973, 24 (01) :19-35
[10]  
MORAIS P, 1976, THESIS NW U