AN OPTIMAL-CONTROL PROBLEM WITH A RANDOM STOPPING TIME

被引:41
作者
BOUKAS, EK
HAURIE, A
MICHEL, P
机构
[1] ECOLE POLYTECH, GERAD, MONTREAL H3C 3A7, QUEBEC, CANADA
[2] UNIV GENEVA, CH-1211 GENEVA 4, SWITZERLAND
[3] ECOLE HAUTES ETUD COMMERCIALES, GERAD, MONTREAL, QUEBEC, CANADA
[4] UNIV PARIS 01, F-75231 PARIS 05, FRANCE
关键词
infinite-horizon optimal control; minimum principle; Stochastic control;
D O I
10.1007/BF00939419
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
This paper deals with a stochastic optimal control problem where the randomness is essentially concentrated in the stopping time terminating the process. If the stopping time is characterized by an intensity depending on the state and control variables, one can reformulate the problem equivalently as an infinite-horizon optimal control problem. Applying dynamic programming and minimum principle techniques to this associated deterministic control problem yields specific optimality conditions for the original stochastic control problem. It is also possible to characterize extremal steady states. The model is illustrated by an example related to the economics of technological innovation. © 1990 Plenum Publishing Corporation.
引用
收藏
页码:471 / 480
页数:10
相关论文
共 11 条
[1]   EXISTENCE THEOREMS FOR LAGRANGE CONTROL PROBLEMS WITH UNBOUNDED TIME DOMAIN [J].
BAUM, RF .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1976, 19 (01) :89-116
[2]  
BOLTYANSKII VG, 1966, SIAM J CONTROL, V4, P326
[3]  
BOUKAS EK, 1988, ANAL OPTIMIZATION SY, P633
[4]  
DAVIS MHA, 1985, 3RD P BAD HONN S STO
[5]   NECESSARY CONDITIONS FOR OPTIMAL CONTROL PROBLEMS WITH INFINITE HORIZONS [J].
HALKIN, H .
ECONOMETRICA, 1974, 42 (02) :267-272
[6]   ON THE TRANSVERSALITY CONDITION IN INFINITE HORIZON OPTIMAL PROBLEMS [J].
MICHEL, P .
ECONOMETRICA, 1982, 50 (04) :975-985
[7]   ON ADMISSIBLE SYNTHESIS IN OPTIMAL CONTROL THEORY AND DIFFERENTIAL GAMES [J].
MIRICA, S .
SIAM JOURNAL ON CONTROL, 1969, 7 (02) :292-&
[8]   CONTROL OF SYSTEMS WITH JUMP MARKOV DISTURBANCES [J].
RISHEL, R .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1975, AC20 (02) :241-244
[9]   DYNAMIC-PROGRAMMING AND MINIMUM PRINCIPLES FOR SYSTEMS WITH JUMP MARKOV DISTURBANCES [J].
RISHEL, R .
SIAM JOURNAL ON CONTROL, 1975, 13 (02) :338-371
[10]   OPTIMAL-CONTROL WITH AN UNBOUNDED HORIZON [J].
TOMAN, MA .
JOURNAL OF ECONOMIC DYNAMICS & CONTROL, 1985, 9 (03) :291-316