Risk-sensitive control of discrete-time Markov processes with infinite horizon

被引:112
作者
Di Masi, GB
Stettner, L
机构
[1] Univ Padua, Dipartimento Matemat Pura & Applicata, I-35131 Padua, Italy
[2] Polish Acad Sci, Inst Math, PL-00950 Warsaw, Poland
关键词
controlled discrete-time Markov processes; exponential ergodic performance criterion; Bellman equation;
D O I
10.1137/S0363012997320614
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper we study existence of solutions to the Bellman equation corresponding to risk-sensitive ergodic control of discrete-time Markov processes using three different approaches. Also, for particular classes of systems, asymptotics for vanishing risk factor is investigated, showing that in the limit the optimal value for an average cost per unit time is obtained.
引用
收藏
页码:61 / 78
页数:18
相关论文
共 15 条
[1]  
Cavazos-Cadena R, 1999, MATH METHOD OPER RES, V49, P299
[2]   DISCOUNTED MDP - DISTRIBUTION-FUNCTIONS AND EXPONENTIAL UTILITY MAXIMIZATION [J].
CHUNG, KJ ;
SOBEL, MJ .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1987, 25 (01) :49-62
[3]   ASYMPTOTIC EVALUATION OF CERTAIN MARKOV PROCESS EXPECTATIONS FOR LARGE TIME, I [J].
DONSKER, MD ;
VARADHAN, SRS .
COMMUNICATIONS ON PURE AND APPLIED MATHEMATICS, 1975, 28 (01) :1-47
[4]   ASYMPTOTIC EVALUATION OF CERTAIN MARKOV PROCESS EXPECTATIONS FOR LARGE TIME .3. [J].
DONSKER, MD ;
VARADHAN, SRS .
COMMUNICATIONS ON PURE AND APPLIED MATHEMATICS, 1976, 29 (04) :389-461
[5]   RISK-SENSITIVE CONTROL ON AN INFINITE TIME HORIZON [J].
FLEMING, WH ;
MCENEANEY, WM .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1995, 33 (06) :1881-1915
[6]   Risk-sensitive control of finite state machines on an infinite horizon .1. [J].
Fleming, WH ;
HernandezHernanadez, D .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1997, 35 (05) :1790-1810
[7]   STATE-SPACE FORMULAS FOR ALL STABILIZING CONTROLLERS THAT SATISFY AN H INFINITY-NORM BOUND AND RELATIONS TO RISK SENSITIVITY [J].
GLOVER, K ;
DOYLE, JC .
SYSTEMS & CONTROL LETTERS, 1988, 11 (03) :167-172
[8]   Risk sensitive control of Markov processes in countable state space [J].
HernandezHernandez, D ;
Marcus, SI .
SYSTEMS & CONTROL LETTERS, 1996, 29 (03) :147-155
[9]  
HERNANDEZLERMA O, 1989, ADAPTIVE CONTROL PRO
[10]   Bellman equations of risk-sensitive control [J].
Nagai, H .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1996, 34 (01) :74-101