Risk-sensitive control of finite state machines on an infinite horizon .1.

被引:59
作者
Fleming, WH [1 ]
HernandezHernanadez, D [1 ]
机构
[1] INST POLITECN NACL, CINVESTAV, DEPT MATEMAT, MEXICO CITY 07000, DF, MEXICO
关键词
risk-sensitive control; robust control; finite state machines; large deviations;
D O I
10.1137/S0363012995291622
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper we consider robust and risk-sensitive control of discrete time finite state systems on an infinite horizon, The solution of the state feedback robust control problem is characterized in terms of the value of an average cost dynamic game. The risk-sensitive stochastic optimal control problem is solved using the policy iteration algorithm, and the optimal rate is expressed in terms of the value of a stochastic dynamic game with average cost per unit time criterion. By taking a small noise limit, a deterministic dynamic game which is closely related to the robust control problem is obtained.
引用
收藏
页码:1790 / 1810
页数:21
相关论文
共 19 条
[1]  
BARAS JS, IN PRESS J MATH SYST
[2]  
BASAL T, 1991, H INFINITY OPTIMAL C
[3]  
Bertsekas D. P, 1976, DYNAMIC PROGRAMMING
[4]  
Dembo A., 1993, Large deviations techniques and applications
[5]  
Dupuis P., 1997, WEAK CONVERGENCE APP
[6]   DIFFERENTIAL-GAMES AND REPRESENTATION FORMULAS FOR SOLUTIONS OF HAMILTON-JACOBI-ISAACS EQUATIONS [J].
EVANS, LC ;
SOUGANIDIS, PE .
INDIANA UNIVERSITY MATHEMATICS JOURNAL, 1984, 33 (05) :773-797
[7]  
FERNANDEZGAUCHERAND E, 1994, IEEE DECIS CONTR P, P1657, DOI 10.1109/CDC.1994.411203
[8]   RISK-SENSITIVE CONTROL ON AN INFINITE TIME HORIZON [J].
FLEMING, WH ;
MCENEANEY, WM .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1995, 33 (06) :1881-1915
[9]  
FLEMING WH, 1964, J MATH MECH, V13, P987
[10]   ON THE EXISTENCE OF VALUE-FUNCTIONS OF 2-PLAYER, ZERO-SUM STOCHASTIC DIFFERENTIAL-GAMES [J].
FLEMING, WH ;
SOUGANIDIS, PE .
INDIANA UNIVERSITY MATHEMATICS JOURNAL, 1989, 38 (02) :293-314