Solutions for the linear-quadratic control problem of Markov jump linear systems

被引:36
作者
do Val, JBR [1 ]
Geromel, JC
Costa, OLV
机构
[1] Univ Estadual Campinas, Fac Elect & Comp Engn, Dept Telemat, Campinas, SP, Brazil
[2] Univ Sao Paulo, Dept Elect Engn, Sao Paulo, Brazil
关键词
linear-quadratic control; Markov jump linear systems; nonstandard Riccati equation; stopping time problems;
D O I
10.1023/A:1021748618305
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
The paper is concerned with recursive methods for obtaining the stabilizing solution of coupled algebraic Riccati equations arising in the linear-quadratic control of Markovian jump linear systems by solving at each iteration uncoupled algebraic Riccati equations. It is shown that the new updates carried out at each iteration represent approximations of the original control problem by control problems with receding horizon, for which some sequences of stopping times define the terminal time. Under this approach, unlike previous results, no initialization conditions are required to guarantee the convergence of the algorithms. The methods can be ordered in terms of number of iterations to reach convergence, and comparisons with existing methods in the current literature are also presented. Also, we extend and generalize current results in the literature for the existence of the mean-square stabilizing solution of coupled algebraic Riccati equations.
引用
收藏
页码:283 / 311
页数:29
相关论文
共 16 条
[1]   SOLUTION AND ASYMPTOTIC-BEHAVIOR OF COUPLED RICCATGI EQUATIONS IN JUMP LINEAR-SYSTEMS [J].
ABOUKANDIL, H ;
FREILING, G ;
JANK, G .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1994, 39 (08) :1631-1636
[2]   PARALLEL COMPUTATION OF THE SOLUTIONS OF COUPLED ALGEBRAIC LYAPUNOV EQUATIONS [J].
BORNO, I .
AUTOMATICA, 1995, 31 (09) :1345-1347
[3]   A convex programming approach to H-2 control of discrete-time Markovian jump linear systems [J].
Costa, OLV ;
DoVal, JBR ;
Geromel, JC .
INTERNATIONAL JOURNAL OF CONTROL, 1997, 66 (04) :557-579
[4]  
Davis M., 1993, MARKOV MODELS OPTIMI
[5]   Uncoupled Riccati iterations for the linear quadratic control problem of discrete-time Markov jump linear systems [J].
do Val, JBR ;
Geromel, JC ;
Costa, OLV .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1998, 43 (12) :1727-1733
[6]   STOCHASTIC STABILITY PROPERTIES OF JUMP LINEAR-SYSTEMS [J].
FENG, XB ;
LOPARO, KA ;
JI, YD ;
CHIZECK, HJ .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1992, 37 (01) :38-53
[7]   A new approach to linearly perturbed Riccati equations arising in stochastic control [J].
Fragoso, MD ;
Costa, OLV ;
deSouza, CE .
APPLIED MATHEMATICS AND OPTIMIZATION, 1998, 37 (01) :99-126
[8]   LYAPUNOV ITERATIONS FOR OPTIMAL-CONTROL OF JUMP LINEAR-SYSTEMS AT STEADY-STATE [J].
GAJIC, Z ;
BORNO, I .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1995, 40 (11) :1971-1975
[9]  
GAJIC Z, 1997, MONOTONICITY ALGEBRA
[10]   CONTROLLABILITY, STABILIZABILITY, AND CONTINUOUS-TIME MARKOVIAN JUMP LINEAR QUADRATIC CONTROL [J].
JI, YD ;
CHIZECK, HJ .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1990, 35 (07) :777-788