Rates of convergence for approximation schemes in optimal control

被引:12
作者
Dupuis, P [1 ]
James, MR
机构
[1] Brown Univ, Div Appl Math, Providence, RI 02912 USA
[2] Australian Natl Univ, Fac Engn & Informat Technol, Dept Engn, Canberra, ACT 0200, Australia
关键词
optimal control; numerical approximation; rate of convergence; finite differences; ergodic control; reflected diffusions; nonlinear PDE;
D O I
10.1137/S0363012994267789
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We present a simple method for obtaining rate of convergence estimates for approximations in optimal control problems. Although the method is applicable to a wide range of approximation problems, it requires in all cases some type of smoothness of the quantity being approximated. We illustrate the method by presenting a number of examples, including finite difference schemes for stochastic and deterministic optimal control problems. A general principle can be abstracted, and indeed the method may be applied to a variety of approximation problems, such as the numerical approximation of nonlinear PDEs not a priori related to control theory.
引用
收藏
页码:719 / 741
页数:23
相关论文
共 26 条
[1]  
Barles G., 1991, Asymptotic Analysis, V4, P271
[2]  
BERTSEKAS D. P, 1978, Neuro-dynamic programming
[3]  
CRANDALL MG, 1984, MATH COMPUT, V43, P1, DOI 10.1090/S0025-5718-1984-0744921-8
[4]  
DOLCETTA IC, 1989, ANNALES DE LINSTITUT HENRI POINCARE, VOL 6 SUPPL, P161
[5]   APPROXIMATE SOLUTIONS OF THE BELLMAN EQUATION OF DETERMINISTIC CONTROL-THEORY [J].
DOLCETTA, IC ;
ISHII, H .
APPLIED MATHEMATICS AND OPTIMIZATION, 1984, 11 (02) :161-181
[6]   LARGE DEVIATIONS FOR MARKOV-PROCESSES WITH DISCONTINUOUS STATISTICS, .1. GENERAL UPPER-BOUNDS [J].
DUPUIS, P ;
ELLIS, RS ;
WEISS, A .
ANNALS OF PROBABILITY, 1991, 19 (03) :1280-1297
[7]   SDES WITH OBLIQUE REFLECTION ON NONSMOOTH DOMAINS [J].
DUPUIS, P ;
ISHII, H .
ANNALS OF PROBABILITY, 1993, 21 (01) :554-580
[8]   STOCHASTIC-APPROXIMATION AND LARGE DEVIATIONS - UPPER-BOUNDS AND W.P.1 CONVERGENCE [J].
DUPUIS, P ;
KUSHNER, HJ .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1989, 27 (05) :1108-1135
[10]  
FLEMING W. H., 2005, Stochastic Modelling and Applied Probability, V2nd