RECURSIVE NONLINEAR ESTIMATION - A GEOMETRIC APPROACH

被引:23
作者
KULHAVY, R
机构
[1] Institute of Information Theory and Automation, Czechoslovak Academy of Sciences, 182 08 Prague
关键词
approximation theory; Bayes statistics; differential geometry; Parameter estimation; recursive algorithms; sampled data systems;
D O I
10.1016/0005-1098(90)90025-D
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The paper deals with approximation of nonlinear estimation within the Bayesian framework. The underlying idea is to project the true posterior density orthogonally onto a prespecified approximation family. The problem to be coped with is that the true posterior density is not typically at disposal when estimation is implemented recursively. It is shown that there exists a Bayes-closed description of the posterior density which is recursively computable without complete knowledge of the true posterior. We study a mutual relationship between the equivalence class, composed of densities matching the current description, and a prespecified parametric family. It is proved that if the approximation family is of the mixture type, the equivalence classes can be made orthogonal to this family. Then the approximating density done by the orthogonal projection of the true posterior density minimizes the Kullback-Leibler distance between both densities. On the contrary, if the approximation family is of the exponential type, the analogous result holds at most locally. To be able to give a sensible definition of the orthogonal projection, we have been forced to introduce a Riemannian geometry on the family of probability distributions. Being aware that the differential-geometric concepts and tools do not belong to common knowledge of control engineers, we include necessary preliminary information. © 1990.
引用
收藏
页码:545 / 555
页数:11
相关论文
共 21 条
[1]  
Amari S., 1985, LECT NOTES STAT
[2]  
BERNARDO JM, 1987, PROBABILITY BAYESIAN
[3]  
Boothby W. M., 1975, INTRO DIFFERENTIABLE
[4]   DIGITAL SYNTHESIS OF NON-LINEAR FILTERS [J].
BUCY, RS ;
SENNE, KD .
AUTOMATICA, 1971, 7 (03) :287-&
[5]  
CHENTSOV NN, 1982, STATISTICAL DECISION
[6]  
de Finetti B., 1970, THEORY PROBABILITY, V1
[7]  
DEFINETTI B, 1972, THEORY PROBABILITY, V2
[8]   GAUSSIAN APPROXIMATION IN RECURSIVE ESTIMATION OF MULTIPLE STATES OF NONLINEAR WIENER SYSTEMS [J].
JACOBS, OLR .
AUTOMATICA, 1988, 24 (02) :243-247
[9]  
Kalman R. E., 1960, T ASME J BASIC ENG, V82, P35, DOI DOI 10.1115/1.3662552
[10]  
KARNY M, 1988, KYBERNETIKA, V24, P321