ON THE RATE OF CONVERGENCE OF THE ECM ALGORITHM

被引:79
作者
MENG, XL
机构
关键词
CONDITIONAL MAXIMIZATION; EM ALGORITHM; GIBBS SAMPLER; INCOMPLETE DATA; MISSING DATA; SEM ALGORITHM; SPEED OF CONVERGENCE;
D O I
10.1214/aos/1176325371
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The fundamental result on the rate of convergence of the EM algorithm has proven to be theoretically valuable and practically useful. Here, this result is generalized to the ECM algorithm, a more flexible and applicable iterative algorithm proposed recently by Meng and Rubin. Results on the rate of convergence of variations of ECM are also presented. An example is given to show that intuitions accurate for complete-data iterative algorithms may not be trustworthy in the presence of missing data.
引用
收藏
页码:326 / 339
页数:14
相关论文
共 17 条
[1]   COMPARING SWEEP STRATEGIES FOR STOCHASTIC RELAXATION [J].
AMIT, Y ;
GRENANDER, U .
JOURNAL OF MULTIVARIATE ANALYSIS, 1991, 37 (02) :197-222
[2]   A MAXIMIZATION TECHNIQUE OCCURRING IN STATISTICAL ANALYSIS OF PROBABILISTIC FUNCTIONS OF MARKOV CHAINS [J].
BAUM, LE ;
PETRIE, T ;
SOULES, G ;
WEISS, N .
ANNALS OF MATHEMATICAL STATISTICS, 1970, 41 (01) :164-&
[3]  
BELIN TR, 1991, V98 STSD DEC CENSUS
[4]  
BESAG J, 1986, J R STAT SOC B, V48, P259
[5]  
Bishop Y., 1975, DISCRETE MULTIVARIAT
[6]   MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38
[7]  
DENNIS JE, 1983, NUMERICAL METHODS UN
[8]  
FADDEEV DK, 1963, COMPUTATIONAL METHOD
[9]   STOCHASTIC RELAXATION, GIBBS DISTRIBUTIONS, AND THE BAYESIAN RESTORATION OF IMAGES [J].
GEMAN, S ;
GEMAN, D .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1984, 6 (06) :721-741
[10]  
MENG X.- L., 1990, THESIS HARVARD U