A simulated annealing version of the EM algorithm for non-Gaussian deconvolution

被引:23
作者
Lavielle, M
Moulines, E
机构
[1] UNIV PARIS 05,F-75270 PARIS 06,FRANCE
[2] UNIV PARIS SUD,PARIS,FRANCE
[3] TELECOM PARIS,URA 820,F-75634 PARIS 13,FRANCE
关键词
EM algorithm; deconvolution; linear filters; stochastic algorithms; simulated annealing;
D O I
10.1023/A:1018594320699
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The Expectation-Maximization (EM) algorithm is a very popular technique for maximum likelihood estimation in incomplete data models. When the expectation step cannot be performed in closed form, a stochastic approximation of EM (SAEM) can be used. Under very general conditions, the authors have shown that the attractive stationary points of the SAEM algorithm correspond to the global and local maxima of the observed likelihood. In order to avoid convergence towards a local maxima, a simulated annealing version of SAEM is proposed. An illustrative application to the convolution model for estimating the coefficients of the filter is given.
引用
收藏
页码:229 / 236
页数:8
相关论文
共 17 条
[1]   COMPARING SWEEP STRATEGIES FOR STOCHASTIC RELAXATION [J].
AMIT, Y ;
GRENANDER, U .
JOURNAL OF MULTIVARIATE ANALYSIS, 1991, 37 (02) :197-222
[2]  
[Anonymous], SPRINGER SERIES STAT
[3]   DOMAINS OF CONVERGENCE FOR THE EM ALGORITHM - A CAUTIONARY TALE IN A LOCATION ESTIMATION PROBLEM [J].
ARSLAN, O ;
CONSTABLE, PDL ;
KENT, JT .
STATISTICS AND COMPUTING, 1993, 3 (03) :103-108
[4]  
Benveniste A, 1990, Adaptive algorithms and stochastic approximations
[5]   MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38
[6]  
DUFLO M, 1996, ALGORITHMES STOCHAST
[7]   METROPOLIS-TYPE ANNEALING ALGORITHMS FOR GLOBAL OPTIMIZATION IN RD [J].
GELFAND, SB ;
MITTER, SK .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1993, 31 (01) :111-131
[8]   IDENTIFICATION OF NONMINIMUM PHASE SYSTEMS USING HIGHER-ORDER STATISTICS [J].
GIANNAKIS, GB ;
MENDEL, JM .
IEEE TRANSACTIONS ON ACOUSTICS SPEECH AND SIGNAL PROCESSING, 1989, 37 (03) :360-377
[9]  
KALEH G, 1994, IEEE T COMMUN, V7, P2406
[10]   ACCELERATED STOCHASTIC-APPROXIMATION [J].
KESTEN, H .
ANNALS OF MATHEMATICAL STATISTICS, 1958, 29 (01) :41-59