EM algorithms for Gaussian mixtures with split-and-merge operation

被引:103
作者
Zhang, ZH
Chen, CB
Sun, J
Chan, KL
机构
[1] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
[2] Beijing Sigma Ctr, MSR, Microsoft Res Asia, Beijing 100080, Peoples R China
关键词
Gaussian mixtures; EM algorithms; split-and-merge operation; statistical computer vision; image segmentation;
D O I
10.1016/S0031-3203(03)00059-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In order to alleviate the problem of local convergence of the usual EM algorithm, a split-and-merge operation is introduced into the EM algorithm for Gaussian mixtures. The split-and-merge equations are first presented theoretically. These equations show that the merge operation is a well-posed problem, whereas the split operation is an ill-posed problem because it is the inverse procedure of the merge. Two methods for solving this ill-posed problem are developed through the singular value decomposition and the Cholesky decomposition. Accordingly, a new modified EM algorithm is constructed. Our experiments demonstrate that this algorithm is efficient for unsupervised color image segmentation. (C) 2003 Pattern Recognition Society. Published by Elsevier Science Ltd. All rights reserved.
引用
收藏
页码:1973 / 1983
页数:11
相关论文
共 27 条
[1]   Robust full Bayesian learning for radial basis networks [J].
Andrieu, C ;
de Freitas, N ;
Doucet, A .
NEURAL COMPUTATION, 2001, 13 (10) :2359-2407
[2]  
[Anonymous], 2000, WILEY SERIES PROBABI
[3]  
[Anonymous], INT C NEUR NETW SIGN
[4]  
Bishop C. M., 1995, NEURAL NETWORKS PATT
[5]  
CLARK E, 1999, P ICASSP, V6, P3497
[6]   MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38
[7]   Unsupervised learning of finite mixture models [J].
Figueiredo, MAT ;
Jain, AK .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (03) :381-396
[8]  
Ghahramani Z, 2000, ADV NEUR IN, V12, P449
[9]  
Golub G.H., 2013, MATRIX COMPUTATIONS
[10]  
Green PJ, 1995, BIOMETRIKA, V82, P711, DOI 10.2307/2337340