A fast fixed-point BYY harmony learning algorithm on Gaussian mixture with automated model selection

被引:29
作者
Ma, Jinwen [1 ,2 ]
He, Xuefeng [1 ,2 ]
机构
[1] Peking Univ, Sch Math Sci, Dept Informat Sci, Beijing 100871, Peoples R China
[2] Peking Univ, LMAM, Beijing 100871, Peoples R China
基金
中国国家自然科学基金;
关键词
Bayesian ying-yang (BYY) system; harmony learning; Gaussian mixture; automated model selection; fixed-point;
D O I
10.1016/j.patrec.2007.11.014
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The Bayesian Ying-Yang (BYY) harmony learning theory has brought about a new mechanism that model selection on Gaussian mixture can be made automatically during parameter learning via maximization of a harmony function on finite mixture defined through a specific bidirectional architecture (B I-architecture) of the BYY learning system. In this paper, we propose a fast fixed-point learning algorithm for efficiently implementing maximization of the harmony function on Gaussian mixture with automated model selection. Several simulation experiments are performed to compare its effectiveness in automated model selection as well as its efficiency in parameter learning with other existing learning algorithms. The experimental results reveal that the performance of the proposed algorithm is superior to its counterparts in these aspects. Moreover, the proposed algorithm is further tested with three typical real-world data sets and successfully applied to unsupervised color image segmentation. (c) 2007 Published by Elsevier B.V.
引用
收藏
页码:701 / 711
页数:11
相关论文
共 26 条
[1]   NEW LOOK AT STATISTICAL-MODEL IDENTIFICATION [J].
AKAIKE, H .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1974, AC19 (06) :716-723
[2]  
[Anonymous], HDB BRAIN THEORY NEU
[3]  
Blake C.L., 1998, UCI repository of machine learning databases
[4]   Generalized competitive clustering for image segmentation [J].
Boujemaa, N .
PEACHFUZZ 2000 : 19TH INTERNATIONAL CONFERENCE OF THE NORTH AMERICAN FUZZY INFORMATION PROCESSING SOCIETY - NAFIPS, 2000, :133-137
[5]  
Duda R O, 2001, PATTER CLASSIFICATIO
[6]   ON SOME INVARIANT CRITERIA FOR GROUPING DATA [J].
FRIEDMAN, HP ;
RUBIN, J .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1967, 62 (320) :1159-&
[7]   Regularized mixture discriminant analysis [J].
Halbe, Zohar ;
Aladjem, Mayer .
PATTERN RECOGNITION LETTERS, 2007, 28 (15) :2104-2115
[8]  
Hartigan J. A., 1977, CLASSIFICATION CLUST, P45
[9]  
Jain A.K., 1988, ALGORITHM CLUSTERING
[10]   The BYY annealing learning algorithm for Gaussian mixture with automated model selection [J].
Ma, Jinwen ;
Liu, Jianfeng .
PATTERN RECOGNITION, 2007, 40 (07) :2029-2037