A kurtosis-based dynamic approach to Gaussian mixture modeling

被引:68
作者
Vlassis, N [1 ]
Likas, A
机构
[1] Univ Amsterdam, Dept Comp Sci, Autonomous Learning Funct SNN, RWCP, NL-1098 SJ Amsterdam, Netherlands
[2] Univ Ioannina, Dept Comp Sci, GR-45110 Ioannina, Greece
来源
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART A-SYSTEMS AND HUMANS | 1999年 / 29卷 / 04期
关键词
expectation-maximization (EM) algorithm; Gaussian mixture modeling; number of mixing kernels; probability density function estimation; total kurtosis; weighted kurtosis;
D O I
10.1109/3468.769758
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
We address the problem of probability density function estimation using a Gaussian mixture model updated with the expectation-maximization (EM) algorithm. To deal with the case of an unknown number of mixing kernels, we define a new measure for Gaussian mixtures, called total kurtosis, which is based on the weighted sample kurtoses of the kernels. This measure provides an indication of how well the Gaussian mixture fits the data. Then we propose a new dynamic algorithm for Gaussian mixture density estimation which monitors the total kurtosis at each step of the Ehl algorithm in order to decide dynamically on the correct number of kernels and possibly escape from local maxima. We show the potential of our technique in approximating unknown densities through a series of examples with several density estimation problems.
引用
收藏
页码:393 / 399
页数:7
相关论文
共 16 条
[1]   MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38
[2]   TESTING FOR THE NUMBER OF COMPONENTS IN A MIXTURE OF NORMAL-DISTRIBUTIONS USING MOMENT ESTIMATORS [J].
FURMAN, WD ;
LINDSAY, BG .
COMPUTATIONAL STATISTICS & DATA ANALYSIS, 1994, 17 (05) :473-492
[3]  
Ingrassia S., 1992, Statistics and Computing, V2, P203, DOI 10.1007/BF01889680
[4]  
McLachlan G. J., 1997, EM ALGORITHM EXTENSI
[5]  
McLachlan G. J, 1987, APPL STAT-J ROY ST C, V36, P318, DOI DOI 10.2307/2347790
[6]   ESTIMATION OF A PROBABILITY DENSITY-FUNCTION AND MODE [J].
PARZEN, E .
ANNALS OF MATHEMATICAL STATISTICS, 1962, 33 (03) :1065-&
[7]   MIXTURE DENSITIES, MAXIMUM-LIKELIHOOD AND THE EM ALGORITHM [J].
REDNER, RA ;
WALKER, HF .
SIAM REVIEW, 1984, 26 (02) :195-237
[8]  
Ripley B. D., 1996, Pattern Recognition and Neural Networks
[9]  
SHIMOJI S, 1994, THESIS U SO CALIFORN
[10]   PROBABILISTIC NEURAL NETWORKS [J].
SPECHT, DF .
NEURAL NETWORKS, 1990, 3 (01) :109-118