Mixtures of Factor Analyzers with Common Factor Loadings: Applications to the Clustering and Visualization of High-Dimensional Data

被引:96
作者
Baek, Jangsun [1 ]
McLachlan, Geoffrey J. [2 ,3 ]
Flack, Lloyd K. [2 ,3 ]
机构
[1] Chonnam Natl Univ, Dept Stat, Kwangju 500757, South Korea
[2] Univ Queensland, Dept Math, Brisbane, Qld 4072, Australia
[3] Univ Queensland, Inst Mol Biosci, Brisbane, Qld 4072, Australia
基金
澳大利亚研究理事会;
关键词
Normal mixture models; mixtures of factor analyzers; common factor loadings; model-based clustering; MODEL;
D O I
10.1109/TPAMI.2009.149
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Mixtures of factor analyzers enable model-based density estimation to be undertaken for high-dimensional data, where the number of observations n is not very large relative to their dimension p. In practice, there is often the need to further reduce the number of parameters in the specification of the component-covariance matrices. To this end, we propose the use of common component-factor loadings, which considerably reduces further the number of parameters. Moreover, it allows the data to be displayed in low-dimensional plots.
引用
收藏
页码:1298 / 1309
页数:12
相关论文
共 25 条
[1]  
[Anonymous], 2008, EM ALGORITHM EXTENSI
[2]  
[Anonymous], 1901, B SOCIETE VAUDOISEDE
[3]  
AXELROD S, 2002, P INT C SPOK LANG PR
[4]  
BAEK J, 2008, PREPRINT SERIES I NE
[5]   MODEL-BASED GAUSSIAN AND NON-GAUSSIAN CLUSTERING [J].
BANFIELD, JD ;
RAFTERY, AE .
BIOMETRICS, 1993, 49 (03) :803-821
[6]   MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38
[7]   Semi-tied covariance matrices for hidden Markov models [J].
Gales, MJF .
IEEE TRANSACTIONS ON SPEECH AND AUDIO PROCESSING, 1999, 7 (03) :272-281
[8]   Latent classes of objects and variable selection [J].
Galimberti, Giuliano ;
Montanari, Angela ;
Viroli, Cinzia .
COMPSTAT 2008: PROCEEDINGS IN COMPUTATIONAL STATISTICS, 2008, :373-383
[9]  
Gopinath R.A., 1998, Proceedings International Conference on Speech and Language Processing, P397
[10]   Modeling the manifolds of images of handwritten digits [J].
Hinton, GE ;
Dayan, P ;
Revow, M .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1997, 8 (01) :65-74