ICA mixture models for unsupervised classification of non-Gaussian classes and automatic context switching in blind signal separation

被引:124
作者
Lee, TW [1 ]
Lewicki, MS
Sejnowski, TJ
机构
[1] Salk Inst Biol Studies, Computat Neurobiol Lab, Howard Hughes Med Inst, La Jolla, CA 92037 USA
[2] Univ Calif San Diego, Inst Neural Computat, La Jolla, CA 92093 USA
[3] Carnegie Mellon Univ, Dept Comp Sci, Pittsburgh, PA 15213 USA
[4] Carnegie Mellon Univ, Ctr Neural Basis Cognit, Pittsburgh, PA 15213 USA
[5] Univ Calif San Diego, Dept Biol, La Jolla, CA 92093 USA
关键词
unsupervised classification; Gaussian mixture model; independent component analysis; blind source separation; image coding; automatic context switching; maximum likelihood;
D O I
10.1109/34.879789
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
An unsupervised classification algorithm is derived by modeling observed data as a mixture of several mutually exclusive classes that are each described by linear combinations of independent, non-Gaussian densities. The algorithm estimates the density of each class and is able to model class distributions with non-Gaussian structure. The new algorithm can improve classification accuracy compared with standard Gaussian mixture models. When applied to blind source separation in nonstationary environments, the method can switch automatically between classes, which correspond to contexts with different mixing properties. The algorithm can learn efficient codes for images containing both natural scenes and text. This method shows promise for modeling non-Gaussian structure in high-dimensional data and has many potential applications.
引用
收藏
页码:1078 / 1089
页数:12
相关论文
共 37 条
  • [21] BLIND SEPARATION OF SOURCES .1. AN ADAPTIVE ALGORITHM BASED ON NEUROMIMETIC ARCHITECTURE
    JUTTEN, C
    HERAULT, J
    [J]. SIGNAL PROCESSING, 1991, 24 (01) : 1 - 10
  • [22] Lee T.W., 2000, P INT WORKSH IND COM, P239
  • [23] Lee TW, 1999, ADV NEUR IN, V11, P508
  • [24] Independent component analysis using an extended infomax algorithm for mixed subgaussian and supergaussian sources
    Lee, TW
    Girolami, M
    Sejnowski, TJ
    [J]. NEURAL COMPUTATION, 1999, 11 (02) : 417 - 441
  • [25] A unifying information-theoretic framework for independent component analysis
    Lee, TW
    Girolami, M
    Bell, AJ
    Sejnowski, TJ
    [J]. COMPUTERS & MATHEMATICS WITH APPLICATIONS, 2000, 39 (11) : 1 - 21
  • [26] LEE TW, 1999, P INT WORKSH IND COM, P209
  • [27] Lewicki MS, 1998, ADV NEUR IN, V10, P556
  • [28] Lewicki MS, 1998, ADV NEUR IN, V10, P815
  • [29] Probabilistic framework for the adaptation and comparison of image codes
    Lewicki, MS
    Olshausen, BA
    [J]. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 1999, 16 (07): : 1587 - 1601
  • [30] Learning overcomplete representations
    Lewicki, MS
    Sejnowski, TJ
    [J]. NEURAL COMPUTATION, 2000, 12 (02) : 337 - 365