Stability analysis of learning algorithms for blind source separation

被引:223
作者
Amari, S
Chen, TP
Cichocki, A
机构
[1] RIKEN Frontier Research Program, Brain Information Processing Group, Wako-shi
关键词
blind source separation; stability of learning; efficiency of learning; natural gradient; independent component analysis (ICA);
D O I
10.1016/S0893-6080(97)00039-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently a number of adaptive learning algorithms have been proposed for blind source separation. Although the underlying principals and approaches are different, most of them have very similar forms. Two important issues remained to be elucidated further: the statistical efficiency and the stability of learning algorithms. The present letter analyzes a general form of statistically efficient algorithms and gives a necessary and sufficient condition for the separating solution to be a stable equilibrium of a general learning algorithm. Moreover, when the separating solution is unstable, a simple method is given for stabilizing the separating solution by modifying the algorithm. (C) 1997 Elsevier Science Ltd.
引用
收藏
页码:1345 / 1351
页数:7
相关论文
共 23 条
[1]  
Amari S, 1996, ADV NEUR IN, V8, P757
[2]   A THEORY OF ADAPTIVE PATTERN CLASSIFIERS [J].
AMARI, S .
IEEE TRANSACTIONS ON ELECTRONIC COMPUTERS, 1967, EC16 (03) :299-+
[3]   Information geometry of estimating functions in semi-parametric statistical models [J].
Amari, S ;
Kawanabe, M .
BERNOULLI, 1997, 3 (01) :29-54
[4]  
AMARI S, 1995, P INT S NONL THEOR I, P37
[5]  
AMARI S, 1997, IN PRESS NEURAL COMP
[6]  
AMARI S, 1997, IN PRESS IEEE T SIGN
[7]  
Amari S.-I., 1985, SPRINGER LECT NOTES
[8]   AN INFORMATION MAXIMIZATION APPROACH TO BLIND SEPARATION AND BLIND DECONVOLUTION [J].
BELL, AJ ;
SEJNOWSKI, TJ .
NEURAL COMPUTATION, 1995, 7 (06) :1129-1159
[9]  
Bickel Peter J, 1993, Efficient and adaptive estimation for semiparametric models, V4
[10]   Equivariant adaptive source separation [J].
Cardoso, JF ;
Laheld, BH .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1996, 44 (12) :3017-3030