A theory for learning by weight flow on Stiefel-Grassman manifold

被引:71
作者
Fiori, S [1 ]
机构
[1] Univ Perugia, Dept Ind Engn, Neural Networks & Adapt Syst Res Grp, I-06100 Perugia, Italy
关键词
D O I
10.1162/089976601750265036
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently we introduced the concept of neural network learning on Stiefel-Grassman manifold for multilayer perceptron-like networks. Contributions of other authors have also appeared in the scientific literature about this topic. This article presents a general theory for it and illustrates how existing theories may be explained within the general framework proposed here.
引用
收藏
页码:1625 / 1647
页数:23
相关论文
共 53 条
[1]  
AFFES S, 1995, P IEEE IEE WORKSH SI, P64
[2]   GLOBAL OPTIMIZATION AND STOCHASTIC DIFFERENTIAL-EQUATIONS [J].
ALUFFIPENTINI, F ;
PARISI, V ;
ZIRILLI, F .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1985, 47 (01) :1-16
[3]   Natural gradient works efficiently in learning [J].
Amari, S .
NEURAL COMPUTATION, 1998, 10 (02) :251-276
[4]   Natural gradient learning for over- and under-complete bases in ICA [J].
Amari, S .
NEURAL COMPUTATION, 1999, 11 (08) :1875-1883
[5]  
ANG B, 1995, IEEE T SIGNAL PROCES, V43, P1247
[6]  
[Anonymous], AUSDEHNUNGSLEHRE
[7]  
BARLOW HB, 1994, LARGE SCALE NEURONAL
[8]   AN INFORMATION MAXIMIZATION APPROACH TO BLIND SEPARATION AND BLIND DECONVOLUTION [J].
BELL, AJ ;
SEJNOWSKI, TJ .
NEURAL COMPUTATION, 1995, 7 (06) :1129-1159
[9]  
BERTEKAS DP, 1982, CONSTRAINED OPTIMIZA
[10]   DYNAMIC-SYSTEMS THAT SORT LISTS, DIAGONALIZE MATRICES, AND SOLVE LINEAR-PROGRAMMING PROBLEMS [J].
BROCKETT, RW .
LINEAR ALGEBRA AND ITS APPLICATIONS, 1991, 146 :79-91