Dynamics of Learning In Hierarchical Models - Singularity and Milnor Attractor

被引：2

作者：

Amari, Shun-ichi ^{[1
]}

Ozeki, Tomoko ^{[1
]}

Cousseau, Florent ^{[1
]}

Wei, Haikun ^{[1
]}

机构：

[1] RIKEN, Brain Sci Inst, Saitama 3510198, Japan

来源：

ADVANCES IN COGNITIVE NEURODYNAMICS (II) | 2011年

关键词：

Dynamics of learning; On-line learning; Multilayer-perceptron; Singularity; Milnor attractor; MULTILAYER PERCEPTRONS; NETWORKS;

D O I：

10.1007/978-90-481-9695-1_1

中图分类号：

Q189 [神经科学];

学科分类号：

071006 ;

摘要：

We study the dynamics of learning in a hierarchical model such as multilayer perceptron. Such a model includes singularities, which affects its dynamics seriously. The Milnor type attractors appear, because of the singularity. We will show its trajectories explicitly, and present the topological nature of the singularities.

引用

页码：3 / 9

页数：7

共 7 条

[1] Natural gradient works efficiently in learning
Amari, S
[J]. NEURAL COMPUTATION, 1998, 10 (02) : 251 - 276
[2] Singularities affect dynamics of learning in neuromanifolds
Amari, Shun-ichi
Park, Hyeyoung
Ozeki, Tomoko
[J]. NEURAL COMPUTATION, 2006, 18 (05) : 1007 - 1065
[3] Dynamics of learning in multilayer perceptrons near singularities
Cousseau, Florent
Ozeki, Tomoko
Amari, Shun-ichi
[J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2008, 19 (08): : 1313 - 1328
[4] Local minima and plateaus in hierarchical structures of multilayer perceptrons
Fukumizu, K
Amari, S
[J]. NEURAL NETWORKS, 2000, 13 (03) : 317 - 327
[5] ON THE CONCEPT OF ATTRACTOR
MILNOR, J
[J]. COMMUNICATIONS IN MATHEMATICAL PHYSICS, 1985, 99 (02) : 177 - 195
[6] Dynamics of learning near singularities in radial basis function networks
Wei, Haikun
Amaria, Shun-ichi
[J]. NEURAL NETWORKS, 2008, 21 (07) : 989 - 1005
[7] Dynamics of learning near singularities in layered networks
Wei, Haikun
Zhang, Jun
Cousseau, Florent
Ozeki, Tomoko
Amari, Shun-Ichi
[J]. NEURAL COMPUTATION, 2008, 20 (03) : 813 - 843

← 1 →