LEARNING IN NEURAL NETWORKS WITH LOCAL MINIMA

被引:21
作者
HESKES, TM
SLIJPEN, ETP
KAPPEN, B
机构
[1] Department of Medical Physics and Biophysics, University of Nijmegen, 6525 EZ Nijmegen
来源
PHYSICAL REVIEW A | 1992年 / 46卷 / 08期
关键词
D O I
10.1103/PhysRevA.46.5221
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
An attempt is made to study learning in neural networks with local minima. For small learning parameters eta, the transition time from one mimimum to another is asymptotically given by exp(eta/eta), with eta, a constant independent of eta, called the reference learning parameter. A general scheme to calculate the reference learning parameter is presented. This scheme is valid for a large class of learning rules.
引用
收藏
页码:5221 / 5231
页数:11
相关论文
共 16 条
[1]  
[Anonymous], 1978, STOCHASTIC APPROXIMA
[2]   RELATION BETWEEN MASTER EQUATIONS AND RANDOM WALKS AND THEIR SOLUTIONS [J].
BEDEAUX, D ;
LAKATOSL.K ;
SHULER, KE .
JOURNAL OF MATHEMATICAL PHYSICS, 1971, 12 (10) :2116-+
[3]   A CONVERGENCE THEOREM FOR GROSSBERG LEARNING [J].
CLARK, DM ;
RAVISHANKAR, K .
NEURAL NETWORKS, 1990, 3 (01) :87-92
[4]  
Gardiner C.W., 1985, HDB STOCHASTIC METHO
[5]  
GROSSBERG S, 1969, J STATISTICAL PHYSIC, V48, P105
[6]  
HEBB DO, 1949, ORG BEHAVIOR
[7]   LEARNING-PROCESSES IN NEURAL NETWORKS [J].
HESKES, TM ;
KAPPEN, B .
PHYSICAL REVIEW A, 1991, 44 (04) :2718-2726
[8]   LEARNING-PARAMETER ADJUSTMENT IN NEURAL NETWORKS [J].
HESKES, TM ;
KAPPEN, B .
PHYSICAL REVIEW A, 1992, 45 (12) :8885-8893
[9]   NEURAL NETWORKS AND PHYSICAL SYSTEMS WITH EMERGENT COLLECTIVE COMPUTATIONAL ABILITIES [J].
HOPFIELD, JJ .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA-BIOLOGICAL SCIENCES, 1982, 79 (08) :2554-2558
[10]   SELF-ORGANIZED FORMATION OF TOPOLOGICALLY CORRECT FEATURE MAPS [J].
KOHONEN, T .
BIOLOGICAL CYBERNETICS, 1982, 43 (01) :59-69