ASSOCIATIVE MEMORY IN AN ANALOG ITERATED-MAP NEURAL NETWORK

被引:73
作者
MARCUS, CM [1 ]
WAUGH, FR [1 ]
WESTERVELT, RM [1 ]
机构
[1] HARVARD UNIV, DEPT PHYS, CAMBRIDGE, MA 02138 USA
来源
PHYSICAL REVIEW A | 1990年 / 41卷 / 06期
关键词
D O I
10.1103/PhysRevA.41.3355
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
The behavior of an analog neural network with parallel dynamics is studied analytically and numerically for two associative-memory learning algorithms, the Hebb rule and the pseudoinverse rule. Phase diagrams in the parameter space of analog gain and storage ratio are presented. For both learning rules, the networks have large recall phases in which retrieval states exist and convergence to a fixed point is guaranteed by a global stability criterion. We also demonstrate numerically that using a reduced analog gain increases the probability of recall starting from a random initial state. This phenomenon is comparable to thermal annealing used to escape local minima but has the advantage of being deterministic, and therefore easily implemented in electronic hardware. Similarities and differences between analog neural networks and networks with two-state neurons at finite temperature are also discussed. © 1990 The American Physical Society.
引用
收藏
页码:3355 / 3364
页数:10
相关论文
共 51 条
[1]   STORING INFINITE NUMBERS OF PATTERNS IN A SPIN-GLASS MODEL OF NEURAL NETWORKS [J].
AMIT, DJ ;
GUTFREUND, H ;
SOMPOLINSKY, H .
PHYSICAL REVIEW LETTERS, 1985, 55 (14) :1530-1533
[2]   STATISTICAL-MECHANICS OF NEURAL NETWORKS NEAR SATURATION [J].
AMIT, DJ ;
GUTFREUND, H ;
SOMPOLINSKY, H .
ANNALS OF PHYSICS, 1987, 173 (01) :30-67
[3]  
[Anonymous], 1989, ANALOG VLSI NEURAL S
[4]  
BLAKE A., 1987, VISUAL RECONSTRUCTIO
[5]   THEORY OF FIRST-ORDER MAGNETIC PHASE CHANGE IN UO2 [J].
BLUME, M .
PHYSICAL REVIEW, 1966, 141 (02) :517-&
[6]   EVIDENCE FOR MASSLESS MODES IN THE SOLVABLE MODEL OF A SPIN GLASS [J].
BRAY, AJ ;
MOORE, MA .
JOURNAL OF PHYSICS C-SOLID STATE PHYSICS, 1979, 12 (11) :L441-L448
[7]  
BROUT R, 1967, PHYSICS NY, V3, P417
[8]   ON POSSIBILITY OF FIRST-ORDER PHASE TRANSITIONS IN ISING SYSTEMS OF TRIPLET IONS WITH ZERO-FIELD SPLITTING [J].
CAPEL, HW .
PHYSICA, 1966, 32 (05) :966-&
[9]   DIGITAL DYNAMICS AND THE SIMULATION OF MAGNETIC SYSTEMS [J].
CHOI, MY ;
HUBERMAN, BA .
PHYSICAL REVIEW B, 1983, 28 (05) :2547-2554
[10]   ABSOLUTE STABILITY OF GLOBAL PATTERN-FORMATION AND PARALLEL MEMORY STORAGE BY COMPETITIVE NEURAL NETWORKS [J].
COHEN, MA ;
GROSSBERG, S .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1983, 13 (05) :815-826