Relaxation, closing probabilities and transition from oscillatory to chaotic attractors in asymmetric neural networks

被引:19
作者
Bastolla, U
Parisi, G
机构
[1] Forschungszentrum Julich, HLRZ, D-52425 Julich, Germany
[2] Univ Roma La Sapienza, Dipartimento Fis, I-00185 Rome, Italy
来源
JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL | 1998年 / 31卷 / 20期
关键词
D O I
10.1088/0305-4470/31/20/003
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
Attractors in asymmetric neural networks with deterministic parallel dynamics present a 'chaotic' regime at symmetry eta less than or equal to 0.5 where the average length of the cycles increases exponentially with system size, and an oscillatory regime at high symmetry. where the average length of the cycles is 2. We show, both with analytic arguments and numerically, that there is a sharp transition, at a critical symmetry eta(c) = 0.33, between a phase where the typical cycles have length 2 and basins of attraction of vanishing weight and a phase where the typical cycles are exponentially long with system size, and the weights of their attraction basins are distributed as in a random map with reversal symmetry. The timescale after which cycles are reached grows exponentially with system size N, and the exponent vanishes in the symmetric limit, where T proportional to N(2/3). The transition can be related to the dynamics of the infinite system (where cycles are never reached), using the closing probabilities as a tool. We also study the relaxation of the function E(t) = -1/N Sigma(l)\h(i)(t)\, where h(i) is the local field experienced by the neuron i. In the symmetric system, it plays the role of a Ljapunov function which drives the system towards its minima through steepest descent. This interpretation survives, even if only on the average, also for small asymmetry. This acts like an effective temperature: the larger the asymmetry, the faster the relaxation, and the higher the asymptotic value reached. E reaches very deep minima in the fixed points of the dynamics, which are reached with vanishing probability, and attains a larger value on the typical attractors, which are cycles of length 2.
引用
收藏
页码:4583 / 4602
页数:20
相关论文
共 41 条
[1]  
Amit D., 1989, Modelling Brain Function: the World of Attractor Neural Networks
[2]   Attractors in fully asymmetric neural networks [J].
Bastolla, U ;
Parisi, G .
JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1997, 30 (16) :5613-5631
[3]   Attraction basins in discretized maps [J].
Bastolla, U ;
Parisi, G .
JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1997, 30 (11) :3757-3769
[4]  
BASTOLLA U, 1997, IN PRESS PHYSICA D
[5]  
BASTOLLA U, 1966, PHYSICA D, V98, P1
[6]   SCALING BEHAVIOR OF RANDOM MAPS [J].
BECK, C .
PHYSICS LETTERS A, 1989, 136 (03) :121-125
[7]   ASYMMETRIC LITTLE SPIN-GLASS MODEL [J].
BRUNETTI, R ;
PARISI, G ;
RITORT, F .
PHYSICAL REVIEW B, 1992, 46 (09) :5339-5350
[8]   TRANSITION FROM REGULAR TO COMPLEX BEHAVIOR IN A DISCRETE DETERMINISTIC ASYMMETRIC NEURAL-NETWORK MODEL [J].
CRISANTI, A ;
FALCIONI, M ;
VULPIANI, A .
JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1993, 26 (14) :3441-3453
[9]   DYNAMICS OF SPIN SYSTEMS WITH RANDOMLY ASYMMETRIC BONDS - LANGEVIN DYNAMICS AND A SPHERICAL MODEL [J].
CRISANTI, A ;
SOMPOLINSKY, H .
PHYSICAL REVIEW A, 1987, 36 (10) :4922-4939
[10]   DYNAMICS OF SPIN SYSTEMS WITH RANDOMLY ASYMMETRIC BONDS - ISING SPINS AND GLAUBER DYNAMICS [J].
CRISANTI, A ;
SOMPOLINSKY, H .
PHYSICAL REVIEW A, 1988, 37 (12) :4865-4874