STATISTICAL-MECHANICS OF HOPFIELD-LIKE NEURAL NETWORKS WITH MODIFIED INTERACTIONS

被引:29
作者
DOTSENKO, VS [1 ]
YARUNIN, ND [1 ]
DOROTHEYEV, EA [1 ]
机构
[1] NE ZHUKOVSKII CENT AIRHYDRODYNAM INST,MOSCOW,USSR
来源
JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL | 1991年 / 24卷 / 10期
关键词
D O I
10.1088/0305-4470/24/10/026
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
Hopfield-like neural networks with modified interactions are studied by a mean-field theory. The modification of interactions is achieved during a special thermally noised iterative procedure. The resulting couplings have an intermediate form between the Hebb-like learning rule and the pseudo inverse one. Replica-symmetric free energy of the model is obtained. Statistical properties of the model depend on three parameters: reduced number of the stored patterns alpha, reduced number of iteration steps of the modification procedure lambda and the temperature T. The phase diagram in the space of these parameters is obtained. The network can retrieve patterns at T = 0 for alpha < alpha(c) (lambda), where alpha-c(0) congruent-to 0.14 and alpha-c (lambda --> infinity) congruent-to 1.07. As alpha decreases below alpha-0(lambda) the FM retrieval stages become ground states of the system, where alpha-0(0) = 0.05 and alpha-0(lambda --> infinity) = 2/pi.
引用
收藏
页码:2419 / 2429
页数:11
相关论文
共 13 条
[1]   RETRIEVAL PHASE-DIAGRAMS FOR ATTRACTOR NEURAL NETWORKS WITH OPTIMAL INTERACTIONS [J].
AMIT, DJ ;
EVANS, MR ;
HORNER, H ;
WONG, KYM .
JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1990, 23 (14) :3361-3381
[2]   STATISTICAL-MECHANICS OF NEURAL NETWORKS NEAR SATURATION [J].
AMIT, DJ ;
GUTFREUND, H ;
SOMPOLINSKY, H .
ANNALS OF PHYSICS, 1987, 173 (01) :30-67
[3]   OPTIMAL BASINS OF ATTRACTION IN RANDOMLY SPARSE NEURAL NETWORK MODELS [J].
GARDNER, E .
JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1989, 22 (12) :1969-1974
[4]   THE SPACE OF INTERACTIONS IN NEURAL NETWORK MODELS [J].
GARDNER, E .
JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1988, 21 (01) :257-270
[5]   TRAINING WITH NOISE AND THE STORAGE OF CORRELATED PATTERNS IN A NEURAL NETWORK MODEL [J].
GARDNER, EJ ;
STROUD, N ;
WALLACE, DJ .
JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1989, 22 (12) :2019-2030
[6]   NEURAL NETWORKS AND PHYSICAL SYSTEMS WITH EMERGENT COLLECTIVE COMPUTATIONAL ABILITIES [J].
HOPFIELD, JJ .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA-BIOLOGICAL SCIENCES, 1982, 79 (08) :2554-2558
[7]   ASSOCIATIVE RECALL OF MEMORY WITHOUT ERRORS [J].
KANTER, I ;
SOMPOLINSKY, H .
PHYSICAL REVIEW A, 1987, 35 (01) :380-392
[8]   UNLEARNING INCREASES THE STORAGE CAPACITY OF CONTENT ADDRESSABLE MEMORIES [J].
KLEINFELD, D ;
PENDERGRAFT, DB .
BIOPHYSICAL JOURNAL, 1987, 51 (01) :47-53
[9]  
Kohonen T., 1984, SELF ORG ASS MEMORY
[10]   INFORMATION-STORAGE AND RETRIEVAL IN SPIN-GLASS LIKE NEURAL NETWORKS [J].
PERSONNAZ, L ;
GUYON, I ;
DREYFUS, G .
JOURNAL DE PHYSIQUE LETTRES, 1985, 46 (08) :L359-L365