Dynamical properties of a randomly diluted neural network with variable activity

被引:3
作者
Grosskinsky, S [1 ]
机构
[1] SUNY Stony Brook, Inst Theoret Phys, Stony Brook, NY 11794 USA
来源
JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL | 1999年 / 32卷 / 16期
关键词
D O I
10.1088/0305-4470/32/16/007
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
The subject of this paper is a neural network with binary neurons, randomly diluted synapses and variable pattern activity. We look at the system with parallel updating using a probabilistic approach to solve the one-step dynamics with one condensed pattern. We derive restrictions on the storage capacity and the mutual information content occuring during the retrieval process. Special focus is placed on the constraints on the threshold for optimal performance. We also look at the effect of noisy updating, giving a dynamical version of the critical temperature, the corresponding threshold and an approximation for the time evolution for small temperatures. The description is applicable to the whole retrieval process in the limit of strong dilution. The analysis is carried out as exactly as possible and over the whole parameter ranges, generalizing some former results.
引用
收藏
页码:2983 / 2995
页数:13
相关论文
共 16 条
[1]  
Amit D., 1989, Modelling Brain Function: the World of Attractor Neural Networks
[2]   SPIN-GLASS MODELS OF NEURAL NETWORKS [J].
AMIT, DJ ;
GUTFREUND, H .
PHYSICAL REVIEW A, 1985, 32 (02) :1007-1018
[3]   INFORMATION-STORAGE IN NEURAL NETWORKS WITH LOW-LEVELS OF ACTIVITY [J].
AMIT, DJ ;
GUTFREUND, H ;
SOMPOLINSKY, H .
PHYSICAL REVIEW A, 1987, 35 (05) :2293-2303
[4]   STORING INFINITE NUMBERS OF PATTERNS IN A SPIN-GLASS MODEL OF NEURAL NETWORKS [J].
AMIT, DJ ;
GUTFREUND, H ;
SOMPOLINSKY, H .
PHYSICAL REVIEW LETTERS, 1985, 55 (14) :1530-1533
[5]   ON THE PARALLEL DYNAMICS OF THE Q-STATE POTTS AND Q-ISING NEURAL NETWORKS [J].
BOLLE, D ;
VINCK, B ;
ZAGREBNOV, VA .
JOURNAL OF STATISTICAL PHYSICS, 1993, 70 (5-6) :1099-1119
[6]   ASSOCIATIVE MEMORY WITH HIGH INFORMATION-CONTENT [J].
BUHMANN, J ;
DIVKO, R ;
SCHULTEN, K .
PHYSICAL REVIEW A, 1989, 39 (05) :2689-2692
[7]   AN EXACTLY SOLVABLE ASYMMETRIC NEURAL NETWORK MODEL [J].
DERRIDA, B ;
GARDNER, E ;
ZIPPELIUS, A .
EUROPHYSICS LETTERS, 1987, 4 (02) :167-173
[8]   Self-control in sparsely coded networks [J].
Dominguez, DRC ;
Bolle, D .
PHYSICAL REVIEW LETTERS, 1998, 80 (13) :2961-2964
[9]   THE SPACE OF INTERACTIONS IN NEURAL NETWORK MODELS [J].
GARDNER, E .
JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1988, 21 (01) :257-270
[10]  
Hertz J., 1991, Introduction to the Theory of Neural Computation