Self-control in sparsely coded networks

被引:27
作者
Dominguez, DRC [1 ]
Bolle, D [1 ]
机构
[1] Katholieke Univ Leuven, Inst Theoret Fys, B-3001 Louvain, Belgium
关键词
D O I
10.1103/PhysRevLett.80.2961
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
A complete self-control mechanism is proposed in the dynamics of neural networks through the introduction of a time-dependent threshold, determined in function of both the noise and the pattern activity in the network. Especially for sparsely coded models this mechanism is shown to considerably improve the storage capacity, the basins of attraction, and the mutual information content.
引用
收藏
页码:2961 / 2964
页数:4
相关论文
共 14 条
[1]   CHARACTERISTICS OF SPARSELY ENCODED ASSOCIATIVE MEMORY [J].
AMARI, S .
NEURAL NETWORKS, 1989, 2 (06) :451-457
[2]   INFORMATION-STORAGE IN NEURAL NETWORKS WITH LOW-LEVELS OF ACTIVITY [J].
AMIT, DJ ;
GUTFREUND, H ;
SOMPOLINSKY, H .
PHYSICAL REVIEW A, 1987, 35 (05) :2293-2303
[3]   PROPERTIES OF SPARSELY CONNECTED EXCITATORY NEURAL NETWORKS [J].
BARKAI, E ;
KANTER, I ;
SOMPOLINSKY, H .
PHYSICAL REVIEW A, 1990, 41 (02) :590-597
[4]   RETRIEVAL AND CHAOS IN EXTREMELY DILUTED Q-ISING NEURAL NETWORKS [J].
BOLLE, D ;
SHIM, GM ;
VINCK, B ;
ZAGREBNOV, VA .
JOURNAL OF STATISTICAL PHYSICS, 1994, 74 (3-4) :565-582
[5]   ASSOCIATIVE MEMORY WITH HIGH INFORMATION-CONTENT [J].
BUHMANN, J ;
DIVKO, R ;
SCHULTEN, K .
PHYSICAL REVIEW A, 1989, 39 (05) :2689-2692
[6]   AN EXACTLY SOLVABLE ASYMMETRIC NEURAL NETWORK MODEL [J].
DERRIDA, B ;
GARDNER, E ;
ZIPPELIUS, A .
EUROPHYSICS LETTERS, 1987, 4 (02) :167-173
[7]  
Hertz J., 1991, Introduction to the Theory of Neural Computation
[8]   NEURAL NETWORKS WITH DYNAMICAL THRESHOLDS [J].
HORN, D ;
USHER, M .
PHYSICAL REVIEW A, 1989, 40 (02) :1036-1044
[9]   NEURAL NETWORKS WITH LOW-LEVELS OF ACTIVITY - ISING VS MCCULLOCH-PITTS NEURONS [J].
HORNER, H .
ZEITSCHRIFT FUR PHYSIK B-CONDENSED MATTER, 1989, 75 (01) :133-136
[10]   Information storage in sparsely coded memory nets [J].
Nadal, Jean-Pierre ;
Toulouse, Gerard .
NETWORK-COMPUTATION IN NEURAL SYSTEMS, 1990, 1 (01) :61-74