Thresholds in layered neural networks with variable activity

被引:7
作者
Bollé, D
Massolo, G
机构
[1] Katholieke Univ Leuven, Inst Theoret Fys, B-3001 Louvain, Belgium
[2] Univ Studi Insubria, Fac Sci, I-22100 Como, Italy
[3] Katholieke Univ Leuven, Interdisciplinair Cent Neurale Netwerken, Louvain, Belgium
来源
JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL | 2000年 / 33卷 / 14期
关键词
D O I
10.1088/0305-4470/33/14/301
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
The inclusion of a threshold in the dynamics of layered neural networks with variable activity is studied at arbitrary temperature. In particular, the effects on the retrieval quality of a self-controlled threshold obtained by forcing the neural activity to stay equal to the activity of the stored patterns during the whole retrieval process, are compared with those of a threshold chosen externally for every loading and every temperature through optimization of the mutual information content of the network. Numerical results, mostly concerning low-activity networks are discussed.
引用
收藏
页码:2597 / 2609
页数:13
相关论文
共 27 条
[1]   CHARACTERISTICS OF SPARSELY ENCODED ASSOCIATIVE MEMORY [J].
AMARI, S .
NEURAL NETWORKS, 1989, 2 (06) :451-457
[2]   INFORMATION-STORAGE IN NEURAL NETWORKS WITH LOW-LEVELS OF ACTIVITY [J].
AMIT, DJ ;
GUTFREUND, H ;
SOMPOLINSKY, H .
PHYSICAL REVIEW A, 1987, 35 (05) :2293-2303
[3]  
Bishop C. M., 1995, NEURAL NETWORKS PATT
[4]  
BLAHUT RE, 1997, PRINCIPLES PRACTICE
[5]   RETRIEVAL AND CHAOS IN LAYERED Q-ISING NEURAL NETWORKS [J].
BOLLE, D ;
SHIM, GM ;
VINCK, B .
JOURNAL OF STATISTICAL PHYSICS, 1994, 74 (3-4) :583-606
[6]   Parallel dynamics of fully connected Q-Ising neural networks [J].
Bolle, D ;
Jongen, G ;
Shim, GM .
JOURNAL OF STATISTICAL PHYSICS, 1998, 91 (1-2) :125-153
[7]  
BOLLE D, 1999, CONDMAT9907390
[8]  
BOLLE D, 1999, P INT C MATH PHYS ST
[9]   ASSOCIATIVE MEMORY WITH HIGH INFORMATION-CONTENT [J].
BUHMANN, J ;
DIVKO, R ;
SCHULTEN, K .
PHYSICAL REVIEW A, 1989, 39 (05) :2689-2692
[10]   AN EXACTLY SOLVABLE ASYMMETRIC NEURAL NETWORK MODEL [J].
DERRIDA, B ;
GARDNER, E ;
ZIPPELIUS, A .
EUROPHYSICS LETTERS, 1987, 4 (02) :167-173