Capacity and information efficiency of the associative net

被引:34
作者
Graham, B
Willshaw, D
机构
关键词
D O I
10.1088/0954-898X/8/1/005
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Numerical calculations have been used to assess the performance of three different winners-fake-all recall strategies for the associative net model of heteroassociative memory. Two strategies designed to improve recall when the net is partially connected or the input cues are noisy are shown to provide significantly greater capacity and information efficiency under these conditions. Estimates are made for the capacity of nets that are the size of the CA3 region of the rat hippocampus. These indicate that thousands of patterns can be stored, with the exact number highly dependent on pattern coding rates and the recall strategy. Analysis of nets with different types of structure shows that the capacity is much more sensitive to net size than to connectivity level. This has implications for neurobiology where there are examples of environmentally produced changes in both the size and connectivity of various brain regions.
引用
收藏
页码:35 / 54
页数:20
相关论文
共 27 条
[1]  
AMARAL DG, 1990, PROG BRAIN RES, V83, P1
[2]   DYNAMICS OF THE CA3 PYRAMIDAL NEURON AUTOASSOCIATIVE MEMORY NETWORK IN THE HIPPOCAMPUS [J].
BENNETT, MR ;
GIBSON, WG ;
ROBINSON, J .
PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES, 1994, 343 (1304) :167-187
[3]   ON THE NUMBERS OF NEURONS IN FIELDS CA1 AND CA3 OF THE HIPPOCAMPUS OF SPRAGUE-DAWLEY AND WISTAR RATS [J].
BOSS, BD ;
TURLEJSKI, K ;
STANFIELD, BB ;
COWAN, WM .
BRAIN RESEARCH, 1987, 406 (1-2) :280-287
[4]   ON SETTING UNIT THRESHOLDS IN AN INCOMPLETELY CONNECTED ASSOCIATIVE NET [J].
BUCKINGHAM, J ;
WILLSHAW, D .
NETWORK-COMPUTATION IN NEURAL SYSTEMS, 1993, 4 (04) :441-459
[5]   PERFORMANCE-CHARACTERISTICS OF THE ASSOCIATIVE NET [J].
BUCKINGHAM, J ;
WILLSHAW, D .
NETWORK-COMPUTATION IN NEURAL SYSTEMS, 1992, 3 (04) :407-414
[6]  
Buckingham J., 1991, THESIS U EDINBURGH
[7]  
BUDINICH M, 1997, IN PRESS INT J NEURA
[8]   TRANSIENT AND ENDURING MORPHOLOGICAL CORRELATES OF SYNAPTIC ACTIVITY AND EFFICACY CHANGE IN THE RAT HIPPOCAMPAL SLICE [J].
CHANG, FLF ;
GREENOUGH, WT .
BRAIN RESEARCH, 1984, 309 (01) :35-46
[9]   HIPPOCAMPAL GROWTH AND ATTRITION IN BIRDS AFFECTED BY EXPERIENCE [J].
CLAYTON, NS ;
KREBS, JR .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 1994, 91 (16) :7410-7414
[10]   INFORMATIONAL CHARACTERISTICS OF NEURAL NETWORKS CAPABLE OF ASSOCIATIVE LEARNING BASED ON HEBBIAN PLASTICITY [J].
FROLOV, AA ;
MURAVEV, IP .
NETWORK-COMPUTATION IN NEURAL SYSTEMS, 1993, 4 (04) :495-536