Effective neuronal learning with ineffective Hebbian learning rules

被引:15
作者
Chechik, G [1 ]
Meilijson, I
Ruppin, E
机构
[1] Hebrew Univ Jerusalem, Ctr Neural Computat, Jerusalem, Israel
[2] Tel Aviv Univ, Sch Math Sci, IL-69978 Tel Aviv, Israel
[3] Tel Aviv Univ, Sch Med, IL-69978 Tel Aviv, Israel
关键词
D O I
10.1162/089976601300014367
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this article we revisit the classical neuroscience paradigm of Hebbian learning. We find that it is difficult to achieve effective associative memory storage by Hebbian synaptic learning, since it requires network-level information at the synaptic level or sparse coding level. Effective learning can yet be achieved even with nonsparse patterns by a neuronal process that maintains a zero sum of the incoming synaptic efficacies. This weight correction improves the memory capacity of associative networks from an essentially bounded one to a memory capacity that scales linearly with network size. It also enables the effective storage of patterns with multiple levels of activity within a single network. Such neuronal weight correction can be successfully carried out by activity-dependent homeostasis of the neuron's synaptic efficacies, which was recently observed in cortical tissue. Thus, our findings suggest that associative learning by Hebbian synaptic learning should be accompanied by continuous remodeling of neuronally driven regulatory processes in the brain.
引用
收藏
页码:817 / 840
页数:24
相关论文
共 27 条
[1]  
Amit DJ, 1989, MODELING BRAIN FUNCT, DOI DOI 10.1017/CBO9780511623257
[2]   Long-term depression in hippocampus [J].
Bear, MF ;
Abraham, WC .
ANNUAL REVIEW OF NEUROSCIENCE, 1996, 19 :437-462
[3]   Synaptic modifications in cultured hippocampal neurons: Dependence on spike timing, synaptic strength, and postsynaptic cell type [J].
Bi, GQ ;
Poo, MM .
JOURNAL OF NEUROSCIENCE, 1998, 18 (24) :10464-10472
[4]   A SYNAPTIC MODEL OF MEMORY - LONG-TERM POTENTIATION IN THE HIPPOCAMPUS [J].
BLISS, TVP ;
COLLINGRIDGE, GL .
NATURE, 1993, 361 (6407) :31-39
[5]   Neuronal regulation: A mechanism for synaptic pruning during brain maturation [J].
Chechik, G ;
Meilijson, I ;
Ruppin, E .
NEURAL COMPUTATION, 1999, 11 (08) :2061-2080
[6]   Synaptic pruning in development: A computational account [J].
Chechik, G ;
Meilijson, I ;
Ruppin, E .
NEURAL COMPUTATION, 1998, 10 (07) :1759-1777
[7]   OPTIMIZING SYNAPTIC LEARNING RULES IN LINEAR ASSOCIATIVE MEMORIES [J].
DAYAN, P ;
WILLSHAW, DJ .
BIOLOGICAL CYBERNETICS, 1991, 65 (04) :253-265
[8]   THE ROLE OF WEIGHT NORMALIZATION IN COMPETITIVE LEARNING [J].
GOODHILL, GJ ;
BARROW, HG .
NEURAL COMPUTATION, 1994, 6 (02) :255-269
[9]   Synaptic runaway in associative networks and the pathogenesis of schizophrenia [J].
Greenstein-Messica, A ;
Ruppin, E .
NEURAL COMPUTATION, 1998, 10 (02) :451-465
[10]   Memory maintenance via neuronal regulation [J].
Horn, D ;
Levy, N ;
Ruppin, E .
NEURAL COMPUTATION, 1998, 10 (01) :1-18