Learning by message passing in networks of discrete synapses

被引:111
作者
Braunstein, A [1 ]
Zecchina, R [1 ]
机构
[1] Abdus Salaam Int Ctr Theoret Phys, I-34100 Trieste, Italy
关键词
D O I
10.1103/PhysRevLett.96.030201
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
We show that a message-passing process allows us to store in binary "material" synapses a number of random patterns which almost saturate the information theoretic bounds. We apply the learning algorithm to networks characterized by a wide range of different connection topologies and of size comparable with that of biological systems (e.g., n similar or equal to 10(5)-10(6)). The algorithm can be turned into an online-fault tolerant-learning protocol of potential interest in modeling aspects of synaptic plasticity and in building neuromorphic devices.
引用
收藏
页数:4
相关论文
共 40 条
[21]   STORAGE CAPACITY OF MEMORY NETWORKS WITH BINARY COUPLINGS [J].
KRAUTH, W ;
MEZARD, M .
JOURNAL DE PHYSIQUE, 1989, 50 (20) :3057-3066
[22]   Communication in neuronal networks [J].
Laughlin, SB ;
Sejnowski, TJ .
SCIENCE, 2003, 301 (5641) :1870-1874
[23]  
MacKay D. J. C., 2019, INFORM THEORY INFERE
[24]   THE SPACE OF INTERACTIONS IN NEURAL NETWORKS - GARDNER COMPUTATION WITH THE CAVITY METHOD [J].
MEZARD, M .
JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1989, 22 (12) :2181-2190
[25]   Random K-satisfiability problem:: From an analytic solution to an efficient algorithm -: art. no. 056126 [J].
Mézard, M ;
Zecchina, R .
PHYSICAL REVIEW E, 2002, 66 (05) :27-056126
[26]   Analytic and algorithmic solution of random satisfiability problems [J].
Mézard, M ;
Parisi, G ;
Zecchina, R .
SCIENCE, 2002, 297 (5582) :812-815
[27]  
MITCHISON GJ, 1989, BIOL CYBERN, V60, P345, DOI 10.1007/BF00204772
[28]   Entropy of the K-satisfiability problem [J].
Monasson, R ;
Zecchina, R .
PHYSICAL REVIEW LETTERS, 1996, 76 (21) :3881-3885
[29]   Coloring random graphs [J].
Mulet, R ;
Pagnani, A ;
Weigt, M ;
Zecchina, R .
PHYSICAL REVIEW LETTERS, 2002, 89 (26)
[30]   Thouless-Anderson-Palmer approach for lossy compression [J].
Murayama, T .
PHYSICAL REVIEW E, 2004, 69 (03) :035105-1