Spike-timing-dependent learning in memristive nanodevices

被引:253
作者
Snider, Greg S. [1 ]
机构
[1] Hewlett Packard Labs, Informat & Quantum Syst Lab, Palo Alto, CA USA
来源
2008 IEEE INTERNATIONAL SYMPOSIUM ON NANOSCALE ARCHITECTURES | 2008年
关键词
adaptive systems; analog memories; learning systems; neural network hardware; nonlinear circuits;
D O I
10.1109/NANOARCH.2008.4585796
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The neuromorphic paradigm is attractive for nanoscale computation because of its massive parallelism, potential scalability, and inherent defect-, fault-, and failure-tolerance. We show how to implement timing-based learning laws, such as spike-timing-dependent plasticity (STDP), in simple, memristive nanodevices, such as those constructed from certain metal oxides. Such nano-scale "synapses" can be combined with CMOS "neurons" to create neuromorphic hardware several orders of magnitude denser than is possible in conventional CMOS. The key ideas are: (1) to factor out two synaptic state variables to pre- and post-synaptic neurons; and (2) to separate computational communication from learning by time-division multiplexing of pulse-width-modulated signals through synapses. This approach offers the advantages of: better control over power dissipation; fewer constraints on the design of memristive materials used for nanoscale synapses; greater freedom in learning algorithms since the synaptic learning dynamics can be dynamically turned on or off (e.g. by attentional priming mechanisms communicated extra-synaptically); greater control over the precise form and timing of the STDP equations; the ability to implement a variety of other learning laws besides STDP; better circuit diversity since the approach allows different learning laws to be implemented in different areas of a single chip using the same memristive material for all synapses.
引用
收藏
页码:85 / 92
页数:8
相关论文
共 22 条
[1]  
[Anonymous], 2007, NANOTECHNOLOGY
[2]  
[Anonymous], 1963, RELIABLE COMPUTATION
[3]  
Arthur J. V., 2006, Advances in neural information processing systems, P75
[4]  
BEIU V, P 15 IEEE INT C APPL
[5]  
Bi, 2001, ANNU REV NEUROSCI, V24, P139
[6]  
BOAHEN K, COMMUNICATION
[7]   Distributed ARTMAP: a neural network for fast distributed supervised learning [J].
Carpenter, GA ;
Milenova, BL ;
Noeske, BW .
NEURAL NETWORKS, 1998, 11 (05) :793-813
[8]   MEMRISTIVE DEVICES AND SYSTEMS [J].
CHUA, LO ;
KANG, SM .
PROCEEDINGS OF THE IEEE, 1976, 64 (02) :209-223
[9]   Nonlinear circuit foundations for nanodevices, part I: The four-element torus [J].
Chua, LO .
PROCEEDINGS OF THE IEEE, 2003, 91 (11) :1830-1859
[10]   Array-based architecture for FET-based, nanoscale electronics [J].
DeHon, A .
IEEE TRANSACTIONS ON NANOTECHNOLOGY, 2003, 2 (01) :23-32