LEARNING PROBABILISTIC RAM NETS USING VLSI STRUCTURES

被引:28
作者
CLARKSON, TG
GORSE, D
TAYLOR, JG
NG, CK
机构
[1] UNIV LONDON KINGS COLL,DEPT MATH,LONDON WC2R 2LS,ENGLAND
[2] UNIV LONDON UNIV COLL,DEPT COMP SCI,LONDON WC1E 6BT,ENGLAND
关键词
LEARNING; NEURAL NETWORKS; PROBABILISTIC RAM NEURON; REINFORCEMENT TRAINING; VLSI;
D O I
10.1109/12.214663
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Probabilistic RAM's (pRAM's) have recently been developed which use local reinforcement rules utilizing synaptic rather than threshold noise in the stochastic search procedure. Hardware-realizable learning pRAM's are described which implement these rules. The design of a pRAM neuron with a reinforcement learning capability is presented. This allows for both global and local rewards and penalties (in this latter case implementing a modified version of back-propagation). The architecture described allows for serial updating of the ''weights'' of a pRAM net according to a reward/penalty learning rule. It is possible to generate a new set of pRAM outputs at least every 100 mus which is faster than the response time of biological neurons.
引用
收藏
页码:1552 / 1561
页数:10
相关论文
共 31 条
[1]  
ALLA PY, 1991, VLSI DESIGN NEURAL N, P174
[2]  
[Anonymous], 1966, NERVE MUSCLE SYNAPSE
[3]   NEURONLIKE ADAPTIVE ELEMENTS THAT CAN SOLVE DIFFICULT LEARNING CONTROL-PROBLEMS [J].
BARTO, AG ;
SUTTON, RS ;
ANDERSON, CW .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1983, 13 (05) :834-846
[4]   LANDMARK LEARNING - AN ILLUSTRATION OF ASSOCIATIVE SEARCH [J].
BARTO, AG ;
SUTTON, RS .
BIOLOGICAL CYBERNETICS, 1981, 42 (01) :1-8
[5]   PATTERN-RECOGNIZING STOCHASTIC LEARNING AUTOMATA [J].
BARTO, AG ;
ANANDAN, P .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1985, 15 (03) :360-375
[6]   RANDOM ITERATIVE NETWORKS [J].
BRESSLOFF, PC ;
TAYLOR, JG .
PHYSICAL REVIEW A, 1990, 41 (02) :1126-1137
[7]  
Clarkson T. G., 1992, J INTELLIGENT SYSTEM, V2, P11, DOI 10.1515/JISYS.1992.2.1-4.11
[8]  
CLARKSON TG, 1990, P IEEE INT WORKSHOP, P235
[9]  
CLARKSON TG, 1991, P ICANN 91, P1573
[10]  
CLARKSON TG, 1989, P 1 IEE C ART NEUR N, P242