BACK-PROPAGATION LEARNING AND NONIDEALITIES IN ANALOG NEURAL NETWORK HARDWARE

被引:53
作者
FRYE, RC
RIETMAN, EA
WONG, CC
机构
[1] AT&T Bell Laboratories, Murray Hill
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 1991年 / 2卷 / 01期
关键词
D O I
10.1109/72.80296
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present experimental results of adaptive learning using an optically controlled neural network. We have used example problems in nonlinear system identification and signal prediction, two common areas of potential neural network application, to study the capabilities of analog neural hardware. These experiments investigate the effects of a variety of nonidealities typical of analog hardware systems. They show that networks using large arrays of nonuniform components can perform analog computations with a much higher degree of accuracy than might be expected, given the degree of variation in the network's elements. We have also investigated effects of other common nonidealities, such as noise, weight quantization, and dynamic range limitations.
引用
收藏
页码:110 / 117
页数:8
相关论文
共 13 条
[1]   2-DIMENSIONAL MAPPING WITH A STRANGE ATTRACTOR [J].
HENON, M .
COMMUNICATIONS IN MATHEMATICAL PHYSICS, 1976, 50 (01) :69-77
[2]   INCREASED RATES OF CONVERGENCE THROUGH LEARNING RATE ADAPTATION [J].
JACOBS, RA .
NEURAL NETWORKS, 1988, 1 (04) :295-307
[3]  
KORNFELD CD, 1988, 2ND IEEE INT C NEUR, V2, P357
[4]  
LAPEDES A, LAUR872662 LOS AL NA
[5]  
LECUN Y, 1986, NATO ASI SERIES F, V20
[6]  
McClelland J.L., 1986, PARALLEL DISTRIBUTED
[7]  
Oppenheim Alan V, 1975, DIGIT SIGNAL PROCESS
[8]  
RIETMAN EA, IN PRESS APPLIED OPT
[9]   LEARNING REPRESENTATIONS BY BACK-PROPAGATING ERRORS [J].
RUMELHART, DE ;
HINTON, GE ;
WILLIAMS, RJ .
NATURE, 1986, 323 (6088) :533-536
[10]  
SIVILOTTI MA, 1986, AIP C P, V151