Piecewise linear approximation applied to nonlinear function of a neural network

被引:132
作者
Amin, H [1 ]
Curtis, KM [1 ]
Hayes-Gill, BR [1 ]
机构
[1] Univ Nottingham, Dept Elect & Elect Engn, Nottingham NG7 2RD, England
来源
IEE PROCEEDINGS-CIRCUITS DEVICES AND SYSTEMS | 1997年 / 144卷 / 06期
关键词
nonlinear approximation; neural networks; Sigmoid function;
D O I
10.1049/ip-cds:19971587
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
An efficient piecewise linear approximation of a nonlinear function (PLAN) is proposed. This uses a simple digital gate design to perform a direct transformation from X to Y, where X is the input and Y is the approximated sigmoidal output. This PLAN is then used within the outputs of an artificial neural network to perform the nonlinear approximation. :The comparison of this technique with two other sigmoidal approximation techniques for digital circuits is presented and the results show that the fast and compact digital circuit proposed produces the closest approximation to the sigmoid function. The hardware implementation of PLAN has been verified by a VHDL simulation with Mentor Graphics running under the UNIX operating system.
引用
收藏
页码:313 / 317
页数:5
相关论文
共 8 条
[1]  
Fahlman S.E., 1988, An Empirical Study of Learning Speed in Back-Propagation Networks
[2]   Progress in supervised neural networks [J].
Hush, Don R. ;
Horne, Bill G. .
IEEE SIGNAL PROCESSING MAGAZINE, 1993, 10 (01) :8-39
[3]  
Lippmann R. P., 1988, Computer Architecture News, V16, P7, DOI [10.1109/MASSP.1987.1165576, 10.1145/44571.44572]
[4]  
LIPSETT R, 1989, VHDL HARDWARE DESCRI
[5]  
MAYERS DJ, 1989, ELECTRON LETT, V25, P1661
[6]   USING AND DESIGNING MASSIVELY PARALLEL COMPUTERS FOR ARTIFICIAL NEURAL NETWORKS [J].
NORDSTROM, T ;
SVENSSON, B .
JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 1992, 14 (03) :260-285
[7]  
Rumelhart D.E., 1987, Parallel Distributed Processing: Explorations in the Microstructure of Cognition, P318
[8]   IMPLEMENTING NONLINEAR ACTIVATION FUNCTIONS IN NEURAL NETWORK EMULATORS [J].
SAMMUT, KM ;
JONES, SR .
ELECTRONICS LETTERS, 1991, 27 (12) :1037-1038