RECURRENT NEURAL-NETWORK TRAINING WITH FEEDFORWARD COMPLEXITY

被引:24
作者
OLUROTIMI, O [1 ]
机构
[1] GEORGE MASON UNIV,CTR C3I,FAIRFAX,VA 22030
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 1994年 / 5卷 / 02期
基金
美国国家科学基金会;
关键词
D O I
10.1109/72.279184
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a training method that is of no more than feedforward complexity for fully recurrent networks. The method is not approximate, but rather depends on an exact transformation that reveals an embedded feedforward structure in every recurrent network. It turns out that given any unambiguous training data set, such as samples of the state variables and their derivatives, we need only to train this embedded feedforward structure. The necessary recurrent network parameters are then obtained by an inverse transformation that consists only of linear operators. As an example of modeling a representative nonlinear dynamical system, the method is applied to learn Bessel's differential equation, thereby generating Bessel functions within, as well as outside the training set.
引用
收藏
页码:185 / 197
页数:13
相关论文
共 31 条
[1]  
BANKS SP, 1988, MATH THEORIES NONLIN
[2]  
Barhen J., 1990, ADV NEURAL INFORMATI, V2, P498
[3]  
BARHEN J, APPLIED MATH LETT, V3, P13
[4]   What Size Net Gives Valid Generalization? [J].
Baum, Eric B. ;
Haussler, David .
NEURAL COMPUTATION, 1989, 1 (01) :151-160
[5]   APPROXIMATION OF A FUNCTION AND ITS DERIVATIVE WITH A NEURAL NETWORK [J].
CARDALIAGUET, P ;
EUVRARD, G .
NEURAL NETWORKS, 1992, 5 (02) :207-220
[6]  
CHEN CT, 1989, SYSTEM SIGNAL ANAL
[7]   ON LEARNING THE DERIVATIVES OF AN UNKNOWN MAPPING WITH MULTILAYER FEEDFORWARD NETWORKS [J].
GALLANT, AR ;
WHITE, H .
NEURAL NETWORKS, 1992, 5 (01) :129-138
[8]   LEARNING AND EXTRACTING FINITE STATE AUTOMATA WITH 2ND-ORDER RECURRENT NEURAL NETWORKS [J].
GILES, CL ;
MILLER, CB ;
CHEN, D ;
CHEN, HH ;
SUN, GZ ;
LEE, YC .
NEURAL COMPUTATION, 1992, 4 (03) :393-405
[9]  
GILES CL, 1990, ADV NEURAL INFORM PR, V0002, P00380
[10]   NONLINEAR NEURAL NETWORKS - PRINCIPLES, MECHANISMS, AND ARCHITECTURES [J].
GROSSBERG, S .
NEURAL NETWORKS, 1988, 1 (01) :17-61