NEURAL NETWORKS AND NONLINEAR ADAPTIVE FILTERING - UNIFYING CONCEPTS AND NEW ALGORITHMS

被引:103
作者
NERRAND, O [1 ]
ROUSSELRAGOT, P [1 ]
PERSONNAZ, L [1 ]
DREYFUS, G [1 ]
MARCOS, S [1 ]
机构
[1] ECOLE SUPER ELECT,SIGNAUX & SYST LAB,F-91192 GIF SUR YVETTE,FRANCE
关键词
D O I
10.1162/neco.1993.5.2.165
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The paper proposes a general framework that encompasses the training of neural networks and the adaptation of filters. We show that neural networks can be considered as general nonlinear filters that can be trained adaptively, that is, that can undergo continual training with a possibly infinite number of time-ordered examples. We introduce the canonical form of a neural network. This canonical form permits a unified presentation of network architectures and of gradient-based training algorithms for both feedforward networks (transversal filters) and feedback networks (recursive filters). We show that several algorithms used classically in linear adaptive filtering, and some algorithms suggested by other authors for training neural networks, are special cases in a general classification of training algorithms for feedback networks.
引用
收藏
页码:165 / 199
页数:35
相关论文
共 35 条
[1]  
APPLEBAUM SP, 1976, IEEE T ANTENN PROPAG, V24, P650, DOI 10.1109/TAP.1976.1141416
[2]  
BELLANGER MG, 1987, ADAPTIVE DIGITAL FIL
[3]   REPRESENTATIONS OF NON-LINEAR SYSTEMS - THE NARMAX MODEL [J].
CHEN, S ;
BILLINGS, SA .
INTERNATIONAL JOURNAL OF CONTROL, 1989, 49 (03) :1013-1032
[4]   ADAPTIVE EQUALIZATION OF FINITE NONLINEAR CHANNELS USING MULTILAYER PERCEPTRONS [J].
CHEN, S ;
GIBSON, GJ ;
COWAN, CFN ;
GRANT, PM .
SIGNAL PROCESSING, 1990, 20 (02) :107-119
[5]  
DREYFUS G, 1992, NEURAL NETWORKS SIGN, V2, P550
[6]   FINDING STRUCTURE IN TIME [J].
ELMAN, JL .
COGNITIVE SCIENCE, 1990, 14 (02) :179-211
[7]  
FALLSIDE F, 1990, NEUROCOMPUTING ALGOR, P265
[8]  
Haykin S., 1991, ADAPTIVE FILTER THEO
[9]   NEURAL NETWORKS AND PHYSICAL SYSTEMS WITH EMERGENT COLLECTIVE COMPUTATIONAL ABILITIES [J].
HOPFIELD, JJ .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA-BIOLOGICAL SCIENCES, 1982, 79 (08) :2554-2558
[10]   MULTILAYER FEEDFORWARD NETWORKS ARE UNIVERSAL APPROXIMATORS [J].
HORNIK, K ;
STINCHCOMBE, M ;
WHITE, H .
NEURAL NETWORKS, 1989, 2 (05) :359-366