A new class of wavelet networks for nonlinear system identification

被引:284
作者
Billings, SA [1 ]
Wei, HL [1 ]
机构
[1] Univ Sheffield, Dept Automat Control & Syst Engn, Sheffield SJ 3JD, S Yorkshire, England
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2005年 / 16卷 / 04期
基金
英国工程与自然科学研究理事会;
关键词
nonlinear autoregressive with exogenous inputs (NARX) models; nonlinear system identification; orthogonal least squares (OLS); wavelet networks (WNs);
D O I
10.1109/TNN.2005.849842
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A new class of wavelet networks (WNs) is proposed for nonlinear system identification. In the new networks, the model structure for a high-dimensional system is chosen to be a superimposition of a number of functions with fewer variables. By expanding each function using truncated wavelet decompositions, the multivariate nonlinear networks can be converted into linear-in-the-parameter regressions, which can be solved using least-squares type methods. An efficient model term selection approach based upon a forward orthogonal least squares (OLS) algorithm and the error reduction ratio (ERR) is applied to solve the linear-in-the-parameters problem in the present study. The main advantage of the new WN is that it exploits the attractive features of multiscale wavelet decompositions and the capability of traditional neural networks. By adopting the analysis of variance (ANOVA) expansion, WNs can now handle nonlinear identification problems in high dimensions.
引用
收藏
页码:862 / 874
页数:13
相关论文
共 60 条
[31]   Nonlinear model structure detection using optimum experimental design and orthogonal least squares [J].
Hong, X ;
Harris, CJ .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2001, 12 (02) :435-439
[32]   On the construction and training of reformulated radial basis function neural networks [J].
Karayiannis, NB ;
Randolph-Gips, MM .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2003, 14 (04) :835-846
[33]   INPUT OUTPUT PARAMETRIC MODELS FOR NON-LINEAR SYSTEMS .1. DETERMINISTIC NON-LINEAR SYSTEMS [J].
LEONTARITIS, IJ ;
BILLINGS, SA .
INTERNATIONAL JOURNAL OF CONTROL, 1985, 41 (02) :303-328
[34]   High dimensional model representations [J].
Li, GY ;
Rosenthal, C ;
Rabitz, H .
JOURNAL OF PHYSICAL CHEMISTRY A, 2001, 105 (33) :7765-7777
[35]   Learning long-term dependencies in NARX recurrent neural networks [J].
Lin, TN ;
Horne, BG ;
Tino, P ;
Giles, CL .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1996, 7 (06) :1329-1338
[36]   OSCILLATION AND CHAOS IN PHYSIOLOGICAL CONTROL-SYSTEMS [J].
MACKEY, MC ;
GLASS, L .
SCIENCE, 1977, 197 (4300) :287-288
[37]  
MALIAT SG, 1998, WAVELET TOUR SIGNAL
[38]   A THEORY FOR MULTIRESOLUTION SIGNAL DECOMPOSITION - THE WAVELET REPRESENTATION [J].
MALLAT, SG .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1989, 11 (07) :674-693
[39]  
Meyer Y., 1993, WAVELETS ALGORITHMS
[40]   GRADIENT METHODS FOR THE OPTIMIZATION OF DYNAMIC-SYSTEMS CONTAINING NEURAL NETWORKS [J].
NARENDRA, KS ;
PARTHASARATHY, K .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1991, 2 (02) :252-262