Generalized multiscale radial basis function networks

被引:98
作者
Billings, Stephen A. [1 ]
Wei, Hua-Liang [1 ]
Balikhin, Michael A. [1 ]
机构
[1] Univ Sheffield, Dept Automat Control & Syst Engn, Sheffield S1 3JD, S Yorkshire, England
基金
英国工程与自然科学研究理事会;
关键词
model term selection; neural networks; nonlinear system identification; orthogonal least squares; radial basis functions;
D O I
10.1016/j.neunet.2007.09.017
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A novel modelling framework is proposed for constructing parsimonious and flexible multiscale radial basis function networks (RBF). Unlike a conventional standard single scale RBF network, where all the basis functions have a common kernel width, the new network structure adopts multiscale Gaussian functions as the bases, where each selected centre has multiple kernel widths, to provide more flexible representations with better generalization properties for general nonlinear dynamical systems. As a direct extension of the traditional single scale Gaussian networks, the new multiscale network is easy to implement and is quick to learn using standard learning algorithms. A k-means clustering algorithm and an improved orthogonal least squares (OLS) algorithm are used to determine the unknown paramenters in the network model including the centres and widths of the basis functions, and the weights between the basis functions. It is demonstrated that the new network can lead to a parsimonious model with much better generalization property compared with the traditional single width RBF networks. (c) 2007 Elsevier Ltd. All rights reserved.
引用
收藏
页码:1081 / 1094
页数:14
相关论文
共 53 条
[1]  
[Anonymous], ADV NEURAL INFORMATI
[2]  
[Anonymous], 2001, PATTERN RECOGNITION
[3]   On the kernel widths in radial-basis function networks [J].
Benoudjit, N ;
Verleysen, M .
NEURAL PROCESSING LETTERS, 2003, 18 (02) :139-154
[4]  
Billings S., 1996, The determination of multivariable nonlinear models for dynamic systems using neural networks
[5]   RECURRENT RADIAL BASIS FUNCTION NETWORKS FOR ADAPTIVE NOISE CANCELLATION [J].
BILLINGS, SA ;
FUNG, CF .
NEURAL NETWORKS, 1995, 8 (02) :273-290
[6]   IDENTIFICATION OF MIMO NON-LINEAR SYSTEMS USING A FORWARD-REGRESSION ORTHOGONAL ESTIMATOR [J].
BILLINGS, SA ;
CHEN, S ;
KORENBERG, MJ .
INTERNATIONAL JOURNAL OF CONTROL, 1989, 49 (06) :2157-2189
[7]   RADIAL BASIS FUNCTION NETWORK CONFIGURATION USING GENETIC ALGORITHMS [J].
BILLINGS, SA ;
ZHENG, GL .
NEURAL NETWORKS, 1995, 8 (06) :877-890
[8]  
BROOMHEAD DS, 1988, COMPLEX SYSTEMS, V2, P3221
[9]   PRACTICAL IDENTIFICATION OF NARMAX MODELS USING RADIAL BASIS FUNCTIONS [J].
CHEN, S ;
BILLINGS, SA ;
COWAN, CFN ;
GRANT, PM .
INTERNATIONAL JOURNAL OF CONTROL, 1990, 52 (06) :1327-1350
[10]   ORTHOGONAL LEAST-SQUARES METHODS AND THEIR APPLICATION TO NON-LINEAR SYSTEM-IDENTIFICATION [J].
CHEN, S ;
BILLINGS, SA ;
LUO, W .
INTERNATIONAL JOURNAL OF CONTROL, 1989, 50 (05) :1873-1896