Generalized multiscale radial basis function networks

被引:98
作者
Billings, Stephen A. [1 ]
Wei, Hua-Liang [1 ]
Balikhin, Michael A. [1 ]
机构
[1] Univ Sheffield, Dept Automat Control & Syst Engn, Sheffield S1 3JD, S Yorkshire, England
基金
英国工程与自然科学研究理事会;
关键词
model term selection; neural networks; nonlinear system identification; orthogonal least squares; radial basis functions;
D O I
10.1016/j.neunet.2007.09.017
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A novel modelling framework is proposed for constructing parsimonious and flexible multiscale radial basis function networks (RBF). Unlike a conventional standard single scale RBF network, where all the basis functions have a common kernel width, the new network structure adopts multiscale Gaussian functions as the bases, where each selected centre has multiple kernel widths, to provide more flexible representations with better generalization properties for general nonlinear dynamical systems. As a direct extension of the traditional single scale Gaussian networks, the new multiscale network is easy to implement and is quick to learn using standard learning algorithms. A k-means clustering algorithm and an improved orthogonal least squares (OLS) algorithm are used to determine the unknown paramenters in the network model including the centres and widths of the basis functions, and the weights between the basis functions. It is demonstrated that the new network can lead to a parsimonious model with much better generalization property compared with the traditional single width RBF networks. (c) 2007 Elsevier Ltd. All rights reserved.
引用
收藏
页码:1081 / 1094
页数:14
相关论文
共 53 条
[11]   Sparse mzodeling using orthogonal forward regression with PRESS statistic and regularization [J].
Chen, S ;
Hong, X ;
Harris, CJ ;
Sharkey, PM .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2004, 34 (02) :898-911
[12]   ORTHOGONAL LEAST-SQUARES LEARNING ALGORITHM FOR RADIAL BASIS FUNCTION NETWORKS [J].
CHEN, S ;
COWAN, CFN ;
GRANT, PM .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1991, 2 (02) :302-309
[13]   NONLINEAR TIME-SERIES MODELING AND PREDICTION USING GAUSSIAN RBF NETWORKS [J].
CHEN, S .
ELECTRONICS LETTERS, 1995, 31 (02) :117-118
[14]  
CHEN S, 1992, INT J CONTROL, V56, P319, DOI [10.1080/00207179208934317, 10.1080/00207179008934126]
[15]   OPTIMAL ADAPTIVE K-MEANS ALGORITHM WITH DYNAMIC ADJUSTMENT OF LEARNING RATE [J].
CHINRUNGRUENG, C ;
SEQUIN, CH .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1995, 6 (01) :157-169
[16]  
Chui C. K., 1992, INTRO WAVELETS
[17]  
Daubechies I., 1992, 10 LECT WAVELETS, DOI [10.1137/1.9781611970104, DOI 10.1137/1.9781611970104.CH2]
[18]   DISCORDANT IDENTIFICATION IN CRITICAL INCIDENT STRESS [J].
DAVIS, RH .
JOURNAL OF RELIGION & HEALTH, 1994, 33 (01) :7-15
[19]   Multiobjective evolutionary optimization of the size, shape, and position parameters of radial basis function networks for function approximation [J].
González, J ;
Rojas, I ;
Ortega, J ;
Pomares, H ;
Fernández, J ;
Díaz, AF .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2003, 14 (06) :1478-1495
[20]   Predicting the Future: Advantages of Semilocal Units [J].
Hartman, Eric ;
Keeler, James D. .
NEURAL COMPUTATION, 1991, 3 (04) :566-578