Nonlinear regression using RBFN with linear submodels

被引:33
作者
Choi, SW
Lee, DW
Park, JH
Lee, IB
机构
[1] Pohang Univ Sci & Technol, Sch Environm Sci & Engn, Pohang 790784, South Korea
[2] Pohang Univ Sci & Technol, Dept Chem Engn, Pohang 790784, South Korea
[3] P&I Consulting Co Ltd, Pohang 790784, South Korea
关键词
radial basis function network; extended RBFN; hybrid learning method; cluster-merging K-means clustering; function approximation;
D O I
10.1016/S0169-7439(02)00109-0
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Radial basis function networks (RBFNs) have been widely used for function approximation and pattern classification as an alternative to conventional artificial neural networks. In this paper, RBFN with local linear functions is developed and applied to mapping nonlinear functions and modeling air pollutant emission. This extended version of the traditional RBFN has a linear function of inputs as a connecting weight, which is functionally equivalent to the first-order Sugeno fuzzy model. There are three kinds of parameters determined through proper training algorithms: the centers and spreads of each radial basis function, and the connection weights. The extended RBFN (ERBFN) is trained by a hybrid learning algorithm, which uses an iterative nonlinear optimization technique to obtain the center and spread of each radial basis function and the least squares method to obtain the connection weights. To avoid capturing a local optimum, the nonlinear parameters are initialized using a modified K-means clustering method, which has cluster-merging characteristic so as to automatically determine the number of basis functions. The proposed ERBFN method was applied to the approximation of three different functional forms and to the modeling of a real process. The results confirm that the proposed methodology gives considerably better performance and shows faster learning in comparison to previous methods. (C) 2002 Elsevier Science B.V. All rights reserved.
引用
收藏
页码:191 / 208
页数:18
相关论文
共 28 条
[1]  
Broomhead D. S., 1988, Complex Systems, V2, P321
[2]   ORTHOGONAL LEAST-SQUARES LEARNING ALGORITHM FOR RADIAL BASIS FUNCTION NETWORKS [J].
CHEN, S ;
COWAN, CFN ;
GRANT, PM .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1991, 2 (02) :302-309
[3]   GEOMETRICAL AND STATISTICAL PROPERTIES OF SYSTEMS OF LINEAR INEQUALITIES WITH APPLICATIONS IN PATTERN RECOGNITION [J].
COVER, TM .
IEEE TRANSACTIONS ON ELECTRONIC COMPUTERS, 1965, EC14 (03) :326-&
[4]  
Golub G.H., 2013, MATRIX COMPUTATIONS
[5]  
Haykin S., 1999, NEURAL NETWORK COMPR
[6]   Applications of artificial neural networks in chemical engineering [J].
Himmelblau, DM .
KOREAN JOURNAL OF CHEMICAL ENGINEERING, 2000, 17 (04) :373-392
[7]   Extending the functional equivalence of radial basis function networks and fuzzy inference systems [J].
Hunt, KJ ;
Haas, R ;
MurraySmith, R .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1996, 7 (03) :776-781
[8]  
Jang J.-S.R., 1997, NEUROFUZZY SOFT COMP
[9]   FUNCTIONAL EQUIVALENCE BETWEEN RADIAL BASIS FUNCTION NETWORKS AND FUZZY INFERENCE SYSTEMS [J].
JANG, JSR ;
SUN, CT .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1993, 4 (01) :156-159
[10]  
Johansen T. A., 1992, Proceedings of the 1992 American Control Conference (IEEE Cat. No.92CH3072-6), P3037