Sensitivity analysis applied to the construction of radial basis function networks

被引:69
作者
Shi, D [1 ]
Yeung, DS
Gao, J
机构
[1] Nanyang Technol Univ, Sch Comp Engn, Singapore 639798, Singapore
[2] Hong Kong Polytech Univ, Dept Comp, Kowloon, Hong Kong, Peoples R China
[3] Univ New England, Sch Math Stat & Comp Sci, Armidale, NSW, Australia
关键词
sensitivity analysis; radial basis function neural network; orthogonal least square learning; network pruning;
D O I
10.1016/j.neunet.2005.02.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Conventionally, a radial basis function (RBF) network is constructed by obtaining cluster centers of basis function by maximum likelihood learning. This paper proposes a novel learning algorithm for the construction of radial basis function using sensitivity analysis. In training, the number of hidden neurons and the centers of their radial basis functions are determined by the maximization of the output's sensitivity to the training data. In classification, the minimal number of such hidden neurons with the maximal sensitivity will be the most generalizable to unknown data. Our experimental results show that our proposed sensitivity-based RBF classifier outperforms the conventional RBFs and is as accurate as support vector machine (SVM). Hence, sensitivity analysis is expected to be a new alternative way to the construction of RBF networks. (c) 2005 Elsevier Ltd. All rights reserved.
引用
收藏
页码:951 / 957
页数:7
相关论文
共 22 条
[1]   Improving the Generalization Properties of Radial Basis Function Neural Networks [J].
Bishop, Chris .
NEURAL COMPUTATION, 1991, 3 (04) :579-588
[2]  
Blake C.L., 1998, UCI repository of machine learning databases
[3]   ORTHOGONAL LEAST-SQUARES LEARNING ALGORITHM FOR RADIAL BASIS FUNCTION NETWORKS [J].
CHEN, S ;
COWAN, CFN ;
GRANT, PM .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1991, 2 (02) :302-309
[4]   A comparison of methods for multiclass support vector machines [J].
Hsu, CW ;
Lin, CJ .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2002, 13 (02) :415-425
[5]   RBF neural network center selection based on Fisher ratio class separability measure [J].
Mao, KZ .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2002, 13 (05) :1211-1217
[6]  
Michie D., 1994, Technometrics, V13, P1
[7]   Fast Learning in Networks of Locally-Tuned Processing Units [J].
Moody, John ;
Darken, Christian J. .
NEURAL COMPUTATION, 1989, 1 (02) :281-294
[8]   APPROXIMATION AND RADIAL-BASIS-FUNCTION NETWORKS [J].
PARK, J ;
SANDBERG, IW .
NEURAL COMPUTATION, 1993, 5 (02) :305-316
[9]   THE SELECTION OF WEIGHT ACCURACIES FOR MADALINES [J].
PICHE, SW .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1995, 6 (02) :432-445
[10]  
Quinlan J. R., 1993, C4 5 PROGRAMS MACHIN