RBF neural network center selection based on Fisher ratio class separability measure

被引:93
作者
Mao, KZ [1 ]
机构
[1] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2002年 / 13卷 / 05期
关键词
center selection; Fisher's class separability measure; pattern classification; radial basis function (RBF) neural networks;
D O I
10.1109/TNN.2002.1031953
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
For classification applications, the role of hidden layer neurons of a radial basis function (RBF) neural network can be interpreted as a function which maps input patterns from a nonlinear separable space to a linear separable space. In the new space, the responses of the hidden layer neurons form new feature vectors. The discriminative power is then determined by RBF centers. In the present study, we propose to choose RBF centers based on Fisher ratio class separability measure with the objective of achieving maximum discriminative power. We implement this idea using a multistep procedure that combines Fisher ratio, an orthogonal transform, and a forward selection search method. Our motivation of employing the orthogonal transform is to decouple the correlations among the responses of the hidden layer neurons so that the class separability provided by individual RBF neurons can be evaluated independently. The strengths of our method are double fold. First, our method selects a parsimonious network architecture. Second, this method selects centers that provide large class separation.
引用
收藏
页码:1211 / 1217
页数:7
相关论文
共 24 条
[1]  
BAY SD, 1999, UCI KDD ARCH
[2]  
Blake C.L., 1998, UCI repository of machine learning databases
[3]   RECURSIVE HYBRID ALGORITHM FOR NONLINEAR-SYSTEM IDENTIFICATION USING RADIAL BASIS FUNCTION NETWORKS [J].
CHEN, S ;
BILLINGS, SA ;
GRANT, PM .
INTERNATIONAL JOURNAL OF CONTROL, 1992, 55 (05) :1051-1070
[4]   ORTHOGONAL LEAST-SQUARES LEARNING ALGORITHM FOR RADIAL BASIS FUNCTION NETWORKS [J].
CHEN, S ;
COWAN, CFN ;
GRANT, PM .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1991, 2 (02) :302-309
[5]   Combined genetic algorithm optimization and regularized orthogonal least squares learning for radial basis function networks [J].
Chen, S ;
Wu, Y ;
Luk, BL .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1999, 10 (05) :1239-1243
[6]   A nonlinear discriminant algorithm for feature extraction and data classification [J].
Cruz, CS ;
Dorronsoro, JR .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1998, 9 (06) :1370-1376
[7]  
Devijver P., 1982, PATTERN RECOGN
[8]  
Duda R. O., 2000, Pattern Classification and Scene Analysis, V2nd
[9]   RADIAL BASIS FUNCTION NEURAL-NETWORK FOR APPROXIMATION AND ESTIMATION OF NONLINEAR STOCHASTIC DYNAMIC-SYSTEMS [J].
ELANAYAR, S ;
SHIN, YC .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (04) :594-603
[10]  
GENNARI JH, 1992, ARTIF INTELL, V40, P11