Reformulated radial basis neural networks trained by gradient descent

被引:187
作者
Karayiannis, NB [1 ]
机构
[1] Univ Houston, Dept Elect & Comp Engn, Houston, TX 77204 USA
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 1999年 / 10卷 / 03期
关键词
clustering; function approximation; generator function; gradient descent learning; learning vector quantization; radial basis function; radial basis neural networks; reformulation;
D O I
10.1109/72.761725
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents an axiomatic approach for constructing radial basis function (RBF) neural networks. This approach results in a broad variety of admissible RBF models, including those employing Gaussian RBF's, The form of the RBF's is determined by a generator function. New RBF models can be developed according to the proposed approach by selecting generator functions other than exponential ones, which lead to Gaussian RBF's, This paper also proposes a supervised learning algorithm based on gradient descent for training reformulated RBF neural networks constructed using the proposed approach. A sensitivity analysis of the proposed algorithm relates the properties of RBF's with the convergence of gradient descent learning, Experiments involving a variety of reformulated RBF networks generated by linear and exponential generator functions indicate that gradient descent learning is simple, easily implementable, acid produces RBF networks that perform considerably better than conventional RBF models trained by existing algorithms.
引用
收藏
页码:657 / 671
页数:15
相关论文
共 24 条
[1]  
ANDERSON E, 1939, B AM IRIS SOC, V59, P2
[2]  
[Anonymous], Pattern Recognition With Fuzzy Objective Function Algorithms
[3]   2 SOFT RELATIVES OF LEARNING VECTOR QUANTIZATION [J].
BEZDEK, JC ;
PAL, NR .
NEURAL NETWORKS, 1995, 8 (05) :729-743
[4]  
Broomhead D. S., 1988, Complex Systems, V2, P321
[5]  
Cybenko G., 1989, Mathematics of Control, Signals, and Systems, V2, P303, DOI 10.1007/BF02551274
[6]   OPTIMIZATION OF CLUSTERING CRITERIA BY REFORMULATION [J].
HATHAWAY, RJ ;
BEZDEK, JC .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 1995, 3 (02) :241-245
[7]  
Karayiannis N.B., 1993, ARTIFICIAL NEURAL NE
[8]  
Karayiannis NB, 1997, J INTELL FUZZY SYST, V5, P103
[9]   An integrated approach to fuzzy learning vector quantization and fuzzy c-means clustering [J].
Karayiannis, NB ;
Bezdek, JC .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 1997, 5 (04) :622-628
[10]  
Karayiannis NB, 1998, IEEE WORLD CONGRESS ON COMPUTATIONAL INTELLIGENCE, P2230, DOI 10.1109/IJCNN.1998.687207