Bayes classification based on minimum bounding spheres

被引:17
作者
Wang, Jigang [1 ]
Neskovic, Predrag [1 ]
Cooper, Leon N. [1 ]
机构
[1] Brown Univ, Inst Brain & Neural Syst, Dept Phys, Providence, RI 02912 USA
关键词
pattern classification; Bayes decision rule; minimum bounding spheres; support vector machines; kernel methods;
D O I
10.1016/j.neucom.2006.10.023
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The minimum bounding sphere of a set of data, defined as the smallest sphere enclosing the data, was first used by Scholkopf et al. to estimate the VC-dimension of support vector classifiers and later applied by Tax and Duin to data domain description. Given a set of data, the minimum bounding sphere of each class can be computed by solving a quadratic programming problem. Since the spheres are constructed for each class separately, they can be used to deal with the multi-class classification problem easily, as proposed by Zhu et al. In this paper, we show that the decision rule proposed by Zhu et al. is generally insufficient to achieve the state-of-the-art classification performance. We, therefore, propose a new decision rule based on the Bayes decision theory. This new decision rule significantly improves the performance of the resulting sphere-based classifier. In addition to its low computational complexity and easy expandability to multi-class problems, the new classifier achieves comparable performance to the standard support vector machines on most of the realworld data sets being tested. (c) 2006 Elsevier B.V. All rights reserved.
引用
收藏
页码:801 / 808
页数:8
相关论文
共 17 条
[1]  
[Anonymous], 1982, ESTIMATION DEPENDENC
[2]  
Blake C.L., 1998, UCI repository of machine learning databases
[3]  
Boser B. E., 1992, Proceedings of the Fifth Annual ACM Workshop on Computational Learning Theory, P144, DOI 10.1145/130385.130401
[4]  
BOTTOU L, 1994, INT C PATT RECOG, P77, DOI 10.1109/ICPR.1994.576879
[5]  
CORTES C, 1995, MACH LEARN, V20, P273, DOI 10.1023/A:1022627411411
[6]  
Duda R. O., 1973, Pattern Classification
[7]  
HUANG SY, KERNEL FISHERES DISC
[8]  
Joachims T, 1999, ADVANCES IN KERNEL METHODS, P169
[9]  
Kressel UHG, 1999, ADVANCES IN KERNEL METHODS, P255
[10]  
OSUNA E, 1996, AIM1602 MIT AI LAB