The evidence framework applied to support vector machines

被引:110
作者
Kwok, JTY [1 ]
机构
[1] Hong Kong Baptist Univ, Dept Comp Sci, Hong Kong, Peoples R China
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2000年 / 11卷 / 05期
关键词
Bayesian inference; evidence framework; support vector machine (SVM);
D O I
10.1109/72.870047
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we show that training of the support vector machine (SVM) can be interpreted as performing the level 1 inference of MacKay's evidence framework. We further on show that levels 2 and 3 of the evidence framework can also be applied to SVMs. This integration allows automatic adjustment of the regularization parameter and the kernel parameter to their near-optimal values, Moreover, it opens up a wealth of Bayesian tools for use with SVMs. Performance of this method is evaluated on both synthetic and real-world data sets.
引用
收藏
页码:1162 / 1173
页数:12
相关论文
共 21 条
[1]  
BERGER JO, 1985, SER SPRINGER SERIES
[2]  
Bishop C. M., 1995, NEURAL NETWORKS PATT
[3]  
BLAKE C, 1998, UCI REPOSITORY MACH
[4]  
Buntine W. L., 1991, Complex Systems, V5, P603
[5]   A tutorial on Support Vector Machines for pattern recognition [J].
Burges, CJC .
DATA MINING AND KNOWLEDGE DISCOVERY, 1998, 2 (02) :121-167
[6]  
CORTES C, 1995, MACH LEARN, V20, P273, DOI 10.1023/A:1022627411411
[7]   Moderating the outputs of support vector machine classifiers [J].
Kwok, JTY .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1999, 10 (05) :1018-1031
[8]  
Kwok JTY, 1998, ICONIP'98: THE FIFTH INTERNATIONAL CONFERENCE ON NEURAL INFORMATION PROCESSING JOINTLY WITH JNNS'98: THE 1998 ANNUAL CONFERENCE OF THE JAPANESE NEURAL NETWORK SOCIETY - PROCEEDINGS, VOLS 1-3, P347
[9]  
KWOK TY, 1996, P INT C ART NEUR NET, P557, DOI DOI 10.1007/3-540-61510-5_95
[10]   THE EVIDENCE FRAMEWORK APPLIED TO CLASSIFICATION NETWORKS [J].
MACKAY, DJC .
NEURAL COMPUTATION, 1992, 4 (05) :720-736