Bayesian trigonometric support vector classifier

被引:17
作者
Chu, W [1 ]
Keerthi, SS [1 ]
Ong, CJ [1 ]
机构
[1] Natl Univ Singapore, Dept Mech Engn, Singapore 119260, Singapore
关键词
D O I
10.1162/089976603322297368
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This letter describes Bayesian techniques for support vector classification. In particular, we propose a novel differentiable loss function, called the trigonometric loss function, which has the desirable characteristic of natural normalization in the likelihood function, and then follow standard gaussian processes techniques to set up a Bayesian framework. In this framework, Bayesian inference is used to implement model adaptation, while keeping the merits of support vector classifier, such as sparseness and convex programming. This differs from standard gaussian processes for classification. Moreover, we put forward class probability in making predictions. Experimental results on benchmark data sets indicate the usefulness of this approach.
引用
收藏
页码:2227 / 2254
页数:28
相关论文
共 23 条
[11]   The evidence framework applied to support vector machines [J].
Kwok, JTY .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2000, 11 (05) :1162-1173
[12]   Ergodic, primal convergence in dual subgradient schemes for convex programming [J].
Larsson, T ;
Patriksson, M ;
Strömberg, AB .
MATHEMATICAL PROGRAMMING, 1999, 86 (02) :283-312
[13]  
MacKay D. J., 1996, MODELS NEURAL NETWOR, VIII, P211, DOI DOI 10.1007/978-1-4612-0723-8_6
[14]   A PRACTICAL BAYESIAN FRAMEWORK FOR BACKPROPAGATION NETWORKS [J].
MACKAY, DJC .
NEURAL COMPUTATION, 1992, 4 (03) :448-472
[15]  
Neal RadfordM., 1996, Priors for Infinite Networks
[16]  
Platt JC, 1999, ADVANCES IN KERNEL METHODS, P185
[17]  
Platt JC, 2000, ADV NEUR IN, P61
[18]   Soft margins for AdaBoost [J].
Rätsch, G ;
Onoda, T ;
Müller, KR .
MACHINE LEARNING, 2001, 42 (03) :287-320
[19]   Bayesian methods for support vector machines: Evidence and predictive class probabilities [J].
Sollich, P .
MACHINE LEARNING, 2002, 46 (1-3) :21-52
[20]  
Vanderbei R.J., 2001, LINEAR PROGRAMMING F