Constructing boosting algorithms from SVMs:: An application to one-class classification

被引:152
作者
Rätsch, G
Mika, S
Schölkopf, B
Müller, KR
机构
[1] Australian Natl Univ, RSISE, Canberra, ACT 0200, Australia
[2] Fraunhofer FIRST, D-12489 Berlin, Germany
[3] Univ Potsdam, Dept Comp Sci, D-14482 Potsdam, Germany
[4] Max Planck Inst Biol Cybernet, D-72076 Tubingen, Germany
关键词
boosting; SVMs; one-class classification; unsupervised learning; novelty detection;
D O I
10.1109/TPAMI.2002.1033211
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We show via an equivalence of mathematical programs that a support vector (SV) algorithm can be translated into an equivalent boosting-like algorithm and vice versa. We exemplify this translation procedure for a new algorithm-one-class leveraging-starting from the one-class support vector machine (1-SVIM). This is a first step toward unsupervised learning in a boosting framework. Building on so-called barrier methods known from the theory of constrained optimization, it returns a function, written as a convex combination of base hypotheses, that characterizes whether a given test point is likely to have been generated from the distribution underlying the training data. Simulations on one-class classification problems demonstrate the usefulness of our approach.
引用
收藏
页码:1184 / 1199
页数:16
相关论文
共 65 条
[1]  
[Anonymous], 1998, Encyclopedia of Biostatistics
[2]   An empirical comparison of voting classification algorithms: Bagging, boosting, and variants [J].
Bauer, E ;
Kohavi, R .
MACHINE LEARNING, 1999, 36 (1-2) :105-139
[3]  
BENNETT KP, 1992, OPTIMIZATION METHODS, V1, P23, DOI DOI 10.1080/10556789208805504
[4]  
Bishop C. M., 1995, NEURAL NETWORKS PATT
[5]  
Boser B. E., 1992, Proceedings of the Fifth Annual ACM Workshop on Computational Learning Theory, P144, DOI 10.1145/130385.130401
[6]   Parsimonious least norm approximation [J].
Bradley, PS ;
Mangasarian, OL ;
Rosen, JB .
COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 1998, 11 (01) :5-21
[7]  
Bregman LM, 1967, USSR Computational Mathematics and Mathematical Physics, V7, P200
[8]   Prediction games and arcing algorithms [J].
Breiman, L .
NEURAL COMPUTATION, 1999, 11 (07) :1493-1517
[9]   A tutorial on Support Vector Machines for pattern recognition [J].
Burges, CJC .
DATA MINING AND KNOWLEDGE DISCOVERY, 1998, 2 (02) :121-167
[10]  
Campbell C, 2001, ADV NEUR IN, V13, P395