A fast iterative nearest point algorithm for support vector machine classifier design

被引:231
作者
Keerthi, SS
Shevade, SK
Bhattacharyya, C
Murthy, KRK
机构
[1] Natl Univ Singapore, Dept Mech & Prod Engn, Singapore 119260, Singapore
[2] Indian Inst Sci, Dept Comp Sci & Automat, Bangalore 560012, Karnataka, India
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2000年 / 11卷 / 01期
关键词
classification; nearest point algorithm; quadratic programming; support vector machine;
D O I
10.1109/72.822516
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper we give a new fast iterative algorithm for support vector machine (SVM) classifier design. The basic problem treated is one that does not allow classification violations. The problem is converted to a problem of computing the nearest point between two convex polytopes. The suitability of two classical nearest point algorithms, due to Gilbert, and Mitchell ct at, is studied. Ideas from both these algorithms are combined and modified to derive our fast algorithm, For problems which require classification violations to be allowed, the violations are quadratically penalized and an idea due to Cortes and Vapnik and FrieB is used to convert it to a problem in which there are no classification violations, Comparative computational evaluation of our algorithm against powerful SVM methods such as Platt's sequential minimal optimization shows that our algorithm is very competitive.
引用
收藏
页码:124 / 136
页数:13
相关论文
共 25 条
[1]   THE ADATRON - AN ADAPTIVE PERCEPTRON ALGORITHM [J].
ANLAUF, JK ;
BIEHL, M .
EUROPHYSICS LETTERS, 1989, 10 (07) :687-692
[2]  
[Anonymous], 1982, ESTIMATION DEPENDENC
[3]  
[Anonymous], 1990, SUPPORT VECTOR LEARN
[4]  
[Anonymous], 1998, DATA MINING KNOWLEDG
[5]   AN EFFICIENT COMPUTATIONAL PROCEDURE FOR A GENERALIZED QUADRATIC PROGRAMMING PROBLEM [J].
BARR, RO .
SIAM JOURNAL ON CONTROL, 1969, 7 (03) :415-&
[6]  
BENNETT KP, 1992, OPTIMIZATION METHODS, V1, P23, DOI DOI 10.1080/10556789208805504
[7]  
BENNETT R, 1996, GEOMETRY LEARNING
[8]  
CORTES C, 1995, MACH LEARN, V20, P273, DOI 10.1023/A:1022627411411
[9]  
Fletcher R., 1981, PRACTICAL METHODS OP
[10]  
Friess T., 1998, P 15 TH INT C MACHIN