Multisurface proximal support vector machine classification via generalized eigenvalues

被引:622
作者
Mangasarian, OL [1 ]
Wild, EW
机构
[1] Univ Wisconsin, Dept Comp Sci, Madison, WI 53706 USA
[2] Univ Calif San Diego, Dept Math, La Jolla, CA 92093 USA
关键词
support vector machines; proximal classification; generalized eigenvalues;
D O I
10.1109/TPAMI.2006.17
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A new approach to support vector machine (SVM) classification is proposed wherein each of two data sets are proximal to one of two distinct planes that are not parallel to each other. Each plane is generated such that it is closest to one of the two data sets and as far as possible from the other data set. Each of the two nonparallel proximal planes is obtained by a single MATLAB command as the eigenvector corresponding to a smallest eigenvalue of a generalized eigenvalue problem. Classification by proximity to two distinct nonlinear surfaces generated by a nonlinear kernel also leads to two simple generalized eigenvalue problems. The effectiveness of the proposed method is demonstrated by tests on simple examples as well as on a number of public data sets. These examples show the advantages of the proposed approach in both computation time and test set correctness.
引用
收藏
页码:69 / 74
页数:6
相关论文
共 27 条
[11]  
Golub G. H., 1996, MATRIX COMPUTATIONS
[12]  
Joachims T, 1999, ADVANCES IN KERNEL METHODS, P169
[13]  
Kojima M., 1991, A unified approach to interior point algorithms for linear complementarity problems
[14]   An optimal structure-discriminative amino acid index for protein fold recognition [J].
Leary, RH ;
Rosen, JB ;
Jambeck, P .
BIOPHYSICAL JOURNAL, 2004, 86 (01) :411-419
[15]  
Lee Y-J, 2001, P 2001 SIAM INT C DA, P1
[16]   NON-LINEAR PERTURBATION OF LINEAR PROGRAMS [J].
MANGASARIAN, OL ;
MEYER, RR .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1979, 17 (06) :745-752
[17]  
Mangasarian OL, 2000, ADV NEUR IN, P135
[18]   Arbitrary-norm separating plane [J].
Mangasarian, OL .
OPERATIONS RESEARCH LETTERS, 1999, 24 (1-2) :15-23
[19]  
MANGASARIAN OL, 1990, FUNCTIONAL ANAL OPTI, P217
[20]  
Mitchell TM., 1997, MACH LEARN, V1