Multisurface proximal support vector machine classification via generalized eigenvalues

被引:622
作者
Mangasarian, OL [1 ]
Wild, EW
机构
[1] Univ Wisconsin, Dept Comp Sci, Madison, WI 53706 USA
[2] Univ Calif San Diego, Dept Math, La Jolla, CA 92093 USA
关键词
support vector machines; proximal classification; generalized eigenvalues;
D O I
10.1109/TPAMI.2006.17
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A new approach to support vector machine (SVM) classification is proposed wherein each of two data sets are proximal to one of two distinct planes that are not parallel to each other. Each plane is generated such that it is closest to one of the two data sets and as far as possible from the other data set. Each of the two nonparallel proximal planes is obtained by a single MATLAB command as the eigenvector corresponding to a smallest eigenvalue of a generalized eigenvalue problem. Classification by proximity to two distinct nonlinear surfaces generated by a nonlinear kernel also leads to two simple generalized eigenvalue problems. The effectiveness of the proposed method is demonstrated by tests on simple examples as well as on a number of public data sets. These examples show the advantages of the proposed approach in both computation time and test set correctness.
引用
收藏
页码:69 / 74
页数:6
相关论文
共 27 条
[1]  
Anderson E, 1999, LAPACK USERS GUIDE
[2]  
[Anonymous], P KDD 2001 KNOWL DIS
[3]  
[Anonymous], MATLAB US GUID
[4]  
[Anonymous], 2002, Least Squares Support Vector Machines
[5]  
[Anonymous], 1998, Encyclopedia of Biostatistics
[6]  
BENNETT KP, 1992, OPTIMIZATION METHODS, V1, P23, DOI DOI 10.1080/10556789208805504
[7]   k-plane clustering [J].
Bradley, PS ;
Mangasarian, OL .
JOURNAL OF GLOBAL OPTIMIZATION, 2000, 16 (01) :23-32
[8]  
Cristianini N., 2000, Intelligent Data Analysis: An Introduction, DOI 10.1017/CBO9780511801389
[9]  
Demmel JW., 1997, APPL NUMERICAL LINEA
[10]   Regularization networks and support vector machines [J].
Evgeniou, T ;
Pontil, M ;
Poggio, T .
ADVANCES IN COMPUTATIONAL MATHEMATICS, 2000, 13 (01) :1-50