On the relationship between the Support Vector Machine for classification and sparsified Fisher's Linear Discriminant

被引:33
作者
Shashua, A [1 ]
机构
[1] Hebrew Univ Jerusalem, Inst Comp Sci, IL-91904 Jerusalem, Israel
关键词
unsupervised;
D O I
10.1023/A:1018677409366
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We show that the orientation and location of the separating hyperplane for 2-class supervised pattern classification obtained by the Support Vector Machine (SVM) proposed by Vapnik and his colleagues, is equivalent to the solution obtained by Fisher's Linear Discriminant on the set of Support Vectors. In other words, SVM can be seen as a way to 'sparsify' Fisher's Linear Discriminant in order to obtain the most generalizing classification from the training set.
引用
收藏
页码:129 / 139
页数:11
相关论文
共 16 条
[1]  
[Anonymous], 1997, P IEEE C COMP VIS PA
[2]  
Belhumeur P.N., 1996, P EUR C COMP VIS
[3]  
Boser B. E., 1992, Proceedings of the Fifth Annual ACM Workshop on Computational Learning Theory, P144, DOI 10.1145/130385.130401
[4]  
CHEN S, 1995, TR479 DEPT STAT
[5]  
Cortes C., 1995, Mach. Learn., DOI [DOI 10.1023/A:1022627411411, 10.1007/BF00994018]
[6]  
COURANT R, 1953, METHODS MATH PHYSICS
[7]  
GIROSI F, 1997, 1606 MIT
[8]   Development of low entropy coding in a recurrent network [J].
Harpur, GF ;
Prager, RW .
NETWORK-COMPUTATION IN NEURAL SYSTEMS, 1996, 7 (02) :277-284
[9]  
Hart P.E., 1973, Pattern recognition and scene analysis
[10]  
JACOBS DW, 1998, P INT C COMP VIS JAN