Formulations of support vector machines: A note from an optimization point of view

被引:57
作者
Lin, CJ [1 ]
机构
[1] Natl Taiwan Univ, Dept Comp Sci & Informat Engn, Taipei 106, Taiwan
关键词
D O I
10.1162/089976601300014547
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this article, we discuss issues about formulations of support vector machines (SVM) from an optimization point of view. First, SVMs map training data into a higher- (maybe infinite-) dimensional space. Currently primal and dual formulations of SVM are derived in the finite dimensional space and readily extend to the infinite-dimensional space. We rigorously discuss the primal-dual relation in the infinite-dimensional spaces. Second, SVM formulations contain penalty terms, which are different from unconstrained penalty functions in optimization. Traditionally unconstrained penalty functions approximate a constrained problem as the penalty parameter increases. We are interested in similar properties for SVM formulations. For two of the most popular SVM formulations, we show that one enjoys properties of exact penalty functions, but the other is only like traditional penalty functions, which converge when the penalty parameter goes to infinity.
引用
收藏
页码:307 / 317
页数:11
相关论文
共 15 条
  • [1] [Anonymous], 1986, CONVEXITY OPTIMIZATI
  • [2] BENNETT KP, 1992, OPTIMIZATION METHODS, V1, P23, DOI DOI 10.1080/10556789208805504
  • [3] Boser B, 1992, P 5 ANN WORKSHOP COM, V1, P37
  • [4] CHANG CC, 2000, SOME ANAL NU SUPPORT
  • [5] CORTES C, 1995, MACH LEARN, V20, P273, DOI 10.1023/A:1022627411411
  • [6] CRISP DJ, IN PRESS ADV NEURAL
  • [7] Debnath L., 1999, INTRO HILBERT SPACES, VSecond
  • [8] Di Pillo G., 1994, ALGORITHMS CONTINUOU
  • [9] Friess T., 1998, P 15 TH INT C MACHIN
  • [10] Girsanov I. V., 1972, Lectures on Mathematical Theory of Extremum Problems, V67