A simple decomposition method for support vector machines

被引:224
作者
Hsu, CW [1 ]
Lin, CJ [1 ]
机构
[1] Natl Taiwan Univ, Dept Comp Sci & Informat Engn, Taipei 106, Taiwan
关键词
support vector machines; decomposition methods; classification;
D O I
10.1023/A:1012427100071
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The decomposition method is currently one of the major methods for solving support vector machines. An important issue of this method is the selection of working sets. In this paper through the design of decomposition methods for bound-constrained SVM formulations we demonstrate that the working set selection is not a trivial task. Then from the experimental analysis we propose a simple selection of the working set which leads to faster convergences for difficult cases. Numerical experiments on different types of problems are conducted to demonstrate the viability of the proposed method.
引用
收藏
页码:291 / 314
页数:24
相关论文
共 21 条
[1]  
Blake C.L., 1998, UCI repository of machine learning databases
[2]   The analysis of decomposition methods for support vector machines [J].
Chang, CC ;
Hsu, CW ;
Lin, CJ .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2000, 11 (04) :1003-1008
[3]  
Cherkassky V, 1997, IEEE Trans Neural Netw, V8, P1564, DOI 10.1109/TNN.1997.641482
[4]  
Cristianini N, 2000, An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods
[5]  
Fletcher R., 1987, PRACTICAL METHODS OP, DOI [DOI 10.1002/9781118723203, 10.1002/9781118723203]
[6]  
Friess T., 1998, P 15 TH INT C MACHIN
[7]  
Joachims T, 1999, ADVANCES IN KERNEL METHODS, P169
[8]  
JOACHIMS T, 2000, COMMUNICATION
[9]   Feasible direction decomposition algorithms for training support vector machines [J].
Laskov, P .
MACHINE LEARNING, 2002, 46 (1-3) :315-349
[10]   Newton's method for large bound-constrained optimization problems [J].
Lin, CJ ;
Moré, JJ .
SIAM JOURNAL ON OPTIMIZATION, 1999, 9 (04) :1100-1127