Model selection for the LS-SVM. Application to handwriting recognition

被引:150
作者
Adankon, Mathias M. [1 ]
Cheriet, Mohamed [1 ]
机构
[1] Synchromedia Lab Multimedia Commun Telepresence E, Montreal, PQ H3C 1K3, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
LS-SVM; Support vector machine; Model selection; Kernel machine; MEAN-FIELD; SUPPORT; OPTIMIZATION;
D O I
10.1016/j.patcog.2008.10.023
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The support vector machine (SVM) is a powerful classifier which has been used successfully in many pattern recognition problems. It has also been shown to perform well in the handwriting recognition field. The least squares SVM (LS-SVM), like the SVM, is based on the margin-maximization principle performing structural risk minimization. However, it is easier to train than the SVM, as it requires only the solution to a convex linear problem, and not a quadratic problem as in the SVM. In this paper, we propose to conduct model selection for the LS-SVM using an empirical error criterion. Experiments on handwritten character recognition show the usefulness of this classifier and demonstrate that model selection improves the generalization performance of the LS-SVM. (C) 2008 Elsevier Ltd. All rights reserved
引用
收藏
页码:3264 / 3270
页数:7
相关论文
共 40 条
[1]   Optimizing resources in model selection for support vector machine [J].
Adankon, Mathias M. ;
Cheriet, Mohamed .
PATTERN RECOGNITION, 2007, 40 (03) :953-963
[2]  
[Anonymous], 2004, KERNEL METHODS PATTE
[3]   Automatic model selection for the optimization of SVM kernels [J].
Ayat, NE ;
Cheriet, M ;
Suen, CY .
PATTERN RECOGNITION, 2005, 38 (10) :1733-1745
[4]   Feature vector selection and projection using kernels [J].
Baudat, G ;
Anouar, F .
NEUROCOMPUTING, 2003, 55 (1-2) :21-38
[5]   Gradient-based optimization of hyperparameters [J].
Bengio, Y .
NEURAL COMPUTATION, 2000, 12 (08) :1889-1900
[6]  
Bishop Christopher M, 1995, Neural networks for pattern recognition
[7]  
Boser B. E., 1992, Proceedings of the Fifth Annual ACM Workshop on Computational Learning Theory, P144, DOI 10.1145/130385.130401
[8]  
CAWLEY G, 2006, P IJCNN 2006 VANC CA
[9]  
Cawley GC, 2007, J MACH LEARN RES, V8, P841
[10]   Fast exact leave-one-out cross-validation of sparse least-squares support vector machines [J].
Cawley, GC ;
Talbot, NLC .
NEURAL NETWORKS, 2004, 17 (10) :1467-1475