A tutorial on support vector machine-based methods for classification problems in chemometrics

被引:252
作者
Luts, Jan [1 ]
Ojeda, Fabian [1 ]
Van de Plas, Raf [1 ,2 ]
De Moor, Bart [1 ]
Van Huffel, Sabine [1 ]
Suykens, Johan A. K. [1 ]
机构
[1] Katholieke Univ Leuven, Dept Elect Engn ESAT, Res Div SCD, B-3001 Louvain, Belgium
[2] Katholieke Univ Leuven, Interfac Ctr Prote & Metab, ProMeTa, B-3000 Louvain, Belgium
关键词
Support vector machine; Least squares support vector machine; Kernel logistic regression; Kernel-based learning; Feature selection; Multi-class probabilities; IMAGING MASS-SPECTROMETRY; STATISTICAL COMPARISONS; CROSS-VALIDATION; BAYESIAN METHODS; CLASSIFIERS; MULTICLASS; EXPRESSION; SELECTION; REGULARIZATION; REGRESSION;
D O I
10.1016/j.aca.2010.03.030
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This tutorial provides a concise overview of support vector machines and different closely related techniques for pattern classification. The tutorial starts with the formulation of support vector machines for classification. The method of least squares support vector machines is explained. Approaches to retrieve a probabilistic interpretation are covered and it is explained how the binary classification techniques can be extended to multi-class methods. Kernel logistic regression, which is closely related to iteratively weighted least squares support vector machines, is discussed. Different practical aspects of these methods are addressed: the issue of feature selection, parameter tuning, unbalanced data sets, model evaluation and statistical comparison. The different concepts are illustrated on three real-life applications in the field of metabolomics, genetics and proteomics. (C) 2010 Elsevier B.V. All rights reserved.
引用
收藏
页码:129 / 145
页数:17
相关论文
共 86 条
[1]  
Abe S., 2005, ADV PTRN RECOGNIT
[2]   Reducing multiclass to binary: A unifying approach for margin classifiers [J].
Allwein, EL ;
Schapire, RE ;
Singer, Y .
JOURNAL OF MACHINE LEARNING RESEARCH, 2001, 1 (02) :113-141
[3]   Combined 5 x 2 cv F test for comparing supervised classification learning algorithms [J].
Alpaydin, E .
NEURAL COMPUTATION, 1999, 11 (08) :1885-1892
[4]   Fast cross-validation algorithms for least squares support vector machine and kernel ridge regression [J].
An, Senjian ;
Liu, Wanquan ;
Venkatesh, Svetha .
PATTERN RECOGNITION, 2007, 40 (08) :2154-2162
[5]  
[Anonymous], 2004, Introduction to Machine Learning
[6]  
[Anonymous], [No title captured]
[7]  
[Anonymous], 2002, Learning to Classify Text Using Support Vector Machines: Methods, Theory and Algorithms
[8]  
[Anonymous], 2002, LS SVMLAB MATLAB C T
[9]  
[Anonymous], 1994, MACHINE LEARNING P 1, DOI DOI 10.1016/B978-1-55860-335-6.50023-4
[10]  
[Anonymous], 2003, P 20 INT C INT C MAC, DOI DOI 10.5555/3041838.3041845