A wrapper method for feature selection using Support Vector Machines

被引:361
作者
Maldonado, Sebastian [1 ]
Weber, Richard [1 ]
机构
[1] Univ Chile, Dept Ind Engn, Santiago, Chile
关键词
Feature selection; Wrapper methods; Classification; Support Vector Machines; Mathematical programming;
D O I
10.1016/j.ins.2009.02.014
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We introduce a novel wrapper Algorithm for Feature Selection, using Support Vector Machines with kernel functions. Our method is based on a sequential backward selection, using the number of errors in a validation subset as the measure to decide which feature to remove in each iteration. We compare our approach with other algorithms like a filter method or Recursive Feature Elimination SVM to demonstrate its effectiveness and efficiency. (C) 2009 Elsevier Inc. All rights reserved.
引用
收藏
页码:2208 / 2217
页数:10
相关论文
共 23 条
[1]  
[Anonymous], 2004, KERNEL METHODS PATTE
[2]  
[Anonymous], Journal of machine learning research
[3]  
[Anonymous], INTELL DATA ANAL
[4]   Wrapper filtering criteria via linear neuron and kernel approaches [J].
Blazadonakis, Michalis E. ;
Zervakis, Michalis .
COMPUTERS IN BIOLOGY AND MEDICINE, 2008, 38 (08) :894-912
[5]   Selection of relevant features and examples in machine learning [J].
Blum, AL ;
Langley, P .
ARTIFICIAL INTELLIGENCE, 1997, 97 (1-2) :245-271
[6]  
Bradley P. S., 1998, Machine Learning. Proceedings of the Fifteenth International Conference (ICML'98), P82
[7]  
Coloma P., 2006, TREND MANAGEMENT, V8, P44
[8]  
Cristianini N., 2000, INTRO SUPPORT VECTOR
[9]   Gene selection for cancer classification using support vector machines [J].
Guyon, I ;
Weston, J ;
Barnhill, S ;
Vapnik, V .
MACHINE LEARNING, 2002, 46 (1-3) :389-422
[10]  
Hettich S., 1999, The UCI KDD Archive