A discrete particle swarm optimization method for feature selection in binary classification problems

被引:326
作者
Unler, Alper [1 ]
Murat, Alper [1 ]
机构
[1] Wayne State Univ, Dept Ind & Mfg Engn, Detroit, MI 48202 USA
基金
美国国家科学基金会;
关键词
Feature selection; Particle swarm optimization; Metaheuristics; Binary classification; Logistic regression; FEATURE SUBSET-SELECTION; GENETIC ALGORITHM; TABU SEARCH; RECOGNITION; CLASSIFIERS; SYSTEMS; BRANCH; SETS;
D O I
10.1016/j.ejor.2010.02.032
中图分类号
C93 [管理学];
学科分类号
12 ; 1201 ; 1202 ; 120202 ;
摘要
This paper investigates the feature subset selection problem for the binary classification problem using logistic regression model. We developed a modified discrete particle swarm optimization (PSO) algorithm for the feature subset selection problem. This approach embodies an adaptive feature selection procedure which dynamically accounts for the relevance and dependence of the features included the feature subset. We compare the proposed methodology with the tabu search and scatter search algorithms using publicly available datasets. The results show that the proposed discrete PSO algorithm is competitive in terms of both classification accuracy and computational performance. (C) 2010 Elsevier B.V. All rights reserved.
引用
收藏
页码:528 / 539
页数:12
相关论文
共 57 条
[1]   On the approximability of minimizing nonzero variables or unsatisfied relations in linear systems [J].
Amaldi, E ;
Kann, V .
THEORETICAL COMPUTER SCIENCE, 1998, 209 (1-2) :237-260
[2]  
[Anonymous], 2004, Introduction to Machine Learning
[3]  
[Anonymous], 1998, FEATURE EXTRACTION C
[4]   Supervised machine learning techniques for the classification of metabolic disorders in newborns [J].
Baumgartner, C ;
Böhm, C ;
Baumgartner, D ;
Marini, G ;
Weinberger, K ;
Olgemöller, B ;
Liebl, B ;
Roscher, AA .
BIOINFORMATICS, 2004, 20 (17) :2985-2996
[5]   Selection of relevant features and examples in machine learning [J].
Blum, AL ;
Langley, P .
ARTIFICIAL INTELLIGENCE, 1997, 97 (1-2) :245-271
[6]  
Bradley P. S., 1998, INFORMS Journal on Computing, V10, P209, DOI 10.1287/ijoc.10.2.209
[7]  
CASADOYUSTA S, 2009, PATTERN RECOGN, V30, P525
[8]   The particle swarm - Explosion, stability, and convergence in a multidimensional complex space [J].
Clerc, M ;
Kennedy, J .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2002, 6 (01) :58-73
[9]   POSSIBLE ORDERINGS IN MEASUREMENT SELECTION PROBLEM [J].
COVER, TM ;
VANCAMPENHOUT, JM .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1977, 7 (09) :657-661
[10]  
*CTR MACH LEARN IN, UCI MACH LEARN REP