A discrete particle swarm optimization method for feature selection in binary classification problems

被引:326
作者
Unler, Alper [1 ]
Murat, Alper [1 ]
机构
[1] Wayne State Univ, Dept Ind & Mfg Engn, Detroit, MI 48202 USA
基金
美国国家科学基金会;
关键词
Feature selection; Particle swarm optimization; Metaheuristics; Binary classification; Logistic regression; FEATURE SUBSET-SELECTION; GENETIC ALGORITHM; TABU SEARCH; RECOGNITION; CLASSIFIERS; SYSTEMS; BRANCH; SETS;
D O I
10.1016/j.ejor.2010.02.032
中图分类号
C93 [管理学];
学科分类号
12 ; 1201 ; 1202 ; 120202 ;
摘要
This paper investigates the feature subset selection problem for the binary classification problem using logistic regression model. We developed a modified discrete particle swarm optimization (PSO) algorithm for the feature subset selection problem. This approach embodies an adaptive feature selection procedure which dynamically accounts for the relevance and dependence of the features included the feature subset. We compare the proposed methodology with the tabu search and scatter search algorithms using publicly available datasets. The results show that the proposed discrete PSO algorithm is competitive in terms of both classification accuracy and computational performance. (C) 2010 Elsevier B.V. All rights reserved.
引用
收藏
页码:528 / 539
页数:12
相关论文
共 57 条
[31]   Machine learning and data mining [J].
Mitchell, TM .
COMMUNICATIONS OF THE ACM, 1999, 42 (11) :30-36
[32]  
NARENDRA P, 1977, IEEE T COMPUT, V26, P917, DOI 10.1109/TC.1977.1674939
[33]  
*NIPS, 2003, NEUR INF PROC C FEAT
[34]   Intelligent partitioning for feature selection [J].
Olafsson, S ;
Yang, J .
INFORMS JOURNAL ON COMPUTING, 2005, 17 (03) :339-355
[35]   Operations research and data mining [J].
Olafsson, Sigurdur ;
Li, Xiaonan ;
Wu, Shuning .
EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2008, 187 (03) :1429-1448
[36]  
OREILLY CA, 1982, ACAD MANAGE J, V25, P756, DOI 10.5465/256097
[37]  
Pacheco J., 2007, IMA Journal of Management Mathematics, V18, P191, DOI 10.1093/imaman/dpm012
[38]   Analysis of new variable selection methods for discriminant analysis [J].
Pacheco, Joaquin ;
Casado, Silvia ;
Nunez, Laura ;
Gomez, Olga .
COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2006, 51 (03) :1463-1478
[39]   A variable selection method based on Tabu search for logistic regression models [J].
Pacheco, Joaquin ;
Casado, Silvia ;
Nunez, Laura .
EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2009, 199 (02) :506-511
[40]   FLOATING SEARCH METHODS IN FEATURE-SELECTION [J].
PUDIL, P ;
NOVOVICOVA, J ;
KITTLER, J .
PATTERN RECOGNITION LETTERS, 1994, 15 (11) :1119-1125