A distributed PSO-SVM hybrid system with feature selection and parameter optimization

被引:489
作者
Huang, Cheng-Lung [1 ]
Dun, Jian-Fan [2 ]
机构
[1] Natl Kaohsiung First Univ Sci & Technol, Dept Informat Management, Kaohsiung 811, Taiwan
[2] Huafan Univ, Dept Informat Management, Taipei, Taiwan
关键词
particle swarm optimization; support vector machines; distributed computing; web service; data mining; feature selection;
D O I
10.1016/j.asoc.2007.10.007
中图分类号
TP18 [人工智能理论];
学科分类号
081104 [模式识别与智能系统]; 0812 [计算机科学与技术]; 0835 [软件工程]; 1405 [智能科学与技术];
摘要
This study proposed a novel PSO-SVM model that hybridized the particle swarm optimization (PSO) and support vector machines (SVM) to improve the classification accuracy with a small and appropriate feature subset. This optimization mechanism combined the discrete PSO with the continuous-valued PSO to simultaneously optimize the input feature subset selection and the SVM kernel parameter setting. The hybrid PSO-SVM data mining system was implemented via a distributed architecture using the web service technology to reduce the computational time. In a heterogeneous computing environment, the PSO optimization was performed on the application server and the SVM model was trained on the client (agent) computer. The experimental results showed the proposed approach can correctly select the discriminating input features and also achieve high classification accuracy. (C) 2007 Elsevier B.V. All rights reserved.
引用
收藏
页码:1381 / 1391
页数:11
相关论文
共 36 条
[1]
Feature selection for structure-activity correlation using binary particle swarms [J].
Agrafiotis, DK ;
Cedeño, W .
JOURNAL OF MEDICINAL CHEMISTRY, 2002, 45 (05) :1098-1107
[2]
A PSO and a Tabu search heuristics for the assembly scheduling problem of the two-stage distributed database application [J].
Allahverdi, A ;
Al-Anzi, FS .
COMPUTERS & OPERATIONS RESEARCH, 2006, 33 (04) :1056-1080
[3]
[Anonymous], 2001, SWARM INTELL-US
[4]
BOTTOU L, 1994, INT C PATT RECOG, P77, DOI 10.1109/ICPR.1994.576879
[5]
LIBSVM: A Library for Support Vector Machines [J].
Chang, Chih-Chung ;
Lin, Chih-Jen .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)
[6]
Nonlinear inertia weight variation for dynamic adaptation in particle swarm optimization [J].
Chatterjee, A ;
Siarry, P .
COMPUTERS & OPERATIONS RESEARCH, 2006, 33 (03) :859-871
[7]
Cherkassky V, 1997, IEEE Trans Neural Netw, V8, P1564, DOI 10.1109/TNN.1997.641482
[8]
Eberhart RC, 2001, IEEE C EVOL COMPUTAT, P81, DOI 10.1109/CEC.2001.934374
[9]
Infrared image segmentation with 2-D maximum entropy method based on particle swarm optimization (PSO) [J].
Feng, D ;
Shi, WK ;
Chen, LZ ;
Yong, D ;
Zhu, ZF .
PATTERN RECOGNITION LETTERS, 2005, 26 (05) :597-603
[10]
Feature selection for support vector machines by means of genetic algorithms [J].
Fröhlich, H ;
Chapelle, O ;
Schölkopf, B .
15TH IEEE INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2003, :142-148