Conditional Mutual Information based Feature Selection

被引:26
作者
Cheng, Hongrong [1 ]
Qin, Zhiguang [1 ]
Qian, Weizhong [1 ]
Liu, Wei [1 ]
机构
[1] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu 610054, Sichuan, Peoples R China
来源
KAM: 2008 INTERNATIONAL SYMPOSIUM ON KNOWLEDGE ACQUISITION AND MODELING, PROCEEDINGS | 2008年
关键词
D O I
10.1109/KAM.2008.85
中图分类号
TP18 [人工智能理论];
学科分类号
081104 [模式识别与智能系统]; 0812 [计算机科学与技术]; 0835 [软件工程]; 1405 [智能科学与技术];
摘要
In this paper, a new greedy feature selection algorithm is proposed to detect more precisely informative features. It overcomes the limitation of many existing MI-based gready feature selection algorithms. It is capable of detecting the relation of relevant feature combinations in some degree. In addition, the requirements of the memory storage and computation cost are low. Experimental results for the UCI benchmark dataset demonstrate the good performance of the proposed algorithm on the experimented data sets.
引用
收藏
页码:103 / 107
页数:5
相关论文
共 17 条
[1]
[Anonymous], [No title captured]
[2]
[Anonymous], 1993, P 13 INT JOINT C ART
[3]
USING MUTUAL INFORMATION FOR SELECTING FEATURES IN SUPERVISED NEURAL-NET LEARNING [J].
BATTITI, R .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (04) :537-550
[4]
TRAINING A 3-NODE NEURAL NETWORK IS NP-COMPLETE [J].
BLUM, AL ;
RIVEST, RL .
NEURAL NETWORKS, 1992, 5 (01) :117-127
[5]
Cover TM, 2006, Elements of Information Theory
[6]
Dash M., 1997, Intelligent Data Analysis, V1
[7]
Fano R. M., 1961, Transmission of information
[8]
a statistical theory of communications
[9]
Friedman J, 2001, The elements of statistical learning, V1, DOI DOI 10.1007/978-0-387-21606-5
[10]
Mutual information-based feature extraction on the time-frequency plane [J].
Grall-Maës, E ;
Beauseroy, P .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2002, 50 (04) :779-790