Improve multi-instance neural networks through feature selection

被引:76
作者
Zhang, ML [1 ]
Zhou, ZH [1 ]
机构
[1] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing 210093, Peoples R China
基金
中国国家自然科学基金;
关键词
backpropagation; feature selection; machine learning; multi-instance learning; neural networks;
D O I
10.1023/B:NEPL.0000016836.03614.9f
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
bMulti-instance learning is regarded as a new learning framework where the training examples are bags composed of instances without labels, and the task is to predict the labels of unseen bags through analyzing the training bags with known labels. Recently, a multi-instance neural network BP-MIP was proposed. In this paper, BP-MIP is improved through adopting two different feature selection techniques, i.e. feature scaling with Diverse Density and feature reduction with principal component analysis. In detail, before feature vectors are fed to a BP-MIP neural network, they are scaled by the feature weights found by running Diverse Density on the training data, or projected by a linear transformation matrix formed by principal component analysis. Experiments show that these feature selection mechanisms can significantly improve the performance of BP-MIP.
引用
收藏
页码:1 / 10
页数:10
相关论文
共 19 条
  • [1] [Anonymous], THESIS MIT
  • [2] Blake C.L., 1998, UCI repository of machine learning databases
  • [3] A note on learning from multiple-instance examples
    Blum, A
    Kalai, A
    [J]. MACHINE LEARNING, 1998, 30 (01) : 23 - 29
  • [4] Chevaleyre Y., 2001, APPL MUT PROBL CAN C, P204
  • [5] Solving the multiple instance problem with axis-parallel rectangles
    Dietterich, TG
    Lathrop, RH
    LozanoPerez, T
    [J]. ARTIFICIAL INTELLIGENCE, 1997, 89 (1-2) : 31 - 71
  • [6] DOOLY DR, 2001, LECT NOTES ARTIF INT, V2225, P167
  • [7] Jollife I., 1986, Principal Component Analysis
  • [8] PAC learning axis-aligned rectangles with respect to product distributions from multiple-instance examples
    Long, PM
    Tan, L
    [J]. MACHINE LEARNING, 1998, 30 (01) : 7 - 21
  • [9] Maron O, 1998, ADV NEUR IN, V10, P570
  • [10] MARON O, 1998, P 15 INT C MACH LEAR, P341