Extracting decision trees from trained neural networks

被引:70
作者
Krishnan, R [1 ]
Sivakumar, G [1 ]
Bhattacharya, P [1 ]
机构
[1] Indian Inst Technol, Dept Comp Sci & Engn, Bombay 400076, Maharashtra, India
关键词
rule extraction; decision trees; data mining; knowledge discovery; classification;
D O I
10.1016/S0031-3203(98)00181-2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper we present a methodology for extracting decision trees from input data generated from trained neural networks instead of doing it directly from the data. A genetic algorithm is used to query the trained network and extract prototypes. A prototype selection mechanism is then used to select a subset of the prototypes. Finally, a standard induction method like ID3 or C5.0 is used to extract the decision tree. The extracted decision trees can be used to understand the working of the neural network besides performing classification. This method is able to extract different decision trees of high accuracy and comprehensibility from the trained neural network. (C) 1999 Pattern Recognition Society. Published by Elsevier Science Ltd. All rights reserved.
引用
收藏
页码:1999 / 2009
页数:11
相关论文
共 32 条
  • [1] Angluin D., 1988, Machine Learning, V2, P319, DOI 10.1007/BF00116828
  • [2] [Anonymous], 1995, SURVEY CRITIQUE TECH
  • [3] SmcHD1, containing a structural-maintenance-of-chromosomes hinge domain, has a critical role in X inactivation
    Blewitt, Marnie E.
    Gendrel, Anne-Valerie
    Pang, Zhenyi
    Sparrow, Duncan B.
    Whitelaw, Nadia
    Craig, Jeffrey M.
    Apedaile, Anwyn
    Hilton, Douglas J.
    Dunwoodie, Sally L.
    Brockdorff, Neil
    Kay, Graham F.
    Whitelaw, Emma
    [J]. NATURE GENETICS, 2008, 40 (05) : 663 - 669
  • [4] ESTIMATION OF A MULTIVARIATE DENSITY
    CACOULLOS, T
    [J]. ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 1966, 18 (02) : 179 - +
  • [5] IMPROVING GENERALIZATION WITH ACTIVE LEARNING
    COHN, D
    ATLAS, L
    LADNER, R
    [J]. MACHINE LEARNING, 1994, 15 (02) : 201 - 221
  • [6] Craven MarkW., 1996, Technical Report
  • [7] CRAVEN MW, 1994, P 11 INT C MACH LEAR
  • [8] Special issue on reinforcement learning
    Dietterich, TG
    [J]. MACHINE LEARNING, 1996, 22 (1-3) : 5 - 6
  • [9] DIETZ V, 1995, STUD PHYSIOL, V3, P51
  • [10] Duda R.O., 1973, Pattern classification