Rule discovery by soft induction techniques

被引:12
作者
Zhong, N
Dong, JZ
Ohsuga, S
机构
[1] Maebashi Inst Technol, Dept Informat Engn, Maebashi, Gumma 371, Japan
[2] Waseda Univ, Sch Sci & Engn, Dept Informat & Comp Sci, Shinjuku Ku, Tokyo 169, Japan
关键词
inductive learning; knowledge discovery; generalization distribution table (GDT); rough sets; soft computing; uncertainty and incompleteness; background knowledge; hybrid system;
D O I
10.1016/S0925-2312(00)00341-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The paper describes two soft induction techniques, GDT-NR and GDT-RS, for discovering classification rules from databases with uncertainty and incompleteness. The techniques are based on a generalization distribution table (GDT), in which the probabilistic relationships between concepts and instances over discrete domains are represented. By using the GDT as a probabilistic search space, (1) unseen instances can be considered in the rule discovery process and the uncertainty of a rule, including its ability to predict unseen instances, can be explicitly represented in the strength of the rule; (2) biases can be flexibly selected for search control and background knowledge can be used as a bias to control the creation of a GDT and the rule discovery process. We describe that a GDT can be represented by a variant of connectionist networks (GDT-NR for short), and rules can be discovered by learning on the GDT-NR. Furthermore, we combine the GDT with the rough set methodology (GDT-RS for short). By using GDT-RS, a minimal set of rules with larger strengths can be acquired from databases with noisy, incomplete data. We compare GDT-NR with GDT-RS, and describe GDT-RS is a better way than GDT-NR for large, complex databases. (C) 2001 Elsevier Science B.V. All rights reserved.
引用
收藏
页码:171 / 204
页数:34
相关论文
共 29 条
  • [1] Survey and critique of techniques for extracting rules from trained artificial neural networks
    Andrews, R
    Diederich, J
    Tickle, AB
    [J]. KNOWLEDGE-BASED SYSTEMS, 1995, 8 (06) : 373 - 389
  • [2] Rough fuzzy MLP: Knowledge encoding and classification
    Banerjee, M
    Mitra, S
    Pal, SK
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 1998, 9 (06): : 1203 - 1216
  • [3] PRISM - AN ALGORITHM FOR INDUCING MODULAR RULES
    CENDROWSKA, J
    [J]. INTERNATIONAL JOURNAL OF MAN-MACHINE STUDIES, 1987, 27 (04): : 349 - 370
  • [4] Dong JZ, 1999, LECT NOTES ARTIF INT, V1711, P178
  • [5] DONG JZ, 1998, P 12 ANN C JSAI TOK, P83
  • [6] DONG JZ, 1998, P 5 INT C SOFT COMP, P943
  • [7] RULE GENERATION FROM NEURAL NETWORKS
    FU, LM
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1994, 24 (08): : 1114 - 1124
  • [8] Knowledge discovery based on neural networks
    Fu, LM
    [J]. COMMUNICATIONS OF THE ACM, 1999, 42 (11) : 47 - 50
  • [9] GORDON DF, 1995, MACH LEARN, V20, P5, DOI 10.1007/BF00993472
  • [10] DATA-DRIVEN DISCOVERY OF QUANTITATIVE RULES IN RELATIONAL DATABASES
    HAN, JW
    CAI, YD
    CERCONE, N
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 1993, 5 (01) : 29 - 40