A complete fuzzy decision tree technique

被引：293

作者：

Olaru, C ^{[1
]}

Wehenkel, L ^{[1
]}

机构：

[1] Univ Liege, Inst Montefiore, Dept Elect Engn & Comp Sci, B-4000 Liege, Belgium

来源：

FUZZY SETS AND SYSTEMS | 2003年 / 138卷 / 02期

关键词：

learning; approximate reasoning; fuzzy decision tree; data mining; soft split; pruning; global optimization; regression tree; neural network;

D O I：

10.1016/S0165-0114(03)00089-7

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

In this paper, a new method of fuzzy decision trees called soft decision trees (SDT) is presented. This method combines tree growing and pruning, to determine the structure of the soft decision tree, with refitting and backfitting, to improve its generalization capabilities. The method is explained and motivated and its behavior is first analyzed empirically on 3 large databases in terms of classification error rate, model complexity and CPU time. A comparative study on 11 standard UCI Repository databases then shows that the soft decision trees produced by this method are significantly more accurate than standard decision trees. Moreover, a global model variance study shows a much lower variance for soft decision trees than for standard trees as a direct cause of the improved accuracy. (C) 2003 Elsevier B.V. All rights reserved.

引用

页码：221 / 254

页数：34

共 60 条

[11] ASSESSING CREDIT CARD APPLICATIONS USING MACHINE LEARNING
CARTER, C
CATLETT, J
[J]. IEEE EXPERT-INTELLIGENT SYSTEMS & THEIR APPLICATIONS, 1987, 2 (03): : 71 - 79
[12] FUZZY DECISION TREE ALGORITHMS
CHANG, RLP
PAVLIDIS, T
[J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1977, 7 (01): : 28 - 35
[13] ID3-derived fuzzy rules and optimized defuzzification for handwritten numeral recognition
Chi, ZR
Yan, H
[J]. IEEE TRANSACTIONS ON FUZZY SYSTEMS, 1996, 4 (01) : 24 - 31
[14] Ontogenic neuro-fuzzy algorithm: F-CID3
Cios, KJ
Sztandera, LM
[J]. NEUROCOMPUTING, 1997, 14 (04) : 383 - 402
[15] A MACHINE LEARNING-METHOD FOR GENERATION OF A NEURAL NETWORK ARCHITECTURE - A CONTINUOUS ID3 ALGORITHM
CIOS, KJ
LIU, N
[J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 1992, 3 (02): : 280 - 291
[16] CIOS KJ, 1992, IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS, P469, DOI 10.1109/FUZZY.1992.258659
[17] Dietterich T.G., 1995, Machine Learning Bias, Statistical Bias, and Statistical Variance of Decision Tree Algorithms
[18] Approximate statistical tests for comparing supervised classification learning algorithms
Dietterich, TG
[J]. NEURAL COMPUTATION, 1998, 10 (07) : 1895 - 1923
[19] Ensemble methods in machine learning
Dietterich, TG
[J]. MULTIPLE CLASSIFIER SYSTEMS, 2000, 1857 : 1 - 15
[20] FRIEDMAN JH, 1996, LOCAL LEARNING BASED

← 1 2 3 4 5 6 →