Technical note: Using model trees for classification

被引:259
作者
Frank, E [1 ]
Wang, Y [1 ]
Inglis, S [1 ]
Holmes, G [1 ]
Witten, IH [1 ]
机构
[1] Univ Waikato, Dept Comp Sci, Hamilton, New Zealand
关键词
model trees; classification algorithms; M5; C5.0; decision trees;
D O I
10.1023/A:1007421302149
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Model trees, which are a type of decision tree with linear regression functions at the leaves, form the basis of a recent successful technique for predicting continuous numeric values. They can be applied to classification problems by employing a standard method of transforming a classification problem into a problem of function approximation. Surprisingly, using this simple transformation the model tree inducer M5', based on Quinlan's M5, generates more accurate classifiers than the state-of-the-art decision tree learner C5.0, particularly when most of the attributes are numeric.
引用
收藏
页码:63 / 76
页数:14
相关论文
共 10 条
[1]  
[Anonymous], P 12 INT C MACH LEAR
[2]  
Devroye L., 1996, A probabilistic theory of pattern recognition
[3]  
Dietterich T. G., 1995, Journal of Artificial Intelligence Research, V2, P263
[4]  
Friedman JH., 1984, BIOMETRICS, V40, P874, DOI [DOI 10.2307/2530946, 10.2307/2530946]
[5]   VERY SIMPLE CLASSIFICATION RULES PERFORM WELL ON MOST COMMONLY USED DATASETS [J].
HOLTE, RC .
MACHINE LEARNING, 1993, 11 (01) :63-91
[6]  
Merz C, 1996, UCI REPOSITORY MACHI
[7]  
Quinlan J. R., 1992, Proceedings of the 5th Australian Joint Conference on Artificial Intelligence. AI '92, P343
[8]  
Quinlan JR, 2014, C4. 5: programs for machine learning
[9]  
TORGO L, 1997, P POST PAP EUR C MAC
[10]  
Wang Y., 1997, P 9 EUR C MACH LEARN