Neural-based learning classifier systems

被引:60
作者
Dam, Hai H. [1 ]
Abbass, Hussein A.
Lokan, Chris
Yao, Xin
机构
[1] Univ New S Wales, Australian Def Force Acad, Sch Informat Technol & Elect Engn, Art Adaptive Robot Lab, Canberra, ACT 2600, Australia
[2] Univ Birmingham, Sch Comp Sci, Nat Comp Grp, Birmingham B15 2TT, W Midlands, England
基金
澳大利亚研究理事会;
关键词
representations; evolutionary computing and genetic algorithms; neural nets; rule-based processing; data mining; classification;
D O I
10.1109/TKDE.2007.190671
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
UCS is a s (u) under bar pervised learning (c) under bar lassifier (s) under bar ystem that was introduced in 2003 for classification in data mining tasks. The representation of a rule in UCS as a univariate classification rule is straightforward for a human to understand. However, the system may require a large number of rules to cover the input space. Artificial neural networks ( NNs), on the other hand, normally provide a more compact representation. However, it is not a straightforward task to understand the network. In this paper, we propose a novel way to incorporate NNs into UCS. The approach offers a good compromise between compactness, expressiveness, and accuracy. By using a simple artificial NN as the classifier's action, we obtain a more compact population size, better generalization, and the same or better accuracy while maintaining a reasonable level of expressiveness. We also apply negative correlation learning ( NCL) during the training of the resultant NN ensemble. NCL is shown to improve the generalization of the ensemble.
引用
收藏
页码:26 / 39
页数:14
相关论文
共 38 条
[1]   C-Net: A Method for Generating Non-deterministic and Dynamic Multivariate Decision Trees [J].
H. A. Abbass ;
M. Towsey ;
G. Finn .
Knowledge and Information Systems, 2001, 3 (2) :184-197
[2]  
[Anonymous], 2001, Proceedings of the 4th international workshop on learning classifier systems (IWLCS-2001)
[3]  
[Anonymous], 1980, LEARNING SYSTEM BASE
[4]   Accuracy-based Learning Classifier Systems:: Models, analysis and applications to classification tasks [J].
Bernadó-Mansilla, E ;
Garrell-Guiu, JM .
EVOLUTIONARY COMPUTATION, 2003, 11 (03) :209-238
[5]  
Brown G., 2005, Information Fusion, V6, P5, DOI 10.1016/j.inffus.2004.04.004
[6]  
Brown G., 2004, THESIS U BIRMINGHAM
[7]  
Bull L., 2002, Parallel Problem Solving from Nature - PPSN VII. 7th International Conference. Proceedings (Lecture Notes in Computer Science Vol.2439), P558
[8]  
Bull L., 2002, P 4 ANN C GEN EV COM, P905
[9]  
Butz M., 2004, THESIS U ILLINOIS UR
[10]  
Butz MV, 2005, GECCO 2005: GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, VOLS 1 AND 2, P1835