Scaffolding type-2 classifier for incremental learning under concept drifts

被引:47
作者
Pratama, Mahardhika [1 ]
Lu, Jie [2 ]
Lughofer, Edwin [3 ]
Zhang, Guangquan [2 ]
Anavatti, Sreenatha [4 ]
机构
[1] La Trobe Univ, Dept Comp Sci & IT, Melbourne, Vic 3083, Australia
[2] Univ Technol Sydney, Fac Engn & Informat Technol, Ctr Quantum Computat & Intelligent Syst, Broadway, NSW 2007, Australia
[3] Johannes Kepler Univ Linz, Dept Knowledge Based Math Syst, A-4040 Linz, Austria
[4] Univ New S Wales, Sch Engn & Math Sci, Canberra, ACT 2200, Australia
基金
澳大利亚研究理事会;
关键词
Fuzzy neural network; Neural network; Evolving system; Concept drift; Incremental learning; FUZZY NEURAL-NETWORK; INTERVAL TYPE-2; FEATURE-SELECTION; IDENTIFICATION; SYSTEMS; ROBUST; SETS;
D O I
10.1016/j.neucom.2016.01.049
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The proposal of a meta-cognitive learning machine that embodies the three pillars of human learning: what-to-learn, how-to-learn, and when-to-learn, has enriched the landscape of evolving systems. The majority of meta-cognitive learning machines in the literature have not, however, characterized a plug and-play working principle, and thus require supplementary learning modules to be pre-or post-processed. In addition, they still rely on the type-1 neuron, which has problems of uncertainty. This paper proposes the Scaffolding Type-2 Classifier (ST2Class). ST2Class is a novel meta-cognitive scaffolding classifier that operates completely in local and incremental learning modes. It is built upon a multi variable interval type-2 Fuzzy Neural Network (FNN) which is driven by multivariate Gaussian function in the hidden layer and the non-linear wavelet polynomial in the output layer. The what-to-learn module is created by virtue of a novel active learning scenario termed the uncertainty measure; the how-to-learn module is based on the renowned Schema and Scaffolding theories; and the when-to-learn module uses a standard sample reserved strategy. The viability of ST2Class is numerically benchmarked against state-of-the-art classifiers in 12 data streams, and is statistically validated by thorough statistical tests, in which it achieves high accuracy while retaining low complexity. (C) 2016 Elsevier B.V. All rights reserved.
引用
收藏
页码:304 / 329
页数:26
相关论文
共 74 条
[41]   Type-2 fuzzy sets made simple [J].
Mendel, JM ;
John, RI .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2002, 10 (02) :117-127
[42]   DDD: A New Ensemble Approach for Dealing with Concept Drift [J].
Minku, Leandro L. ;
Yao, Xin .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2012, 24 (04) :619-633
[43]   The Impact of Diversity on Online Ensemble Learning in the Presence of Concept Drift [J].
Minku, Leandro L. ;
White, Allan P. ;
Yao, Xin .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2010, 22 (05) :730-742
[44]   Unsupervised feature selection using feature similarity [J].
Mitra, P ;
Murthy, CA ;
Pal, SK .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (03) :301-312
[45]  
Nelson TO., 1990, The psychology of learning and motivation, V80, P125, DOI [DOI 10.1016/S0079-7421, DOI 10.1016/S0079-7421(08)60053-5]
[46]   Evolving Type-2 Fuzzy Classifier [J].
Pratama, Mahardhika ;
Lu, Jie ;
Zhang, Guangquan .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2016, 24 (03) :574-589
[47]   Recurrent Classifier Based on an Incremental Metacognitive-Based Scaffolding Algorithm [J].
Pratama, Mahardhika ;
Anavatti, Sreenatha G. ;
Lu, Jie .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2015, 23 (06) :2048-2066
[48]   pClass: An Effective Classifier for Streaming Examples [J].
Pratama, Mahardhika ;
Anavatti, Sreenatha G. ;
Er, Meng Joo ;
Lughofer, Edwin David .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2015, 23 (02) :369-386
[49]  
Pratama M, 2014, IEEE INT FUZZY SYST, P369, DOI 10.1109/FUZZ-IEEE.2014.6891560
[50]   GENEFIS: Toward an Effective Localist Network [J].
Pratama, Mahardhika ;
Anavatti, Sreenatha G. ;
Lughofer, Edwin .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2014, 22 (03) :547-562