Scaffolding type-2 classifier for incremental learning under concept drifts

被引:47
作者
Pratama, Mahardhika [1 ]
Lu, Jie [2 ]
Lughofer, Edwin [3 ]
Zhang, Guangquan [2 ]
Anavatti, Sreenatha [4 ]
机构
[1] La Trobe Univ, Dept Comp Sci & IT, Melbourne, Vic 3083, Australia
[2] Univ Technol Sydney, Fac Engn & Informat Technol, Ctr Quantum Computat & Intelligent Syst, Broadway, NSW 2007, Australia
[3] Johannes Kepler Univ Linz, Dept Knowledge Based Math Syst, A-4040 Linz, Austria
[4] Univ New S Wales, Sch Engn & Math Sci, Canberra, ACT 2200, Australia
基金
澳大利亚研究理事会;
关键词
Fuzzy neural network; Neural network; Evolving system; Concept drift; Incremental learning; FUZZY NEURAL-NETWORK; INTERVAL TYPE-2; FEATURE-SELECTION; IDENTIFICATION; SYSTEMS; ROBUST; SETS;
D O I
10.1016/j.neucom.2016.01.049
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The proposal of a meta-cognitive learning machine that embodies the three pillars of human learning: what-to-learn, how-to-learn, and when-to-learn, has enriched the landscape of evolving systems. The majority of meta-cognitive learning machines in the literature have not, however, characterized a plug and-play working principle, and thus require supplementary learning modules to be pre-or post-processed. In addition, they still rely on the type-1 neuron, which has problems of uncertainty. This paper proposes the Scaffolding Type-2 Classifier (ST2Class). ST2Class is a novel meta-cognitive scaffolding classifier that operates completely in local and incremental learning modes. It is built upon a multi variable interval type-2 Fuzzy Neural Network (FNN) which is driven by multivariate Gaussian function in the hidden layer and the non-linear wavelet polynomial in the output layer. The what-to-learn module is created by virtue of a novel active learning scenario termed the uncertainty measure; the how-to-learn module is based on the renowned Schema and Scaffolding theories; and the when-to-learn module uses a standard sample reserved strategy. The viability of ST2Class is numerically benchmarked against state-of-the-art classifiers in 12 data streams, and is statistically validated by thorough statistical tests, in which it achieves high accuracy while retaining low complexity. (C) 2016 Elsevier B.V. All rights reserved.
引用
收藏
页码:304 / 329
页数:26
相关论文
共 74 条
[1]  
Abiyev R. H., 2012, J FRANKLIN I, V550, P1658
[2]   Fuzzy wavelet neural networks for identification and control of dynamic plants - A novel structure and a comparative study [J].
Abiyev, Rahib Hidayat ;
Kaynak, Okyay .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2008, 55 (08) :3133-3140
[3]   Type 2 Fuzzy Neural Structure for Identification and Control of Time-Varying Plants [J].
Abiyev, Rahib Hidayat ;
Kaynak, Okyay .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2010, 57 (12) :4147-4159
[4]   Evolving fuzzy classifiers using different model architectures [J].
Angelov, P. ;
Lughofer, E. ;
Zhou, X. .
FUZZY SETS AND SYSTEMS, 2008, 159 (23) :3160-3182
[5]   Fuzzily Connected Multimodel Systems Evolving Autonomously From Data Streams [J].
Angelov, Plamen .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2011, 41 (04) :898-910
[6]   Evolving Fuzzy-Rule-Based Classifiers From Data Streams [J].
Angelov, Plamen P. ;
Zhou, Xiaowei .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2008, 16 (06) :1462-1475
[7]   An approach to Online identification of Takagi-Suigeno fuzzy models [J].
Angelov, PP ;
Filev, DP .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2004, 34 (01) :484-498
[8]  
Bartett F. C., 1932, REMEMBERING STUDY EX
[9]   A Growing and Pruning Method for Radial Basis Function Networks [J].
Bortman, M. ;
Aladjem, M. .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2009, 20 (06) :1039-1045
[10]   Dealing With Concept Drifts in Process Mining [J].
Bose, R. P. Jagadeesh Chandra ;
van der Aalst, Wil M. P. ;
Zliobaite, Indre ;
Pechenizkiy, Mykola .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2014, 25 (01) :154-171