Weighted Online Sequential Extreme Learning Machine for Class Imbalance Learning

被引:140
作者
Mirza, Bilal [1 ]
Lin, Zhiping [1 ]
Toh, Kar-Ann [2 ]
机构
[1] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
[2] Yonsei Univ, Sch Elect & Elect Engn, Seoul 120749, South Korea
关键词
Class imbalance; Online sequential learning; Extreme learning machine (ELM); Weighted least squares; Total error rate; ALGORITHM; NETWORK;
D O I
10.1007/s11063-013-9286-9
中图分类号
TP18 [人工智能理论];
学科分类号
140502 [人工智能];
摘要
Most of the existing sequential learning methods for class imbalance learn data in chunks. In this paper, we propose a weighted online sequential extreme learning machine (WOS-ELM) algorithm for class imbalance learning (CIL). WOS-ELM is a general online learning method that alleviates the class imbalance problem in both chunk-by-chunk and one-by-one learning. One of the new features of WOS-ELM is that an appropriate weight setting for CIL is selected in a computationally efficient manner. In one-by-one learning of WOS-ELM, a new sample can update the classification model without waiting for a chunk to be completed. Extensive empirical evaluations on 15 imbalanced datasets show that WOS-ELM obtains comparable or better classification performance than competing methods. The computational time of WOS-ELM is also found to be lower than that of the competing CIL methods.
引用
收藏
页码:465 / 486
页数:22
相关论文
共 32 条
[1]
Applying support vector machines to imbalanced datasets [J].
Akbani, R ;
Kwek, S ;
Japkowicz, N .
MACHINE LEARNING: ECML 2004, PROCEEDINGS, 2004, 3201 :39-50
[2]
[Anonymous], 2012, P 18 ACM SIGKDD INT, DOI [10.1145/2339530.2339558, DOI 10.1145/2339530.2339558]
[3]
Batuwita R, 2012, IMBALANCED IN PRESS
[4]
ADJUSTED GEOMETRIC-MEAN: A NOVEL PERFORMANCE MEASURE FOR IMBALANCED BIOINFORMATICS DATASETS LEARNING [J].
Batuwita, Rukshan ;
Palade, Vasile .
JOURNAL OF BIOINFORMATICS AND COMPUTATIONAL BIOLOGY, 2012, 10 (04)
[5]
A New Performance Measure for Class Imbalance Learning. Application to Bioinformatics Problems [J].
Batuwita, Rukshan ;
Palade, Vasile .
EIGHTH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, PROCEEDINGS, 2009, :545-550
[6]
FSVM-CIL: Fuzzy Support Vector Machines for Class Imbalance Learning [J].
Batuwita, Rukshan ;
Palade, Vasile .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2010, 18 (03) :558-571
[7]
SMOTE: Synthetic minority over-sampling technique [J].
Chawla, Nitesh V. ;
Bowyer, Kevin W. ;
Hall, Lawrence O. ;
Kegelmeyer, W. Philip .
2002, American Association for Artificial Intelligence (16)
[8]
Chen S, 2009, INT JOINT C NEUR NET
[9]
Towards incremental learning of nonstationary imbalanced data stream: a multiple selectively recursive approach [J].
Chen, Sheng ;
He, Haibo .
EVOLVING SYSTEMS, 2011, 2 (01) :35-50
[10]
Demsar J, 2006, J MACH LEARN RES, V7, P1