A multiple resampling method for learning from imbalanced data sets

被引:733
作者
Estabrooks, A
Jo, TH
Japkowicz, N
机构
[1] Univ Ottawa, SITE, Stn A, Ottawa, ON K1N 6N5, Canada
[2] IBM Toronto Lab, Toronto, ON, Canada
关键词
inductive learning; decision trees; class imbalance problem; multiple resampling; text classification;
D O I
10.1111/j.0824-7935.2004.t01-1-00228.x
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Resampling methods are commonly used for dealing with the class-imbalance problem. Their advantage over other methods is that they are external and thus, easily transportable. Although such approaches can be very simple to implement, tuning them most effectively is not an easy task. In particular, it is unclear whether oversampling is more effective than undersampling and which oversampling or undersampling rate should be used. This paper presents an experimental study of these questions and concludes that combining different expressions of the resampling approach is an effective solution to the tuning problem. The proposed combination scheme is evaluated on imbalanced subsets of the Reuters-21578 text collection and is shown to be quite effective for these problems.
引用
收藏
页码:18 / 36
页数:19
相关论文
共 18 条
[1]  
BREIMAN L, 1998, COMBINING PREDICTORS
[2]   SMOTE: Synthetic minority over-sampling technique [J].
Chawla, Nitesh V. ;
Bowyer, Kevin W. ;
Hall, Lawrence O. ;
Kegelmeyer, W. Philip .
2002, American Association for Artificial Intelligence (16)
[3]  
Estabrooks A., 2000, THESIS DALHOUSIE U
[4]   NEURAL NETWORK ENSEMBLES [J].
HANSEN, LK ;
SALAMON, P .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1990, 12 (10) :993-1001
[5]   Adaptive Mixtures of Local Experts [J].
Jacobs, Robert A. ;
Jordan, Michael I. ;
Nowlan, Steven J. ;
Hinton, Geoffrey E. .
NEURAL COMPUTATION, 1991, 3 (01) :79-87
[6]  
Japkowicz N, 1995, INT JOINT CONF ARTIF, P518
[7]  
Japkowicz N., 2002, Intelligent Data Analysis, V6, P429
[8]   Machine learning for the detection of oil spills in satellite radar images [J].
Kubat, M ;
Holte, RC ;
Matwin, S .
MACHINE LEARNING, 1998, 30 (2-3) :195-215
[9]  
Kubat M, 1997, P 14 INT C MACH LEAR, P821
[10]  
LEWIS D, 1994, P 7 ANN INT ACM SIGI