A Survey of Predictive Modeling on Im balanced Domains

被引:855
作者
Branco, Paula [1 ,2 ]
Torgo, Luis [1 ,2 ]
Ribeiro, Rita P. [1 ,2 ]
机构
[1] LIAAD INESC TEC, Campus FEUP,Rua Dr Roberto Frias, P-4200465 Oporto, Portugal
[2] Univ Porto, DCC Fac Sci, Rua Campo Alegre S-N, P-4169007 Oporto, Portugal
关键词
Imbalanced domains; rare cases; classification; regression; performance metrics; SUPPORT VECTOR MACHINES; UNDER-SAMPLING APPROACH; IMBALANCED DATA; NEURAL-NETWORKS; CLASSIFICATION; SMOTE; PERFORMANCE; CLASSIFIERS; FRAMEWORK; SELECTION;
D O I
10.1145/2907070
中图分类号
TP301 [理论、方法];
学科分类号
080201 [机械制造及其自动化];
摘要
Many real-world data-mining applications involve obtaining predictive models using datasets with strongly imbalanced distributions of the target variable. Frequently, the least-common values of this target variable are associated with events that are highly relevant for end users (e.g., fraud detection, unusual returns on stock markets, anticipation of catastrophes, etc.). Moreover, the events may have different costs and benefits, which, when associated with the rarity of some of them on the available training data, creates serious problems to predictive modeling techniques. This article presents a survey of existing techniques for handling these important applications of predictive analytics. Although most of the existing work addresses classification tasks (nominal target variables), we also describe methods designed to handle similar problems within regression tasks (numeric target variables). In this survey, we discuss the main challenges raised by imbalanced domains, propose a definition of the problem, describe the main approaches to these tasks, propose a taxonomy of the methods, summarize the conclusions of existing comparative studies as well as some theoretical analyses of some methods, and refer to some related problems within predictive modeling.
引用
收藏
页数:50
相关论文
共 252 条
[1]
Applying support vector machines to imbalanced datasets [J].
Akbani, R ;
Kwek, S ;
Japkowicz, N .
MACHINE LEARNING: ECML 2004, PROCEEDINGS, 2004, 3201 :39-50
[2]
Alejo R, 2007, LECT NOTES COMPUT SC, V4507, P162
[3]
Alejo R., 2013, Pattern Recognition. 5th Mexican Conference, MCPR 2013. Proceedings: LNCS 7914, P335, DOI 10.1007/978-3-642-38989-4_34
[4]
A hybrid method to face class overlap and class imbalance on neural networks and multi-class scenarios [J].
Alejo, R. ;
Valdovinos, R. M. ;
Garcia, V. ;
Pacheco-Sanchez, J. H. .
PATTERN RECOGNITION LETTERS, 2013, 34 (04) :380-388
[5]
[Anonymous], RES J APPL SCI
[6]
[Anonymous], IEEE C EV COMP 2006
[7]
[Anonymous], 2011, P INT J SCI ENG RES
[8]
[Anonymous], 2002, INTELLIGENT DATA ANA
[9]
[Anonymous], IEEE T KNOWLEDGE DAT
[10]
[Anonymous], 5 INT C HYBR INT SYS