A novel evolutionary data mining algorithm with applications to churn prediction

被引:191
作者
Au, WH [1 ]
Chan, KCC
Yao, X
机构
[1] Hong Kong Polytech Univ, Dept Comp, Kowloon, Hong Kong, Peoples R China
[2] Univ Birmingham, Sch Comp Sci, Birmingham B15 2TT, W Midlands, England
关键词
churn prediction; customer retention; data mining; evolutionary computation; genetic algorithms;
D O I
10.1109/TEVC.2003.819264
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Classification is an important topic in data mining research. Given a set of data records; each of which belongs to one of a number of predefined classes, the classification problem is concerned with the discovery of classification rules that can allow records with unknown class membership to be correctly classified. Many algorithms have been developed to mine large data sets for classification models and they have been shown to be very effective. However, when it comes to determining the likelihood of each classification made, many of them are not designed with, such purpose in mind. For this, they are not readily applicable to such problem as churn prediction. For such an application, the goal is not only to predict whether or not a subscriber would switch from one carrier to another, it is. also important that the likelihood of the subscriber's doing so be predicted. The reason for this is that a carrier can then choose to provide special personalized offer and services to those subscribers who are predicted with higher likelihood to churn. Given its importance, we propose a new data mining algorithm, called data mining by evolutionary learning (DMEL), to handle classification problems of which the accuracy of each predictions made has to be estimated. In performing its tasks, DMEL searches through the possible rule space using an evolutionary approach that has the following characteristics: 1) the evolutionary process begins with the generation of an initial set of first-order rules (i.e., rules with one conjunct/condition) using a probabilistic induction technique and based on these rules, rules of higher order (two or more conjuncts) are obtained iteratively; 2) when identifying interesting rules, an objective interestingness measure is used; 3) the fitness of a chromosome is defined in terms of the probability that the attribute values of a record can be correctly determined using the rules it encodes; and 4) the likelihood of predictions (or classifications) made are estimated so that subscribers can be ranked according to their likelihood to churn. Experiments with different data sets showed that DMEL is able to effectively discover interesting classification rules. In particular; it is able to predict churn accurately under different churn rates when applied to real telecom subscriber data.
引用
收藏
页码:532 / 545
页数:14
相关论文
共 41 条
  • [1] Agresti A., 1990, Analysis of categorical data
  • [2] [Anonymous], 1989, GENETIC ALGORITHM SE
  • [3] [Anonymous], 2000, C&H TEXT STAT SCI
  • [4] [Anonymous], PC BEAGLE USERS GUID
  • [5] Mining fuzzy association rules in a bank-account database
    Au, WH
    Chan, KCC
    [J]. IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2003, 11 (02) : 238 - 248
  • [6] Bishop C. M., 1995, NEURAL NETWORKS PATT
  • [7] Chan K. C. C., 1991, Knowledge discovery in databases, P107
  • [8] Chan K. C. C., 1990, Computational Intelligence, V6, P119, DOI 10.1111/j.1467-8640.1990.tb00129.x
  • [9] Chan KCC, 2001, STUD FUZZ SOFT COMP, V68, P95
  • [10] CLASS-DEPENDENT DISCRETIZATION FOR INDUCTIVE LEARNING FROM CONTINUOUS AND MIXED-MODE DATA
    CHING, JY
    WONG, AKC
    CHAN, KCC
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1995, 17 (07) : 641 - 651