Improved algorithm based on mutual information for learning Bayesian network structures in the space of equivalence classes

被引:14
作者
Li, Bing Han [1 ]
Liu, San Yang [1 ]
Li, Zhan Guo [2 ]
机构
[1] Xian Elect & Sci Univ, Dept Sci, Xian 710071, Peoples R China
[2] Xi An Jiao Tong Univ, Dept Mech Engn, Xian 710049, Peoples R China
关键词
Data mining; Bayesian network; Structure learning; Mutual information; Conditional independence test; DIAGNOSIS;
D O I
10.1007/s11042-011-0801-6
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As is well known, greedy algorithm is usually used as local optimization method in many heuristic algorithms such as ant colony optimization, taboo search, and genetic algorithms, and it is significant to increase the convergence speed and learning accuracy of greedy search in the space of equivalence classes of Bayesian network structures. An improved algorithm, I-GREEDY-E is presented based on mutual information and conditional independence tests to firstly make a draft about the real network, and then greedily explore the optimal structure in the space of equivalence classes starting from the draft. Numerical experiments show that both the BIC score and structure error have some improvement, and the number of iterations and running time are greatly reduced. Therefore the structure with highest degree of data matching can be relatively faster determined by the improved algorithm.
引用
收藏
页码:129 / 137
页数:9
相关论文
共 26 条
  • [1] Bayes prediction for the number of failures of a repairable system
    Beiser, JA
    Rigdon, SE
    [J]. IEEE TRANSACTIONS ON RELIABILITY, 1997, 46 (02) : 291 - 295
  • [2] Bromberg F, 2006, SIAM PROC S, P141
  • [3] Improving Bayesian network structure learning with mutual information-based node ordering in the K2 algorithm
    Chen, Xue-Wen
    Anantha, Gopalakrishna
    Lin, Xiaotong
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2008, 20 (05) : 628 - 640
  • [4] Chickering D. M., 2003, Journal of Machine Learning Research, V3, P507, DOI 10.1162/153244303321897717
  • [5] Chickering D. M., 1995, Uncertainty in Artificial Intelligence. Proceedings of the Eleventh Conference (1995), P87
  • [6] Chickering D.M., 1994, LEARNING BAYESIAN NE
  • [7] Learning equivalence classes of Bayesian-network structures
    Chickering, DM
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2002, 2 (03) : 445 - 498
  • [8] Chickering DM, 1995, PREL PAP 5 INT WORKS
  • [9] A Stable Stochastic Optimization Algorithm for Triangulation of Bayesian Networks
    Dong, Xuchu
    Ouyang, Dantong
    Ye, Yuxin
    Feng, Shasha
    Yu, Haihong
    [J]. THIRD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING: WKDD 2010, PROCEEDINGS, 2010, : 466 - 469
  • [10] HANSEN JF, 1980, DAN MED BULL, V27, P280