Learning Bayesian networks in the space of structures by estimation of distribution algorithms

被引:44
作者
Blanco, R [1 ]
Inza, I [1 ]
Larrañga, P [1 ]
机构
[1] Univ Basque Country, Dept Comp Sci & Artificial Intelligence, Intelligent Syst Grp, E-20080 San Sebastian, Spain
关键词
D O I
10.1002/int.10084
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The induction of the optimal Bayesian network structure is NP-hard, justifying the use of search heuristics. Two novel population-based stochastic search approaches, univariate marginal distribution algorithm (UMDA) and population-based incremental learning (PBIL), are used to learn a Bayesian network structure from a database of cases in a score + search framework. A comparison with a genetic algorithm (GA) approach is performed using three different scores: penalized maximum likelihood, marginal likelihood, and information-theory-based entropy. Experimental results show the interesting capabilities of both novel approaches with respect to the score value and the number of generations needed to converge. (C) 2003 Wiley Periodicals, Inc.
引用
收藏
页码:205 / 220
页数:16
相关论文
共 17 条
[1]   A guide to the literature on learning probabilistic networks from data [J].
Buntine, W .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 1996, 8 (02) :195-210
[2]  
Castillo E., 1997, Expert Systems and Probabilistic Network Models
[3]  
COOPER GF, 1992, MACH LEARN, V9, P309, DOI 10.1007/BF00994110
[4]  
Cowell R.G., 1999, PROBABILISTIC NETWOR
[5]  
DAWID AP, 1979, J ROY STAT SOC B MET, V41, P1
[6]  
DECAMPOS LM, 1998, PROBABILISTIC EXPERT, P113
[7]  
Glymour C., 1993, LECT NOTES STAT, V1, DOI 10.1007/978-1-4612-2748-9
[8]  
HECKERMAN D, 1995, MACH LEARN, V20, P197, DOI 10.1007/BF00994016
[9]  
HECKERMAN D, 1995, MSTTR9554 MICR CORP
[10]   Feature subset selection by Bayesian networks:: a comparison with genetic and sequential algorithms [J].
Inza, I ;
Larrañaga, P ;
Sierra, B .
INTERNATIONAL JOURNAL OF APPROXIMATE REASONING, 2001, 27 (02) :143-164