An introduction to MCMC for machine learning

被引:1490
作者
Andrieu, C
de Freitas, N
Doucet, A
Jordan, MI
机构
[1] Univ Bristol, Dept Math, Stat Grp, Bristol BS8 1TW, Avon, England
[2] Univ British Columbia, Dept Comp Sci, Vancouver, BC V6T 1Z4, Canada
[3] Univ Melbourne, Dept Elect & Elect Engn, Parkville, Vic 3052, Australia
[4] Univ Calif Berkeley, Dept Comp Sci, Berkeley, CA 94720 USA
[5] Univ Calif Berkeley, Dept Stat, Berkeley, CA 94720 USA
关键词
Markov chain Monte Carlo; MCMC; sampling; stochastic algorithms;
D O I
10.1023/A:1020281327116
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This purpose of this introductory paper is threefold. First, it introduces the Monte Carlo method with emphasis on probabilistic machine learning. Second, it reviews the main building blocks of modern Markov chain Monte Carlo simulation, thereby providing and introduction to the remaining papers of this special issue. Lastly, it discusses new interesting research horizons.
引用
收藏
页码:5 / 43
页数:39
相关论文
共 140 条
[1]   BAYESIAN-ANALYSIS OF BINARY AND POLYCHOTOMOUS RESPONSE DATA [J].
ALBERT, JH ;
CHIB, S .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1993, 88 (422) :669-679
[2]   Stochastic gradient optimization of importance sampling for the efficient simulation of digital communication systems [J].
AlQaq, WA ;
Devetsikiotis, M ;
Townsend, JK .
IEEE TRANSACTIONS ON COMMUNICATIONS, 1995, 43 (12) :2975-2985
[3]  
Anderson H.L., 1986, Los Alamos Sci, V14, P96
[4]   Sequential MCMC for Bayesian model selection [J].
Andrieu, C ;
De Freitas, N ;
Doucet, A .
PROCEEDINGS OF THE IEEE SIGNAL PROCESSING WORKSHOP ON HIGHER-ORDER STATISTICS, 1999, :130-134
[5]   Robust full Bayesian learning for radial basis networks [J].
Andrieu, C ;
de Freitas, N ;
Doucet, A .
NEURAL COMPUTATION, 2001, 13 (10) :2359-2407
[6]  
Andrieu C, 2000, ADV NEUR IN, V12, P379
[7]   Joint Bayesian model selection and estimation of noisy sinusoids via reversible jump MCMC [J].
Andrieu, C ;
Doucet, A .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1999, 47 (10) :2667-2676
[8]  
ANDRIEU C, 2001, ADV NEURAL INFORMATI
[9]  
ANDRIEU C, 1999, 346 CUED F INFENG
[10]  
ANDRIEU C, 2000, UNCERTAINTY ARTIFICI, P11