Markov chain sampling methods for Dirichlet process mixture

被引:1339
作者
Neal, RM [1 ]
机构
[1] Univ Toronto, Dept Stat, Toronto, ON, Canada
[2] Univ Toronto, Dept Comp Sci, Toronto, ON, Canada
关键词
auxiliary variable methods; density estimation; latent class models; Monte Carlo; Metropolis-Hasting algorithm;
D O I
10.2307/1390653
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
This article reviews Markov chain methods for sampling from the posterior distribution of a Dirichlet process mixture model and presents two new classes of methods. One new approach is to make Metropolis-Hastings updates of the indicators specifying which mixture component is associated with each observation, perhaps supplemented with a partial form of Gibbs sampling, The other new approach extends Gibbs sampling for these indicators by using a set of auxiliary parameters. These methods are simple to implement and are more efficient than previous ways of handling general Dirichlet process mixture models with non-conjugate priors.
引用
收藏
页码:249 / 265
页数:17
相关论文
共 18 条
[1]  
Anderson JR, 1990, ADAPTIVE CHARACTER T
[2]  
[Anonymous], PRACTICAL NON PARAME
[3]   MIXTURES OF DIRICHLET PROCESSES WITH APPLICATIONS TO BAYESIAN NONPARAMETRIC PROBLEMS [J].
ANTONIAK, CE .
ANNALS OF STATISTICS, 1974, 2 (06) :1152-1174
[4]   FERGUSON DISTRIBUTIONS VIA POLYA URN SCHEMES [J].
BLACKWELL, D ;
MACQUEEN, JB .
ANNALS OF STATISTICS, 1973, 1 (02) :353-355
[5]   A semiparametric Bayesian model for randomised block designs [J].
Bush, CA ;
MacEachern, SN .
BIOMETRIKA, 1996, 83 (02) :275-285
[6]   BAYESIAN DENSITY-ESTIMATION AND INFERENCE USING MIXTURES [J].
ESCOBAR, MD ;
WEST, M .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1995, 90 (430) :577-588
[7]   ESTIMATING NORMAL MEANS WITH A DIRICHLET PROCESS PRIOR [J].
ESCOBAR, MD .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1994, 89 (425) :268-277
[8]  
ESCOBAR MD, 1998, PRACTICAL NONPARAMET, P1
[9]  
Ferguson T.S., 1983, Recent Advances in Statistics: Papers in Honor of Herman Chernojf on His Sixtieth Birthday, P287
[10]   BAYESIAN ANALYSIS OF SOME NONPARAMETRIC PROBLEMS [J].
FERGUSON, TS .
ANNALS OF STATISTICS, 1973, 1 (02) :209-230