A simulation approach to convergence rates for Markov chain Monte Carlo algorithms

被引:27
作者
Cowles, MK
Rosenthal, JS
机构
[1] Harvard Univ, Sch Publ Hlth, Dept Biostat, Boston, MA 02115 USA
[2] Univ Toronto, Dept Stat, Toronto, ON M5S 3G3, Canada
关键词
drift condition; Gibbs sampler; Markov chain Monte Carlo; Metropolis-Hastings algorithm; minorization condition; ordinal probit; variance components;
D O I
10.1023/A:1008982016666
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Markov chain Monte Carlo (MCMC) methods, including the Gibbs sampler and the Metropolis-Hastings algorithm, are very commonly used in Bayesian statistics for sampling from complicated. high-dimensional posterior distributions. A continuing source of uncertainty is how long such a sampler must be run in order to converge approximately to its target stationary distribution. A method has previously been developed to compute rigorous theoretical upper bounds on the number of iterations required to achieve a specified degree of convergence in total variation distance by verifying drift and minorization conditions. We propose the use of auxiliary simulations to estimate the numerical values needed in this theorem. Our simulation method makes it possible to compute quantitative convergence bounds for models for which the requisite analytical computations would be prohibitively difficult or impossible. On the other hand, although our method appears to perform well in our example problems, it cannot provide the guarantees offered by analytical proof.
引用
收藏
页码:115 / 124
页数:10
相关论文
共 32 条
[11]  
GARREN ST, 1995, 9518 U CAMBR STAT LA
[12]   SAMPLING-BASED APPROACHES TO CALCULATING MARGINAL DENSITIES [J].
GELFAND, AE ;
SMITH, AFM .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1990, 85 (410) :398-409
[13]   ILLUSTRATION OF BAYESIAN-INFERENCE IN NORMAL DATA MODELS USING GIBBS SAMPLING [J].
GELFAND, AE ;
HILLS, SE ;
RACINEPOON, A ;
SMITH, AFM .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1990, 85 (412) :972-985
[14]  
Gelman A., 1992, STAT SCI, V7, P457, DOI [10.1214/ss/1177011136, DOI 10.1214/SS/1177011136]
[15]   STOCHASTIC RELAXATION, GIBBS DISTRIBUTIONS, AND THE BAYESIAN RESTORATION OF IMAGES [J].
GEMAN, S ;
GEMAN, D .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1984, 6 (06) :721-741
[16]  
Geweke J, 1992, Bayesian Statistics, P169, DOI DOI 10.21034/SR.148
[17]  
GEYER CJ, 1994, UNPUB GEOMETRIC ERGO
[18]  
Geyer CJ, 1992, STAT SCI, V7, P473, DOI [10.1214/ss/1177011137, DOI 10.1214/SS/1177011137]
[19]   MONTE-CARLO SAMPLING METHODS USING MARKOV CHAINS AND THEIR APPLICATIONS [J].
HASTINGS, WK .
BIOMETRIKA, 1970, 57 (01) :97-&
[20]   ON THE RATE OF CONVERGENCE OF THE METROPOLIS ALGORITHM AND GIBBS SAMPLER BY GEOMETRIC BOUNDS [J].
Ingrassia, Salvatore .
ANNALS OF APPLIED PROBABILITY, 1994, 4 (02) :347-389