Renewal theory and computable convergence rates for geometrically ergodic Markov chains

被引:102
作者
Baxendale, PH [1 ]
机构
[1] Univ So Calif, Dept Math, Los Angeles, CA 90089 USA
关键词
geometric ergodicity; renewal theory; reversible Markov chain; Markov chain Monte Carlo; Metropolis-Hastings algorithm; spectral gap;
D O I
10.1214/105051604000000710
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We give computable bounds on the rate of convergence of the transition probabilities to the stationary distribution for a certain class of geometrically ergodic Markov chains. Our results are different from earlier estimates of Meyn and Tweedie, and from estimates using coupling, although we start from essentially the same assumptions of a drift condition toward a "small set." The estimates show a noticeable improvement on existing results if the Markov chain is reversible with respect to its stationary distribution, and especially so if the chain is also positive. The method of proof uses the first-entrance-last-exit decomposition, together with new quantitative versions of a result of Kendall from discrete renewal theory.
引用
收藏
页码:700 / 738
页数:39
相关论文
共 23 条
  • [1] [Anonymous], 1968, An introduction to probability theory and its applications
  • [2] BAXENDALE PH, 1994, UNIFORM ESTIMATES GE
  • [3] Quantitative bounds on convergence of time-inhomogeneous Markov chains
    Douc, R
    Moulines, E
    Rosenthal, JS
    [J]. ANNALS OF APPLIED PROBABILITY, 2004, 14 (04) : 1643 - 1665
  • [4] FORT G, 2003, COMPUTABLE BOUNDS V
  • [5] Kendall D.G., 1959, PROBABILITY STAT, P138
  • [6] LIU JS, 1995, J ROY STAT SOC B MET, V57, P157
  • [7] Geometric convergence rates for stochastically ordered Markov chains
    Lund, RB
    Tweedie, RL
    [J]. MATHEMATICS OF OPERATIONS RESEARCH, 1996, 21 (01) : 182 - 194
  • [8] COMPUTABLE BOUNDS FOR GEOMETRIC CONVERGENCE RATES OF MARKOV CHAINS
    Meyn, Sean P.
    Tweedie, R. L.
    [J]. ANNALS OF APPLIED PROBABILITY, 1994, 4 (04) : 981 - 1011
  • [9] Meyn SP., 1993, Stochastic Stability of Markov chains
  • [10] GEOMETRIC ERGODICITY AND R-POSITIVITY FOR GENERAL MARKOV-CHAINS
    NUMMELIN, E
    TWEEDIE, RL
    [J]. ANNALS OF PROBABILITY, 1978, 6 (03) : 404 - 420