Geometric convergence rates for stochastically ordered Markov chains

被引:48
作者
Lund, RB [1 ]
Tweedie, RL [1 ]
机构
[1] COLORADO STATE UNIV,DEPT STAT,FT COLLINS,CO 80523
关键词
total variation; convergence rate; geometric ergodicity; coupling; random walks; queues; storage processes;
D O I
10.1287/moor.21.1.182
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
Let {Phi(n)} be a Markov chain on the state space [0,infinity) that is stochastically ordered in its initial state; that is, a stochastically larger initial state produces a stochastically larger chain at all other times. Examples of such chains include random walks, the number of customers in various queueing systems, and a plethora of storage processes. A large body of recent literature concentrates on establishing geometric ergodicity of {Phi(n)} in total variation; that is, proving the existence of a limiting probability measure pi and a number r > 1 such that [GRAPHICS] for every deterministic initial state Phi(0) = x. We seek to identify the largest r that satisfies this relationship. A dependent sample path coupling and a Foster-Lyapumov drift inequality are used to derive convergence rate bounds; we then show that the bounds obtained are frequently the best possible. Application of the methods to queues and random walks are included.
引用
收藏
页码:182 / 194
页数:13
相关论文
共 18 条
  • [1] [Anonymous], 1992, Stochastic Stability of Markov chains
  • [2] Asmussen S, 2008, APPL PROBABILITY QUE, V51
  • [3] Feller W., 1960, INTRO PROBABILITY TH
  • [4] Lindvall T., 1992, Lectures on the coupling method
  • [5] A DAM WITH SEASONAL INPUT
    LUND, RB
    [J]. JOURNAL OF APPLIED PROBABILITY, 1994, 31 (02) : 526 - 541
  • [6] MENGERSEN KL, 1995, IN PRESS ANN STAT
  • [7] COMPUTABLE BOUNDS FOR GEOMETRIC CONVERGENCE RATES OF MARKOV CHAINS
    Meyn, Sean P.
    Tweedie, R. L.
    [J]. ANNALS OF APPLIED PROBABILITY, 1994, 4 (04) : 981 - 1011
  • [8] Nummelin E, 1982, Stochastic Processes and Their Applications, V12, P187
  • [9] POPOV N., 1977, SOV MATH DOKL, V18, P676
  • [10] ROBERTS GO, 1994, IN PRESS J ROYAL S B