Stability of piecewise-deterministic Markov processes

被引:27
作者
Dufour, F
Costa, OLV
机构
[1] Ecole Super Elect, Signaux & Syst Lab, CNRS, F-91192 Gif Sur Yvette, France
[2] Univ Sao Paulo, Escola Politecn, Dept Engn Eletron, BR-05508900 Sao Paulo, Brazil
关键词
piecewise-deterministic Markov process; invariant measure; Markov chain;
D O I
10.1137/S0363012997330890
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we study a form of stability for a general family of nondiffusion Markov processes known in the literature as piecewise-deterministic Markov process (PDMP). By stability here we mean the existence of an invariant probability measure for the PDMP. It is shown that the existence of such an invariant probability measure is equivalent to the existence of a sigma-finite invariant measure for a Markov kernel G linked to the resolvent operator U of the PDMP, satisfying a boundedness condition or, equivalently, a Radon-Nikodym derivative. Here we generalize existing results of the literature [O. Costa, J. Appl. Prob., 27, (1990), pp. 60-73; M. Davis, Markov Models and Optimization, Chapman and Hall, 1993] since we do not require any additional assumptions to establish this equivalence. Moreover, we give sufficient conditions to ensure the existence of such a sigma-finite measure satisfying the boundedness condition. They are mainly based on a modified Foster-Lyapunov criterion for the case in which the Markov chain generated by G is either recurrent or weak Feller. To emphasize the relevance of our results, we study three examples and in particular, we are able to generalize the results obtained by Costa and Davis on the capacity expansion model.
引用
收藏
页码:1483 / 1502
页数:20
相关论文
共 18 条