Subgeometric rates of convergence for a class of continuous-time Markov process



Journal of Applied Probability

Subgeometric rates of convergence for a class of continuous-time Markov process

Zhenting Hou, Yuanyuan Liu, and Hanjun Zhang

Source: J. Appl. Probab. Volume 42, Number 3 (2005), 698-712.

Abstract

Let (Φt)t∈ℛ+ be a Harris ergodic continuous-time Markov process on a general state space, with invariant probability measure π. We investigate the rates of convergence of the transition function Pt(x,·) to π; specifically, we find conditions under which r(t)|Pt(x,·)-π|→0 as t→∞, for suitable subgeometric rate functions r(t), where |·| denotes the usual total variation norm for a signed measure. We derive sufficient conditions for the convergence to hold, in terms of the existence of suitable points on which the first hitting time moments are bounded. In particular, for stochastically ordered Markov processes, explicit bounds on subgeometric rates of convergence are obtained. These results are illustrated in several examples.

Primary Subjects: 60J25
Secondary Subjects: 60K25
Keywords: Continuous-time Markov process; queueing model; birth-death process; ergodicity; subgeometric convergence

Full-text: Access denied (no subscription detected)

We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber.
If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription. Read more about accessing full-text
Alternatively, the document is available for a cost of $6. Select the "buy article" button below to purchase this document from a secured VeriSign, Inc. site.
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.jap/1127322021
Digital Object Identifier: doi:10.1239/jap/1127322021
Mathematical Reviews number (MathSciNet): MR2157514
Zentralblatt MATH identifier: 1082.60064

References

Chen, M. F. (1992). From Markov Chains to Nonequilibrium Particle Systems. World Scientific, River Edge, NJ.
Mathematical Reviews (MathSciNet): MR1168209
Doshi, B. (1985). An M/G/$1$ queue with variable vacations. In Proc. Internat. Conf. Model. Techniques Tools Performance Anal., North-Holland, Amsterdam, pp. 67--81.
Down, D., Meyn, S. P. and Tweedie, R. L. (1995). Exponential and uniform ergodicity of Markov processes. Ann. Prob. 23, 1671--1691.
Mathematical Reviews (MathSciNet): MR1379163
Foss, S. and Sapozhnikov, A. (2004). On the existence of moments for the busy period in a single-server queue. Math. Operat. Res. 29, 592--601.
Mathematical Reviews (MathSciNet): MR2082619
Digital Object Identifier: doi:10.1287/moor.1030.0074
Fuhrman, S. (1984). A note on the M/G/$1$ queue with server vacations. Operat. Res. 32, 1368--1373.
Mathematical Reviews (MathSciNet): MR775265
Gut, A. (1974). On the moments of some first passage times for sums of dependent random variables. Stoch. Process. Appl. 2, 115--126.
Mathematical Reviews (MathSciNet): MR370737
Digital Object Identifier: doi:10.1016/0304-4149(74)90015-5
Harris, C. and Marchal, W. (1988). State dependence in M/G/$1$ server vacation models. Operat. Res. 36, 560--565.
Mathematical Reviews (MathSciNet): MR960256
Hou, Z. and Liu, Y. (2004). Explicit criteria for several types of ergodicity of the embedded M/G/$1$ and GI/M/$n$ queues. J. Appl. Prob. 41, 778--790.
Mathematical Reviews (MathSciNet): MR2074823
Digital Object Identifier: doi:10.1239/jap/1091543425
Levy, H. and Kleinrock, L. (1986). A queue with starter and a queue with vacations: delay analysis by decompostition. Operat. Res. 34, 426--436.
Mathematical Reviews (MathSciNet): MR862594
Levy, Y. and Yechiali, U. (1975). Utilization of idle time in an M/G/$1$ queueing system. Manag. Sci. 22, 202--211.
Lund, R. B., Meyn, S. P. and Tweedie, R. L. (1996). Computable exponential convergence rates for stochastically ordered Markov processes. Ann. Appl. Prob. 6, 218--237.
Mathematical Reviews (MathSciNet): MR1389838
Digital Object Identifier: doi:10.1214/aoap/1034968072
Project Euclid: euclid.aoap/1034968072
Mao, Y. H. (2004). Ergodic degrees for continuous-time Markov chains. Sci. China A 47, 161--174.
Mathematical Reviews (MathSciNet): MR2068936
Digital Object Identifier: doi:10.1360/02ys0306
Meyn, S. P. and Tweedie, R. L. (1993). Stability of Markovian processes. II. Continuous-time processes and sampled chains. Adv. Appl. Prob. 25, 487--517.
Mathematical Reviews (MathSciNet): MR1234294
Meyn, S. P. and Tweedie, R. L. (1993). Stability of Markovian processes. III. Foster--Lyapunov criteria for continuous-time processes. Adv. Appl. Prob. 25, 518--548.
Mathematical Reviews (MathSciNet): MR1234295
Nummelin, E. and Tuominen, P. (1983). The rate of convergence in Orey's theorem for Harris recurrent Markov chains with applications to renewal theory. Stoch. Process. Appl. 15, 295--311.
Mathematical Reviews (MathSciNet): MR711187
Digital Object Identifier: doi:10.1016/0304-4149(83)90037-6
Thorisson, H. (1985). The queue GI/G/1: finite moments of the cycle variables and uniform rates of convergence. Stoch. Process. Appl. 19, 85--99.
Mathematical Reviews (MathSciNet): MR780722
Digital Object Identifier: doi:10.1016/0304-4149(85)90041-9
Tuominen, P. and Tweedie, R. L. (1979). Exponential ergodicity in Markovian queueing and dam models. J. Appl. Prob. 16, 867--880.
Mathematical Reviews (MathSciNet): MR549565
Tuominen, P. and Tweedie, R. L. (1994). Subgeometric rates of convergence of $f$-ergodic Markov chains. Adv. Appl. Prob. 26, 775--798.
Mathematical Reviews (MathSciNet): MR1285459
Van Doorn, E. A. (1981). Stochastic Monotonicity and Queueing Applications of Birth--Death Processes (Lecture Notes Statist. 4). Springer, New York.
Mathematical Reviews (MathSciNet): MR606558

2008 © Applied Probability Trust