Let (Φt)t∈ℛ+ be a
Harris ergodic continuous-time Markov process on a general state space, with
invariant probability measure π. We investigate the rates of convergence of the transition function
Pt(x,·)
to π; specifically, we find conditions under which
r(t)|Pt(x,·)-π|→0 as t→∞,
for suitable subgeometric rate functions r(t), where |·| denotes the usual total variation
norm for a signed measure.
We derive sufficient conditions for the convergence to hold, in terms
of the existence of suitable points on which the first hitting time moments are bounded. In particular, for
stochastically ordered Markov processes, explicit bounds on subgeometric rates of convergence are obtained. These
results are illustrated in several examples.
Full-text: Access denied (no subscription detected)
We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber.
If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription.
Read more about accessing full-text
Alternatively, the document is available for a cost of $6. Select the "buy article" button below to purchase this document from a secured VeriSign, Inc. site.
References
Chen, M. F. (1992). From Markov Chains to Nonequilibrium Particle Systems. World Scientific, River Edge, NJ.
Doshi, B. (1985). An M/G/$1$ queue with variable vacations. In Proc. Internat. Conf. Model. Techniques Tools Performance Anal., North-Holland, Amsterdam, pp. 67--81.
Down, D., Meyn, S. P. and Tweedie, R. L. (1995). Exponential and uniform ergodicity of Markov processes. Ann. Prob. 23, 1671--1691.
Foss, S. and Sapozhnikov, A. (2004). On the existence of moments for the busy period in a single-server queue. Math. Operat. Res. 29, 592--601.
Fuhrman, S. (1984). A note on the M/G/$1$ queue with server vacations. Operat. Res. 32, 1368--1373.
Mathematical Reviews (MathSciNet):
MR775265
Gut, A. (1974). On the moments of some first passage times for sums of dependent random variables. Stoch. Process. Appl. 2, 115--126.
Mathematical Reviews (MathSciNet):
MR370737
Harris, C. and Marchal, W. (1988). State dependence in M/G/$1$ server vacation models. Operat. Res. 36, 560--565.
Mathematical Reviews (MathSciNet):
MR960256
Hou, Z. and Liu, Y. (2004). Explicit criteria for several types of ergodicity of the embedded M/G/$1$ and GI/M/$n$ queues. J. Appl. Prob. 41, 778--790.
Levy, H. and Kleinrock, L. (1986). A queue with starter and a queue with vacations: delay analysis by decompostition. Operat. Res. 34, 426--436.
Mathematical Reviews (MathSciNet):
MR862594
Levy, Y. and Yechiali, U. (1975). Utilization of idle time in an M/G/$1$ queueing system. Manag. Sci. 22, 202--211.
Lund, R. B., Meyn, S. P. and Tweedie, R. L. (1996). Computable exponential convergence rates for stochastically ordered Markov processes. Ann. Appl. Prob. 6, 218--237.
Mao, Y. H. (2004). Ergodic degrees for continuous-time Markov chains. Sci. China A 47, 161--174.
Meyn, S. P. and Tweedie, R. L. (1993). Stability of Markovian processes. II. Continuous-time processes and sampled chains. Adv. Appl. Prob. 25, 487--517.
Meyn, S. P. and Tweedie, R. L. (1993). Stability of Markovian processes. III. Foster--Lyapunov criteria for continuous-time processes. Adv. Appl. Prob. 25, 518--548.
Nummelin, E. and Tuominen, P. (1983). The rate of convergence in Orey's theorem for Harris recurrent Markov chains with applications to renewal theory. Stoch. Process. Appl. 15, 295--311.
Mathematical Reviews (MathSciNet):
MR711187
Thorisson, H. (1985). The queue GI/G/1: finite moments of the cycle variables and uniform rates of convergence. Stoch. Process. Appl. 19, 85--99.
Mathematical Reviews (MathSciNet):
MR780722
Tuominen, P. and Tweedie, R. L. (1979). Exponential ergodicity in Markovian queueing and dam models. J. Appl. Prob. 16, 867--880.
Mathematical Reviews (MathSciNet):
MR549565
Tuominen, P. and Tweedie, R. L. (1994). Subgeometric rates of convergence of $f$-ergodic Markov chains. Adv. Appl. Prob. 26, 775--798.
Van Doorn, E. A. (1981). Stochastic Monotonicity and Queueing Applications of Birth--Death Processes (Lecture Notes Statist. 4). Springer, New York.
Mathematical Reviews (MathSciNet):
MR606558