Journal of Applied Probability

Extinction probability in a birth-death process with killing

Erik A. Van Doorn and Alexander I. Zeifman

Source: J. Appl. Probab. Volume 42, Number 1 (2005), 185-198.

Abstract

We study birth-death processes on the nonnegative integers, where {1, 2,...} is an irreducible class and 0 an absorbing state, with the additional feature that a transition to state 0 may occur from any state. We give a condition for absorption (extinction) to be certain and obtain the eventual absorption probabilities when absorption is not certain. We also study the rate of convergence, as t → ∞, of the probability of absorption at time t, and relate it to the common rate of convergence of the transition probabilities that do not involve state 0. Finally, we derive upper and lower bounds for the probability of absorption at time t by applying a technique that involves the logarithmic norm of an appropriately defined operator.

Primary Subjects: 60J80
Secondary Subjects: 60J27
Keywords: Absorption; decay parameter; extinction time; persistence time; rate of convergence; logarithmic norm

Full-text: Access denied (no subscription detected)

We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber.
If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription. Read more about accessing full-text
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.jap/1110381380
Digital Object Identifier: doi:10.1239/jap/1110381380
Mathematical Reviews number (MathSciNet): MR2144903
Zentralblatt MATH identifier: 1083.60071

References

Anderson, W. J. (1991). Continuous-Time Markov Chains. Springer, New York.
Mathematical Reviews (MathSciNet): MR1118840
Zentralblatt MATH: 0731.60067
Bobrowski, A. (2004). Quasi-stationary distributions of a pair of Markov chains related to time evolution of a DNA locus. Adv. Appl. Prob. 36, 56--77.
Mathematical Reviews (MathSciNet): MR2035774
Digital Object Identifier: doi:10.1239/aap/1077134464
Brockwell, P. J. (1986). The extinction time of a general birth and death process with catastrophes. J. Appl. Prob. 23, 851--858.
Mathematical Reviews (MathSciNet): MR867182
Chen, A., Pollett, P., Zhang, H. and Cairns, B. (2004). Uniqueness criteria for continuous-time Markov chains with general transition structure. Preprint, University of Queensland.
Chen, M. F. (1991). Exponential $L^2$-convergence and $L^2$-spectral gap for Markov processes. Acta Math. Sinica (N.S.) 7, 19--37.
Mathematical Reviews (MathSciNet): MR1106707
Chen, M. F. (1996). Estimation of the spectral gap for Markov chains. Acta Math. Sinica (N.S.) 12, 337--360.
Mathematical Reviews (MathSciNet): MR1457859
Chihara, T. S. (1978). An Introduction to Orthogonal Polynomials. Gordon and Breach, New York.
Mathematical Reviews (MathSciNet): MR481884
Zentralblatt MATH: 0389.33008
Cohen, J. W. (1982). The Single Server Queue (North-Holland Ser. Appl. Math. Mech. 8), 2nd edn. North-Holland, Amsterdam.
Mathematical Reviews (MathSciNet): MR668697
Zentralblatt MATH: 0481.60003
Elmes, S., Pollett, P. and Walker, D. (2000). Further results on the relationship between $\mu$-invariant measures and quasi-stationary distributions for absorbing continuous-time Markov chains. Math. Comput. Modelling 31, 107--113.
Mathematical Reviews (MathSciNet): MR1768779
Digital Object Identifier: doi:10.1016/S0895-7177(00)00077-7
Feller, W. (1968). An Introduction to Probability Theory and Its Applications, Vol. 1, 3rd edn. John Wiley, New York.
Mathematical Reviews (MathSciNet): MR228020
Good, P. (1968). The limiting behavior of transient birth and death processes conditioned on survival. J. Austral. Math. Soc. 8, 716--722.
Mathematical Reviews (MathSciNet): MR240879
Granovsky, B. L. and Zeifman, A. I. (1997). The decay function of nonhomogeneous birth--death processes, with applications to mean-field models. Stoch. Process. Appl. 72, 105--120.
Mathematical Reviews (MathSciNet): MR1483614
Digital Object Identifier: doi:10.1016/S0304-4149(97)00085-9
Granovsky, B. L. and Zeifman, A. I. (2000). The $N$-limit of spectral gap of a class of birth--death Markov chains. Appl. Stoch. Models Business Industry 16, 235--248.
Mathematical Reviews (MathSciNet): MR1813663
Granovsky, B. L. and Zeifman, A. I. (2004). Nonstationary queues: estimation of the rate of convergence. Queueing Systems 46, 363--388.
Mathematical Reviews (MathSciNet): MR2068133
Digital Object Identifier: doi:10.1023/B:QUES.0000027991.19758.b4
Jacka, S. D. and Roberts, G. O. (1995). Weak convergence of conditioned processes on a countable state space. J. Appl. Prob. 32, 902--916.
Mathematical Reviews (MathSciNet): MR1363332
Karlin, S. and McGregor, J. L. (1957). The differential equations of birth-and-death processes, and the Stieltjes moment problem. Trans. Amer. Math. Soc. 85, 589--646.
Mathematical Reviews (MathSciNet): MR91566
Karlin, S. and Tavaré, S. (1982). Linear birth and death processes with killing. J. Appl. Prob. 19, 477--487.
Mathematical Reviews (MathSciNet): MR664833
Kartashov, N. V. (1998). Calculation of the exponential ergodicity exponent for birth--death processes. Theory Prob. Math. Statist. 57, 53--60.
Mathematical Reviews (MathSciNet): MR1806884
Kijima, M. (1992). Evaluation of the decay parameter for some specialized birth--death processes. J. Appl. Prob. 29, 781--791.
Mathematical Reviews (MathSciNet): MR1188535
Kingman, J. F. C. (1963). The exponential decay of Markov transition probabilities. Proc. London Math. Soc. 13, 337--358.
Mathematical Reviews (MathSciNet): MR152014
Lenin, R. B., Parthasarathy, P. R., Scheinhardt, W. R. W. and van Doorn, E. A. (2000). Families of birth--death processes with similar time-dependent behaviour. J. Appl. Prob. 37, 835--849.
Mathematical Reviews (MathSciNet): MR1782457
Digital Object Identifier: doi:10.1239/jap/1014842840
Pakes, A. G. (1995). Quasi-stationary laws for Markov processes: examples of an always proximate absorbing state. Adv. Appl. Prob. 27, 120--145.
Mathematical Reviews (MathSciNet): MR1315582
Van Doorn, E. A. (1985). Conditions for exponential ergodicity and bounds for the decay parameter of a birth--death process. Adv. Appl. Prob. 17, 514--530.
Mathematical Reviews (MathSciNet): MR798874
Van Doorn, E. A. (1991). Quasi-stationary distributions and convergence to quasi-stationarity of birth--death processes. Adv. Appl. Prob. 23, 683--700.
Mathematical Reviews (MathSciNet): MR1133722
Van Doorn, E. A. (2002). Representations for the rate of convergence of birth--death processes. Theory Prob. Math. Statist. 65, 37--43.
Mathematical Reviews (MathSciNet): MR1936126
Van Doorn, E. A. and Zeifman, A. I. (2005). Birth--death processes with killing. To appear in Statist. Prob. Lett.
Zeifman, A. I. (1991). Some estimates of the rate of convergence for birth and death processes. J. Appl. Prob. 28, 268--277.
Mathematical Reviews (MathSciNet): MR1104565
Zeifman, A. I. (1995). On the estimation of probabilities for birth and death processes. J. Appl. Prob. 32, 623--634.
Mathematical Reviews (MathSciNet): MR1344064
Zeifman, A. I. (1995). Upper and lower bounds on the rate of convergence for nonhomogeneous birth and death processes. Stoch. Process. Appl. 59, 157--173.
Mathematical Reviews (MathSciNet): MR1350261
Digital Object Identifier: doi:10.1016/0304-4149(95)00028-6

2010 © Applied Probability Trust