On the convergence and limits of certain matrix sequences arising in quasi-birth-and-death Markov chains

Abstract

We study the convergence of certain matrix sequences that arise in quasi-birth-and-death (QBD) Markov chains and we identify their limits. In particular, we focus on a sequence of matrices whose elements are absorption probabilities into some boundary states of the QBD. We prove that, under certain technical conditions, that sequence converges. Its limit is either the minimal nonnegative solution G of the standard nonlinear matrix equation, or it is a stochastic solution that can be explicitly expressed in terms of G. Similar results are obtained relative to the standard matrix R that arises in the matrix-geometric solution of the QBD. We present numerical examples that clarify some of the technical issues of interest.