Critical random walks on two-dimensional complexes with applications to polling systems
I. M. MacPhee and M. V. Menshikov
Source: Ann. Appl. Probab.
Volume 13, Number 4
(2003), 1399-1422.
Abstract
We consider a time-homogeneous random walk $\Xi = \{\xi(t)\}$ on a
two-dimensional complex. All of our results here are formulated in a
constructive way. By this we mean that for any given random walk we
can, with an expression using only the first and second moments of
the jumps and the return probabilities for some transient
one-dimensional random walks, conclude whether the process is
ergodic, null-recurrent or transient. Further we can determine when
$p$th moments of passage times $\tau_K$ to sets $S_K = \{x \dvtx \|x\|
\leq K\}$ are finite ($p >0$, real). Our main interest is in a new
critical case where we will show the long-term behavior of the
random walk is very similar to that found for walks with zero mean
drift inside the quadrants. Recently a partial case of a polling
system model in the critical regime was investigated by Menshikov
and Zuyev who give explicit results in terms of the parameters of
the queueing model. This model and some others can be interpreted as
random walks on two-dimensional complexes.
Primary Subjects: 60G42, 60J10
Secondary Subjects: 90B22
Keywords: Random walk; two-dimensional complex; transience; recurrence; passage time moments; polling systems
Links and Identifiers
Permanent link to this document: http://projecteuclid.org/euclid.aoap/1069786503
Digital Object Identifier: doi:10.1214/aoap/1069786503
Mathematical Reviews number (MathSciNet):
MR2023881
Zentralblatt MATH identifier:
02063743
References
Asmussen, S. (1987). Applied Probability and Queues. Wiley, Chichester.
Mathematical Reviews (MathSciNet):
MR889893
Aspandiiarov, S., Iasnogorodski, R. and Menshikov, M. (1996). Passage-time moments for nonnegative stochastic processes and an application to reflected random walks in a quadrant. Ann. Probab. 24 932--960.
Asymont, I., Fayolle, G. and Menshikov, M. (1995). Random walks in a quarter plane with zero drifts: Transience and recurrence. J. Appl. Probab. 32 941--955.
Fayolle, G., Ignatyuk, I. A., Malyshev, V. A. and Menshikov, M. (1991). Random walks in two-dimensional complexes. Queueing Syst. Theory Appl. 9 269--300.
Fayolle, G., Malyshev, V. and Menshikov, M. (1992). Random walks in a quarter plane with zero drift. Ann. Inst. H. Poincaré 28 179--195.
Fayolle, G., Malyshev, V. and Menshikov, M. (1995). Topics in the Constructive Theory of Countable Markov Chains. Cambridge Univ. Press.
Foss, S. and Last, G. (1996). Stability of polling systems with exhaustive service policies and state-dependent routing. Ann. Appl. Probab. 6 116--137.
Lamperti, J. (1960). Criteria for the recurrence and transience of stochastic processes I. J. Math. Anal. Appl. 1 314--330.
Mathematical Reviews (MathSciNet):
MR126872
Lamperti, J. (1963). Criteria for stochastic processes II: Passage time moments. J. Math. Anal. Appl. 7 127--145.
Mathematical Reviews (MathSciNet):
MR159361
Malyshev, V. and Menshikov, M. (1981). Ergodicity, continuity and analyticity of countable Markov chains. Trans. Moscow Math. Soc. 39 1--48.
Menshikov, M. and Popov, S. Yu. (1995). Exact power estimates for countable Markov chains. Markov Process. Related Fields 1 57--78.
Menshikov, M. and Williams, R. J. (1996). Passage-time moments for continuous non-negative stochastic processes and applications. Adv. in Appl. Prob. 28 747--762.
Menshikov, M. and Zuyev, S. (2001). Polling systems in the critical regime. Stoch. Process. Appl. 92 201--218.
Varadhan, S. R. S. and Williams, R. J. (1985). Brownian motion in a wedge with oblique reflection. Comm. Pure Appl. Math. 38 405--443.
Mathematical Reviews (MathSciNet):
MR792398