The Annals of Applied Probability

Critical random walks on two-dimensional complexes with applications to polling systems

I. M. MacPhee and M. V. Menshikov

Source: Ann. Appl. Probab. Volume 13, Number 4 (2003), 1399-1422.

Abstract

We consider a time-homogeneous random walk $\Xi = \{\xi(t)\}$ on a two-dimensional complex. All of our results here are formulated in a constructive way. By this we mean that for any given random walk we can, with an expression using only the first and second moments of the jumps and the return probabilities for some transient one-dimensional random walks, conclude whether the process is ergodic, null-recurrent or transient. Further we can determine when $p$th moments of passage times $\tau_K$ to sets $S_K = \{x \dvtx \|x\| \leq K\}$ are finite ($p >0$, real). Our main interest is in a new critical case where we will show the long-term behavior of the random walk is very similar to that found for walks with zero mean drift inside the quadrants. Recently a partial case of a polling system model in the critical regime was investigated by Menshikov and Zuyev who give explicit results in terms of the parameters of the queueing model. This model and some others can be interpreted as random walks on two-dimensional complexes.

Primary Subjects: 60G42, 60J10
Secondary Subjects: 90B22
Keywords: Random walk; two-dimensional complex; transience; recurrence; passage time moments; polling systems

Full-text: Open access

Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aoap/1069786503
Digital Object Identifier: doi:10.1214/aoap/1069786503
Mathematical Reviews number (MathSciNet): MR2023881
Zentralblatt MATH identifier: 02063743

References

Asmussen, S. (1987). Applied Probability and Queues. Wiley, Chichester.
Mathematical Reviews (MathSciNet): MR889893
Zentralblatt MATH: 0624.60098
Aspandiiarov, S., Iasnogorodski, R. and Menshikov, M. (1996). Passage-time moments for nonnegative stochastic processes and an application to reflected random walks in a quadrant. Ann. Probab. 24 932--960.
Mathematical Reviews (MathSciNet): MR1404537
Digital Object Identifier: doi:10.1214/aop/1039639371
Project Euclid: euclid.aop/1039639371
Asymont, I., Fayolle, G. and Menshikov, M. (1995). Random walks in a quarter plane with zero drifts: Transience and recurrence. J. Appl. Probab. 32 941--955.
Mathematical Reviews (MathSciNet): MR1363336
Fayolle, G., Ignatyuk, I. A., Malyshev, V. A. and Menshikov, M. (1991). Random walks in two-dimensional complexes. Queueing Syst. Theory Appl. 9 269--300.
Mathematical Reviews (MathSciNet): MR1132178
Digital Object Identifier: doi:10.1007/BF01158467
Fayolle, G., Malyshev, V. and Menshikov, M. (1992). Random walks in a quarter plane with zero drift. Ann. Inst. H. Poincaré 28 179--195.
Fayolle, G., Malyshev, V. and Menshikov, M. (1995). Topics in the Constructive Theory of Countable Markov Chains. Cambridge Univ. Press.
Mathematical Reviews (MathSciNet): MR1331145
Zentralblatt MATH: 0823.60053
Foss, S. and Last, G. (1996). Stability of polling systems with exhaustive service policies and state-dependent routing. Ann. Appl. Probab. 6 116--137.
Mathematical Reviews (MathSciNet): MR1389834
Digital Object Identifier: doi:10.1214/aoap/1034968068
Project Euclid: euclid.aoap/1034968068
Lamperti, J. (1960). Criteria for the recurrence and transience of stochastic processes I. J. Math. Anal. Appl. 1 314--330.
Mathematical Reviews (MathSciNet): MR126872
Digital Object Identifier: doi:10.1016/0022-247X(60)90005-6
Lamperti, J. (1963). Criteria for stochastic processes II: Passage time moments. J. Math. Anal. Appl. 7 127--145.
Mathematical Reviews (MathSciNet): MR159361
Digital Object Identifier: doi:10.1016/0022-247X(63)90083-0
Malyshev, V. and Menshikov, M. (1981). Ergodicity, continuity and analyticity of countable Markov chains. Trans. Moscow Math. Soc. 39 1--48.
Menshikov, M. and Popov, S. Yu. (1995). Exact power estimates for countable Markov chains. Markov Process. Related Fields 1 57--78.
Mathematical Reviews (MathSciNet): MR1403077
Menshikov, M. and Williams, R. J. (1996). Passage-time moments for continuous non-negative stochastic processes and applications. Adv. in Appl. Prob. 28 747--762.
Mathematical Reviews (MathSciNet): MR1404308
Menshikov, M. and Zuyev, S. (2001). Polling systems in the critical regime. Stoch. Process. Appl. 92 201--218.
Mathematical Reviews (MathSciNet): MR1817586
Digital Object Identifier: doi:10.1016/S0304-4149(00)00087-9
Varadhan, S. R. S. and Williams, R. J. (1985). Brownian motion in a wedge with oblique reflection. Comm. Pure Appl. Math. 38 405--443.
Mathematical Reviews (MathSciNet): MR792398

2010 © Institute of Mathematical Statistics