The Annals of Probability

Vertex-Reinforced Random Walk on Z Has Finite Range

Robin Pemantle and Stanislav Volkov

Full-text: Open access

Abstract

A stochastic process called vertex-reinforced random walk (VRRW) is defined in Pemantle [Ann. Probab. 16 1229–1241] . We consider this process in the case where the underlying graph is an infinite chain (i.e., the one-dimensional integer lattice). We show that the range is almost surely finite, that at least five points are visited infinitely often almost surely and that with positive probability the range contains exactly five points. There are always points visited infinitely often but at a set of times of zero density, and we show that the number of visits to such a point to time $n$ may be asymptotically $n ^[\alpha}$ for a dense set of values $\alpha \in (0,1)$. The power law analysis relies on analysis of a related urn model.

Article information

Source
Ann. Probab., Volume 27, Number 3 (1999), 1368-1388.

Dates
First available in Project Euclid: 29 May 2002

Permanent link to this document
https://projecteuclid.org/euclid.aop/1022677452

Digital Object Identifier
doi:10.1214/aop/1022677452

Mathematical Reviews number (MathSciNet)
MR1733153

Zentralblatt MATH identifier
0960.60041

Subjects
Primary: 60G17: Sample path properties
Secondary: 60J20

Keywords
Vertex-reinforced random walk Reinforced random walk VRRW Urn model Bernard Friedman’s urn

Citation

Pemantle, Robin; Volkov, Stanislav. Vertex-Reinforced Random Walk on Z Has Finite Range. Ann. Probab. 27 (1999), no. 3, 1368--1388. doi:10.1214/aop/1022677452. https://projecteuclid.org/euclid.aop/1022677452


Export citation

References

  • ARTHUR, B. 1986. Industry location patterns and the importance of history. Center for Economic Policy Research Paper 84. Stanford Univ.
  • ARTHUR, B., ERMOLIEV, Y. and KANIOVSKI, Y. 1987. Path-dependent processes and the emergence of macro-structure. European J. Oper. Res. 30 294 303.
  • ATHREYA, K. 1967. Doctoral dissertation, Stanford Univ.
  • ATHREYA, K. and NEY, P. 1972. Branching Processes. Springer, New York.
  • BLACKWELL, D. and MCQUEEN, J. 1973. Ferguson distributions via Polya urn schemes. Ann. ´ Math. Statist. 1 353 355.
  • COOPERSMITH, D. and DIACONIS, P. 1987. Random walks with reinforcement. Unpublished manuscript.
  • DAVIS, B. 1990. Reinforced random walk. Probab. Theory Related Fields 84 203 229. ¨
  • EGGENBERGER, F. and POLYA, G. 1923. Uber die Statistik verketter Vorgange. Zeit. Angew. ´ ¨ Math. Mech. 3 279 289.
  • FELLER, W. 1971. Introduction to Probability Theory and Its Applications, 2nd ed. Wiley, New York.
  • FREEDMAN, D. 1965. Bernard Friedman's urn. Ann. Math. Statist. 36 956 970.
  • FRIEDMAN, B. 1949. A simple urn model. Comm. Pure Appl. Math. 2 59 70.
  • GREENWOOD, M. and YULE, G. U. 1920. Inquiry into the nature of frequency distributions representative of multiple happenings with particular reference to the occurrence of multiple attacks of disease or of repeated accidents. J. Roy. Statist. Soc. 83 255 279.
  • IOSIFESCU, M. and THEODORESCU, R. 1969. Random Processes and Learning. Springer, New York.
  • KUSHNER, H. and YIN, G. 1997. Stochastic Approximation Algorithms and Applications. Springer, New York.
  • MAULDIN, D., SUDDERTH, B. and WILLIAMS, S. 1992. Polya trees and random distributions. Ann. ´ Math. Statist. 20 1203 1221.
  • OTHMER, H. and STEVENS, A. 1998. Aggregation, blowup, and collapse: the ABC's of taxis in reinforced random walk. SIAM J. Appl. Math. 57 1044 1081.
  • PEMANTLE, R. 1988a. Random processes with reinforcement. Ph.D. dissertation, MIT.
  • PEMANTLE, R. 1988b. Phase transition in reinforced random walk and RWRE on trees. Ann. Probab. 16 1229 1241.
  • PEMANTLE, R. 1992. Vertex reinforced random walk. Probab. Theory Related Fields 92 117 136.
  • ROBBINS, H. and MONRO, S. 1951. A stochastic approximation method. Ann. Math. Statist. 22 400 407.
  • SELLKE, T. 1994. Reinforced random walk on the d-dimensional integer lattice. Preprint.
  • MADISON, WISCONSIN 53706 CANADA M5T 3J1