The Annals of Applied Probability

Generalized URN models of evolutionary processes

Michel Benaïm, Sebastian J. Schreiber, and Pierre Tarrès
Source: Ann. Appl. Probab. Volume 14, Number 3 (2004), 1455-1478.

Abstract

Generalized Pólya urn models can describe the dynamics of finite populations of interacting genotypes. Three basic questions these models can address are: Under what conditions does a population exhibit growth? On the event of growth, at what rate does the population increase? What is the long-term behavior of the distribution of genotypes? To address these questions, we associate a mean limit ordinary differential equation (ODE) with the urn model. Previously, it has been shown that on the event of population growth, the limiting distribution of genotypes is a connected internally chain recurrent set for the mean limit ODE. To determine when growth and convergence occurs with positive probability, we prove two results. First, if the mean limit ODE has an “attainable” attractor at which growth is expected, then growth and convergence toward this attractor occurs with positive probability. Second, the population distribution almost surely does not converge to sets where growth is not expected and almost surely does not converge to “nondegenerate” unstable equilibria or periodic orbits of the mean limit ODE. Applications to stochastic analogs of the replicator equations and fertility-selection equations of population genetics are given.

First Page: Show Hide
Primary Subjects: 60J10
Secondary Subjects: 92D25
Full-text: Open access
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aoap/1089736292
Digital Object Identifier: doi:10.1214/105051604000000422
Mathematical Reviews number (MathSciNet): MR2071430
Zentralblatt MATH identifier: 1051.60072

References

Arthur, B., Ermol'ev, Y. and Kaniovskii, Y. (1983). A generalized urn problem and its applications. Cybernetics 19 61--71.
Benaïm, M. (1996). A dynamical systems approach to stochastic approximations. SIAM J. Control Optim. 34 437--472.
Mathematical Reviews (MathSciNet): MR1377706
Digital Object Identifier: doi:10.1137/S0363012993253534
Zentralblatt MATH: 0841.62072
Benaïm, M. (1997). Vertex-reinforced random walks and a conjecture of Pemantle. Ann. Probab. 25 361--392.
Mathematical Reviews (MathSciNet): MR1428513
Digital Object Identifier: doi:10.1214/aop/1024404292
Project Euclid: euclid.aop/1024404292
Zentralblatt MATH: 0873.60044
Benaïm, M. (1999). Dynamics of stochastic approximation algorithms. Séminaire de Probabilités. Lecture Notes in Math. 1709 1--68. Springer, Berlin.
Mathematical Reviews (MathSciNet): MR1767993
Benaïm, M. and Hirsch, M. W. (1995). Dynamics of Morse--Smale urn processes. Ergodic Theory Dynam. Systems 15 1005--1030.
Mathematical Reviews (MathSciNet): MR1366305
Benaïm, M. and Hirsch, M. W. (1996). Asymptotic pseudotrajectories and chain recurrent flows, with applications. J. Dynam. Differential Equations 8 141--176.
Mathematical Reviews (MathSciNet): MR1388167
Digital Object Identifier: doi:10.1007/BF02218617
Zentralblatt MATH: 0878.58053
Durrett, R. (1996). Probability: Theory and Examples, 2nd ed. Duxbury Press, Boston.
Mathematical Reviews (MathSciNet): MR1609153
Hill, B. M., Lane, D. and Sudderth, W. (1980). A strong law for some generalized urn processes. Ann. Probab. 8 214--226.
Mathematical Reviews (MathSciNet): MR566589
Hofbauer, J. and Sigmund, K. (1998). Evolutionary Games and Population Dynamics. Cambridge Univ. Press.
Mathematical Reviews (MathSciNet): MR1635735
Zentralblatt MATH: 0914.90287
Pemantle, R. (1990). Nonconvergence to unstable points in urn models and stochastic approximations. Ann. Probab. 18 698--712.
Mathematical Reviews (MathSciNet): MR1055428
Posch, M. (1997). Cycling in a stochastic learning algorithm for normal form games. Journal of Evolutionary Economics 7 193--207.
Schreiber, S. J. (2001). Urn models, replicator processes, and random genetic drift. SIAM J. Appl. Math. 61 2148--2167.
Mathematical Reviews (MathSciNet): MR1856886
Digital Object Identifier: doi:10.1137/S0036139999352857
Zentralblatt MATH: 0993.92026
Tarrès, P. (2000). Pièges répulsifs. Comptes Rendus de l'Académie des Sciences Sér. I Math 330 125--130.
Mathematical Reviews (MathSciNet): MR1745175
Digital Object Identifier: doi:10.1016/S0764-4442(00)00139-7

2012 © Institute of Mathematical Statistics

The Annals of Applied Probability

The Annals of Applied Probability