Two-player nonZero–sum stopping games in discrete time



The Annals of Probability

Two-player nonZero–sum stopping games in discrete time

Eran Shmaya and Eilon Solan

Source: Ann. Probab. Volume 32, Number 3B (2004), 2733-2764.

Abstract

We prove that every two-player nonzero–sum stopping game in discrete time admits an ɛ-equilibrium in randomized strategies for every ɛ>0. We use a stochastic variation of Ramsey’s theorem, which enables us to reduce the problem to that of studying properties of ɛ-equilibria in a simple class of stochastic games with finite state space.

Primary Subjects: 60G40
Secondary Subjects: 91A15, 91A05
Keywords: Stopping games; Dynkin games; stochastic games; ɛ-equilibrium; randomized stopping times

Full-text: Open access

Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aop/1091813629
Digital Object Identifier: doi:10.1214/009117904000000162
Mathematical Reviews number (MathSciNet): MR2078556

References

Alario-Nazaret, M., Lepeltier, J. P. and Marchal, B. (1982). Dynkin games. Stochastic Differential Systems. Lecture Notes in Control and Inform. Sci. 43 23--32. Springer, Berlin.
Mathematical Reviews (MathSciNet): MR814103
Digital Object Identifier: doi:10.1007/BFb0044285
Bismut, J. M. (1977). Sur un problème de Dynkin. Z. Wahrsch. Verw. Gebiete 39 31--53.
Mathematical Reviews (MathSciNet): MR444218
Digital Object Identifier: doi:10.1007/BF01844871
Cvitanić, J. and Karatzas, I. (1996). Backward stochastic differential equations with reflection and Dynkin games. Ann. Probab. 24 2024--2056.
Mathematical Reviews (MathSciNet): MR1415239
Digital Object Identifier: doi:10.1214/aop/1041903216
Project Euclid: euclid.aop/1041903216
Dynkin, E. B. (1969). Game variant of a problem on optimal stopping. Soviet Math. Dokl. 10 270--274.
Flesch, J., Thuijsman, F. and Vrieze, O. J. (1996). Recursive repeated games with absorbing states. Math. Oper. Res. 21 1016--1022.
Mathematical Reviews (MathSciNet): MR1419915
Flesch, J., Thuijsman, F. and Vrieze, O. J. (1997). Cyclic Markov equilibria in stochastic games. Internat. J. Game Theory 26 303--314.
Mathematical Reviews (MathSciNet): MR1467832
Laraki, R. and Solan, E. (2002). Stopping games in continuous time. Preprint.
Lepeltier, J. P. and Maingueneau, M. A. (1984). Le jeu de Dynkin en thèorie gènèrale sans l`hypothèse de Mokobodski. Stochastics 13 25--44.
Mathematical Reviews (MathSciNet): MR752475
Mamer, J. W. (1987). Monotone stopping games. J. Appl. Probab. 24 386--401.
Mathematical Reviews (MathSciNet): MR889803
Morimoto, H. (1986). Non-zero--sum discrete parameter stochastic games with stopping times. Probab. Theory Related Fields 72 155--160.
Mathematical Reviews (MathSciNet): MR835164
Digital Object Identifier: doi:10.1007/BF00343901
Neumann, P., Ramsey, D. and Szajowski, K. (2002). Randomized stopping times in Dynkin games. Z. Angew. Math. Mech. 82 811--819.
Mathematical Reviews (MathSciNet): MR1944424
Neveu, J. (1975). Discrete-Parameter Martingales. North-Holland, Amsterdam.
Mathematical Reviews (MathSciNet): MR402915
Zentralblatt MATH: 0345.60026
Nowak, A. S. and Szajowski, K. (1999). Nonzero-sum stochastic games. In Stochastic and Differential Games (M. Bardi, T. E. S. Raghavan and T. Parthasarathy, eds.) 297--342. Birkhäuser, Boston.
Mathematical Reviews (MathSciNet): MR1678287
Ohtsubo, Y. (1987). A nonzero--sum extension of Dynkin's stopping problem. Math. Oper. Res. 12 277--296.
Mathematical Reviews (MathSciNet): MR888977
Ohtsubo, Y. (1991). On a discrete-time non-zero--sum Dynkin problem with monotonicity. J. Appl. Probab. 28 466--472.
Mathematical Reviews (MathSciNet): MR1104581
Ramsey, F. P. (1930). On a problem of formal logic. Proc. London Math. Soc. 30 264--286.
Rosenberg, D., Solan, E. and Vieille, N. (2001). Stopping games with randomized strategies. Probab. Theory Related Fields 119 433--451.
Mathematical Reviews (MathSciNet): MR1821142
Digital Object Identifier: doi:10.1007/PL00008766
Shapley, L. S. (1953). Stochastic games. Proc. Nat. Acad. Sci. U.S.A. 39 1095--1100.
Mathematical Reviews (MathSciNet): MR61807
Shmaya, E., Solan, E. and Vieille, N. (2003). An application of Ramsey theorem to stopping games. Games Econom. Behav. 42 300--306.
Mathematical Reviews (MathSciNet): MR1984248
Digital Object Identifier: doi:10.1016/S0899-8256(02)00539-0
Solan, E. (1999). Three-person absorbing games. Math. Oper. Res. 24 669--698.
Mathematical Reviews (MathSciNet): MR1854248
Solan, E. (2001). The dynamics of the Nash correspondence and $n$-player stochastic games. International Game Theory Review 3 291--300.
Mathematical Reviews (MathSciNet): MR1885794
Digital Object Identifier: doi:10.1142/S0219198901000488
Solan, E. and Vieille, N. (2001). Quitting games. Math. Oper. Res. 26 265--285.
Mathematical Reviews (MathSciNet): MR1895828
Digital Object Identifier: doi:10.1287/moor.26.2.265.10549
Touzi, N. and Vieille, N. (2002). Continuous-time Dynkin games with mixed strategies. SIAM J. Control Opttim. 41 1073--1088.
Mathematical Reviews (MathSciNet): MR1972503
Digital Object Identifier: doi:10.1137/S0363012900369812
Vrieze, O. J. and Thuijsman, F. (1989). On equilibria in repeated games with absorbing states. Internat. J. Game Theory 18 293--310.
Mathematical Reviews (MathSciNet): MR1024959
Digital Object Identifier: doi:10.1007/BF01254293

2008 © Institute of Mathematical Statistics