Advances in Applied Probability

A central limit theorem, and related results, for a two-color randomly reinforced urn

Aletti Giacomo, May Caterina, and Secchi Piercesare

Source: Adv. in Appl. Probab. Volume 41, Number 3 (2009), 829-844.

Abstract

We prove a central limit theorem for the sequence of random compositions of a two-color randomly reinforced urn. As a consequence, we are able to show that the distribution of the urn limit composition has no point masses.

Primary Subjects: 60F05
Keywords: Reinforced processes; generalized Pólya urn; convergence of conditional distributions

Full-text: Access denied (no subscription detected)

We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber.
If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription. Read more about accessing full-text
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aap/1253281065
Digital Object Identifier: doi:10.1239/aap/1253281065
Zentralblatt MATH identifier: 05625069

References

Aletti, G., May, C. and Secchi, P. (2007). On the distribution of the limit proportion for a two-color, randomly reinforced urn with equal reinforcement distributions. Adv. Appl. Prob. 39, 690--707.
Mathematical Reviews (MathSciNet): MR2357377
Zentralblatt MATH: 1135.60008
Digital Object Identifier: doi:10.1239/aap/1189518634
Project Euclid: euclid.aap/1189518634
Beggs, A. W. (2005). On the convergence of reinforcement learning. J. Econom. Theory 122, 1--36.
Mathematical Reviews (MathSciNet): MR2131871
Zentralblatt MATH: 1118.91025
Digital Object Identifier: doi:10.1016/j.jet.2004.03.008
Crimaldi, I. (2008). Almost sure conditional convergence for a generalized Pólya urn. Preprint, Dipartimento di Matematica, Università di Bologna. Available at: http://almadl.cib.unibo.it/.
Durham, S. D. and Yu, K. F. (1990). Randomized play-the leader rules for sequential sampling from two populations. Prob. Eng. Inf. Sci. 4, 355--367.
Durham, S. D., Flournoy, N. and Li, W. (1998). A sequential design for maximizing the probability of a favourable response. Canad. J. Statist. 26, 479--495.
Mathematical Reviews (MathSciNet): MR1646698
Digital Object Identifier: doi:10.2307/3315771
Gibbs, A. L. and Su, F. E. (2002). On choosing and bounding probability metrics. Internat. Statist. Rev. 70, 419--435.
Hopkins, E. and Posch, M. (2005). Attainability of boundary points under reinforcement learning. Games Econom. Behavior 53, 110--125.
Mathematical Reviews (MathSciNet): MR2173863
Zentralblatt MATH: 1118.91026
Digital Object Identifier: doi:10.1016/j.geb.2004.08.002
Li, W., Durham, S. D. and Flournoy, N. (1996). Randomized Pólya urn designs. In Proc. Biometric Section Amer. Statist. Assoc., American Statistical Association, Alexandria, VA, pp. 166--170.
May, C. and Flournoy, N. (2008). Asymptotics in response-adaptive designs generated by a two-color, randomly reinforced urn. Ann. Statist. 32, 1058--1078.
Mathematical Reviews (MathSciNet): MR2502661
Zentralblatt MATH: 1162.62076
Digital Object Identifier: doi:10.1214/08-AOS596
Project Euclid: euclid.aos/1236693160
May, C., Paganoni, A. and Secchi, P. (2005). On a two color generalized Pólya urn. Metron 63, 115--134.
Mathematical Reviews (MathSciNet): MR2200975
May, C., Paganoni, A. and Secchi, P. (2007). Response-adaptive designs targeting the best treatment for clinical trials with continuous responses. In S. Co. 2007 5th Conf. - Complex Models and Computational Intensive Methods for Estimation and Prediction, Cluep, Padova, pp. 326--331.
Mera, M. E., Morán, M., Preiss, D. and Zajíček, L. (2003). Porosity, $\sigma$-porosity and measures. Nonlinearity 16, 247--255.
Mathematical Reviews (MathSciNet): MR1950786
Zentralblatt MATH: 1026.28001
Digital Object Identifier: doi:10.1088/0951-7715/16/1/315
Muliere, P., Paganoni, A. and Secchi, P. (2006). A randomly reinforced urn. J. Statist. Planning Infer. 136, 1853--1874.
Mathematical Reviews (MathSciNet): MR2255601
Zentralblatt MATH: 1090.62082
Digital Object Identifier: doi:10.1016/j.jspi.2005.08.009
Paganoni, A. M. and Secchi, P. (2007). A numerical study for comparing two response-adaptive designs for continuous treatment effects. Statist. Meth. Appl. 16, 321--346.
Mathematical Reviews (MathSciNet): MR2413518
Pemantle, R. (1990). A time-dependent version of Pólya's urn. J. Theoret. Prob. 3, 627--637.
Mathematical Reviews (MathSciNet): MR1067672
Digital Object Identifier: doi:10.1007/BF01046101
Pemantle, R. and Volkov, S. (1999). Vertex-reinforced random walk on $\bm Z$ has finite range. Ann. Prob. 27, 1368--1388.
Mathematical Reviews (MathSciNet): MR1733153
Zentralblatt MATH: 0960.60041
Digital Object Identifier: doi:10.1214/aop/1022677452
Project Euclid: euclid.aop/1022677452
Prokaj, V. (2001/02). On a construction of J. Tkadlec concerning $\sigma$-porous sets. Real Anal. Exchange 1, 269--273.
Mathematical Reviews (MathSciNet): MR1887857
Zentralblatt MATH: 1009.28009
Project Euclid: euclid.rae/1212763966
Račkauskas, A. (1990). On probabilities of large deviations for martingales. Litovsk. Mat. Sb. 30, 784--795 (in Russian). English translation: Lithuanian Math. J. 30 (1991), 376--384.
Mathematical Reviews (MathSciNet): MR1091658
Tkadlec, J. (1986/87). Construction of a finite Borel measure with $\sigma$-porous sets as null sets. Real Anal. Exchange 1, 349--353.
Mathematical Reviews (MathSciNet): MR873903
Zajíček, L. (2005). On $\sigma$-porous sets in abstract spaces. Abstr. Appl. Anal. 5, 509--534.
Mathematical Reviews (MathSciNet): MR2201041
Zentralblatt MATH: 1098.28003

2009 © Applied Probability Trust