We prove a central limit theorem for the sequence of random
compositions of a two-color randomly reinforced urn. As a
consequence, we are able to show that the distribution of the urn
limit composition has no point masses.
References
Aletti, G., May, C. and Secchi, P. (2007). On the distribution of the limit proportion for a two-color, randomly reinforced urn with equal reinforcement distributions. Adv. Appl. Prob. 39, 690--707.
Beggs, A. W. (2005). On the convergence of reinforcement learning. J. Econom. Theory 122, 1--36.
Crimaldi, I. (2008). Almost sure conditional convergence for a generalized Pólya urn. Preprint, Dipartimento di Matematica, Università di Bologna. Available at: http://almadl.cib.unibo.it/.
Durham, S. D. and Yu, K. F. (1990). Randomized play-the leader rules for sequential sampling from two populations. Prob. Eng. Inf. Sci. 4, 355--367.
Durham, S. D., Flournoy, N. and Li, W. (1998). A sequential design for maximizing the probability of a favourable response. Canad. J. Statist. 26, 479--495.
Gibbs, A. L. and Su, F. E. (2002). On choosing and bounding probability metrics. Internat. Statist. Rev. 70, 419--435.
Hopkins, E. and Posch, M. (2005). Attainability of boundary points under reinforcement learning. Games Econom. Behavior 53, 110--125.
Li, W., Durham, S. D. and Flournoy, N. (1996). Randomized Pólya urn designs. In Proc. Biometric Section Amer. Statist. Assoc., American Statistical Association, Alexandria, VA, pp. 166--170.
May, C. and Flournoy, N. (2008). Asymptotics in response-adaptive designs generated by a two-color, randomly reinforced urn. Ann. Statist. 32, 1058--1078.
May, C., Paganoni, A. and Secchi, P. (2005). On a two color generalized Pólya urn. Metron 63, 115--134.
May, C., Paganoni, A. and Secchi, P. (2007). Response-adaptive designs targeting the best treatment for clinical trials with continuous responses. In S. Co. 2007 5th Conf. - Complex Models and Computational Intensive Methods for Estimation and Prediction, Cluep, Padova, pp. 326--331.
Mera, M. E., Morán, M., Preiss, D. and Zajíček, L. (2003). Porosity, $\sigma$-porosity and measures. Nonlinearity 16, 247--255.
Muliere, P., Paganoni, A. and Secchi, P. (2006). A randomly reinforced urn. J. Statist. Planning Infer. 136, 1853--1874.
Paganoni, A. M. and Secchi, P. (2007). A numerical study for comparing two response-adaptive designs for continuous treatment effects. Statist. Meth. Appl. 16, 321--346.
Pemantle, R. (1990). A time-dependent version of Pólya's urn. J. Theoret. Prob. 3, 627--637.
Pemantle, R. and Volkov, S. (1999). Vertex-reinforced random walk on $\bm Z$ has finite range. Ann. Prob. 27, 1368--1388.
Prokaj, V. (2001/02). On a construction of J. Tkadlec concerning $\sigma$-porous sets. Real Anal. Exchange 1, 269--273.
Račkauskas, A. (1990). On probabilities of large deviations for martingales. Litovsk. Mat. Sb. 30, 784--795 (in Russian). English translation: Lithuanian Math. J. 30 (1991), 376--384.
Tkadlec, J. (1986/87). Construction of a finite Borel measure with $\sigma$-porous sets as null sets. Real Anal. Exchange 1, 349--353.
Mathematical Reviews (MathSciNet):
MR873903
Zajíček, L. (2005). On $\sigma$-porous sets in abstract spaces. Abstr. Appl. Anal. 5, 509--534.