Source: Ann. Probab. Volume 30, Number 4
(2002), 1576-1604.
We consider the supremum $\mathcal{W}_n$ of self-normalized empirical processes indexed by unbounded classes of functions $\mathcal{F}$. Such variables are of interest in various statistical applications, for example, the likelihood ratio tests of contamination. Using the Herbst method, we prove an exponential concentration inequality for $\mathcal{W}_n$ under a second moment assumption on the envelope function of $\mathcal{F}$. This inequality is applied to obtain moderate deviations for $\mathcal{W}_n$. We also provide large deviations results for some unbounded parametric classes $\mathcal{F}$.
References
[1] ANDERSEN, N. T., GINÉ, E. OSSIANDER, M. and ZINN, J. (1988). The central limit theorem and the law of iterated logarithm for empirical processes under local conditions. Probab. Theory Related Fields 77 271-305.
[2] ARNOLD, V. (1974). Equations différentielles ordinaires. Mir, Moscow.
Mathematical Reviews (MathSciNet):
MR361232
[3] BARTLETT, P. and LUGOSI, G. (1999). An inequality for uniform deviations of sample averages from their means. Statist. Probab. Lett. 4 55-62.
[4] DACUNHA-CASTELLE, D. and GASSIAT, E. (1997). Testing in locally conic models, and application to mixture models. ESAIM Probab. Statist. 1 285-317.
[5] DACUNHA-CASTELLE, D. and GASSIAT, E. (1999). Testing the order of a model using locally conic parametrization: population mixtures and stationary ARMA processes. Ann. Statist. 27 1178-1209.
[6] DEMBO, A. and SHAO, Q. M. (1998). Self-normalized large deviations in vector spaces. In Proceedings of the Oberwolfach Meeting on High Dimensional Probability (E. Eberlein, M. Hahn and M. Talagrand, eds.) 28-32. Birkhäuser, Boston.
[7] DEMBO, A. and ZEITOUNI, O. (1998). Large Deviations Techniques and Applications, 2nd ed. Springer, New York.
[8] DUDLEY, R. (1978). Central limit theorems for empirical measures. Ann. Probab. 6 899-929.
[9] DUNFORD, N. and SCHWARTZ, J. T. (1953). Linear Operators. Part I: General Theory. Interscience, New York.
[10] GASSIAT, E. (2002). Likelihood ratio inequalities with applications to various mixtures. Ann. Inst. H. Poincaré Probab. Statist. To appear.
[11] GINÉ, E. (1996). Empirical processes and applications: an overview. Bernoulli 2 1-28.
[12] HAUSSLER, D. (1992). Decision theoretic generalizations of the PAC model for neural net and other learning applications. Inform. Comput. 100 78-150.
[13] KERIBIN, C. (1999). Tests de modèles par maximum de vraisemblance. Thèse de l'Université d'Evry-Val d'Essonne.
[14] KERIBIN, C. (2000). Consistent estimation of the order of mixture models. Sankhy¯a Ser. A 62 49-66.
[15] LEDOUX, M. (1996). On Talagrand's deviation inequalities for product measures. ESAIM Probab. Statist. 1 63-87.
[16] LEDOUX, M. (1992). Sur les déviations modérées des sommes de variables aléatoires vectorielles indépendantes de même loi. Ann. Inst. H. Poincaré Probab. Statist. 28 267-280.
[17] MASSART, P. (2000). About the constants in Talagrand's concentration inequalities for empirical processes. Ann. Probab. 28 863-884.
[18] MCDIARMID, C. (1998). Concentration. In Probabilistic Methods for Algorithmic Discrete Mathematics 195-248. Springer, Berlin.
[19] POLLARD, D. (1984). Convergence of Stochastic Processes. Springer, New York.
[20] POLLARD, D. (1995). Uniform ratio limit theorems for empirical processes. Scand. J. Statist. 22 271-278.
[21] RIO, E. (2001). Inégalités de concentration pour les processus empiriques: Classes de parties. Probab. Theory Related Fields 119 163-175.
[22] RIO, E. (2000). Inégalités exponentielles pour les processus empiriques. C. R. Acad. Sci. Paris Sér. I 330 597-600.
[23] SHAO, Q. M. (1997). Self-normalized large deviations. Ann. Probab. 25 285-328.
[24] TALAGRAND, M. (1996). New concentration inequalities for product spaces. Invent. Math. 126 505-563.
[25] TALAGRAND, M. (1995). Concentration of measure and isoperimetric inequalities in product spaces. Publ. Math. IHES 81 73-205.
[26] VAN DER VAART, A. and WELLNER, J. (1996). Weak Convergence and Empirical Processes. Springer, New York.
[27] VAN DER VAART, A. (1998). Asy mptotic Statistics. Cambridge Univ. Press.
[28] WU, L. M. (1994). Large deviations, moderate deviations and LIL for empirical processes. Ann. Probab. 22 17-27.