The Annals of Probability

Concentration inequalities, large and moderate deviations for self-normalized empirical processes

Bernard Bercu, Elisabeth Gassiat, and Emmanuel Rio
Source: Ann. Probab. Volume 30, Number 4 (2002), 1576-1604.

Abstract

We consider the supremum $\mathcal{W}_n$ of self-normalized empirical processes indexed by unbounded classes of functions $\mathcal{F}$. Such variables are of interest in various statistical applications, for example, the likelihood ratio tests of contamination. Using the Herbst method, we prove an exponential concentration inequality for $\mathcal{W}_n$ under a second moment assumption on the envelope function of $\mathcal{F}$. This inequality is applied to obtain moderate deviations for $\mathcal{W}_n$. We also provide large deviations results for some unbounded parametric classes $\mathcal{F}$.

First Page: Show Hide
Primary Subjects: 60E15, 60F10
Secondary Subjects: 62E20, 62F05
Full-text: Open access
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aop/1039548367
Digital Object Identifier: doi:10.1214/aop/1039548367
Mathematical Reviews number (MathSciNet): MR1944001
Zentralblatt MATH identifier: 1021.60013

References

[1] ANDERSEN, N. T., GINÉ, E. OSSIANDER, M. and ZINN, J. (1988). The central limit theorem and the law of iterated logarithm for empirical processes under local conditions. Probab. Theory Related Fields 77 271-305.
Mathematical Reviews (MathSciNet): MR89g:60009
Zentralblatt MATH: 0618.60022
Digital Object Identifier: doi:10.1007/BF00334041
[2] ARNOLD, V. (1974). Equations différentielles ordinaires. Mir, Moscow.
Mathematical Reviews (MathSciNet): MR361232
[3] BARTLETT, P. and LUGOSI, G. (1999). An inequality for uniform deviations of sample averages from their means. Statist. Probab. Lett. 4 55-62.
Mathematical Reviews (MathSciNet): MR2001c:60030
Zentralblatt MATH: 0974.62007
[4] DACUNHA-CASTELLE, D. and GASSIAT, E. (1997). Testing in locally conic models, and application to mixture models. ESAIM Probab. Statist. 1 285-317.
Zentralblatt MATH: 1007.62507
Mathematical Reviews (MathSciNet): MR1468112
Digital Object Identifier: doi:10.1051/ps:1997111
[5] DACUNHA-CASTELLE, D. and GASSIAT, E. (1999). Testing the order of a model using locally conic parametrization: population mixtures and stationary ARMA processes. Ann. Statist. 27 1178-1209.
Mathematical Reviews (MathSciNet): MR2003a:62031
Zentralblatt MATH: 0957.62073
Digital Object Identifier: doi:10.1214/aos/1017938921
Project Euclid: euclid.aos/1017938921
[6] DEMBO, A. and SHAO, Q. M. (1998). Self-normalized large deviations in vector spaces. In Proceedings of the Oberwolfach Meeting on High Dimensional Probability (E. Eberlein, M. Hahn and M. Talagrand, eds.) 28-32. Birkhäuser, Boston.
Mathematical Reviews (MathSciNet): MR99j:60036
Zentralblatt MATH: 0910.60011
[7] DEMBO, A. and ZEITOUNI, O. (1998). Large Deviations Techniques and Applications, 2nd ed. Springer, New York.
Mathematical Reviews (MathSciNet): MR99d:60030
[8] DUDLEY, R. (1978). Central limit theorems for empirical measures. Ann. Probab. 6 899-929.
Mathematical Reviews (MathSciNet): MR81k:60029a
Zentralblatt MATH: 0404.60016
Digital Object Identifier: doi:10.1214/aop/1176995384
Project Euclid: euclid.aop/1176995384
[9] DUNFORD, N. and SCHWARTZ, J. T. (1953). Linear Operators. Part I: General Theory. Interscience, New York.
Mathematical Reviews (MathSciNet): MR1009162
Zentralblatt MATH: 0635.47001
[10] GASSIAT, E. (2002). Likelihood ratio inequalities with applications to various mixtures. Ann. Inst. H. Poincaré Probab. Statist. To appear.
Mathematical Reviews (MathSciNet): MR1955343
Zentralblatt MATH: 1011.62025
Digital Object Identifier: doi:10.1016/S0246-0203(02)01125-1
[11] GINÉ, E. (1996). Empirical processes and applications: an overview. Bernoulli 2 1-28.
Mathematical Reviews (MathSciNet): MR1394050
Digital Object Identifier: doi:10.2307/3318565
Project Euclid: euclid.bj/1193758786
[12] HAUSSLER, D. (1992). Decision theoretic generalizations of the PAC model for neural net and other learning applications. Inform. Comput. 100 78-150.
Mathematical Reviews (MathSciNet): MR93i:68149
Zentralblatt MATH: 0762.68050
Digital Object Identifier: doi:10.1016/0890-5401(92)90010-D
[13] KERIBIN, C. (1999). Tests de modèles par maximum de vraisemblance. Thèse de l'Université d'Evry-Val d'Essonne.
[14] KERIBIN, C. (2000). Consistent estimation of the order of mixture models. Sankhy¯a Ser. A 62 49-66.
Mathematical Reviews (MathSciNet): MR2001c:62026
Zentralblatt MATH: 01644942
[15] LEDOUX, M. (1996). On Talagrand's deviation inequalities for product measures. ESAIM Probab. Statist. 1 63-87.
Zentralblatt MATH: 0869.60013
Mathematical Reviews (MathSciNet): MR1399224
Digital Object Identifier: doi:10.1051/ps:1997103
[16] LEDOUX, M. (1992). Sur les déviations modérées des sommes de variables aléatoires vectorielles indépendantes de même loi. Ann. Inst. H. Poincaré Probab. Statist. 28 267-280.
Zentralblatt MATH: 0751.60009
[17] MASSART, P. (2000). About the constants in Talagrand's concentration inequalities for empirical processes. Ann. Probab. 28 863-884.
Mathematical Reviews (MathSciNet): MR2001m:60038
Zentralblatt MATH: 01905939
Digital Object Identifier: doi:10.1214/aop/1019160263
Project Euclid: euclid.aop/1019160263
[18] MCDIARMID, C. (1998). Concentration. In Probabilistic Methods for Algorithmic Discrete Mathematics 195-248. Springer, Berlin.
Mathematical Reviews (MathSciNet): MR2000d:60032
[19] POLLARD, D. (1984). Convergence of Stochastic Processes. Springer, New York.
Mathematical Reviews (MathSciNet): MR86i:60074
Zentralblatt MATH: 0544.60045
[20] POLLARD, D. (1995). Uniform ratio limit theorems for empirical processes. Scand. J. Statist. 22 271-278.
Mathematical Reviews (MathSciNet): MR97g:60010
[21] RIO, E. (2001). Inégalités de concentration pour les processus empiriques: Classes de parties. Probab. Theory Related Fields 119 163-175.
Mathematical Reviews (MathSciNet): MR2001m:60042
Digital Object Identifier: doi:10.1007/PL00008756
[22] RIO, E. (2000). Inégalités exponentielles pour les processus empiriques. C. R. Acad. Sci. Paris Sér. I 330 597-600.
Mathematical Reviews (MathSciNet): MR2000m:60020
Digital Object Identifier: doi:10.1016/S0764-4442(00)00210-X
[23] SHAO, Q. M. (1997). Self-normalized large deviations. Ann. Probab. 25 285-328.
Zentralblatt MATH: 0873.60017
Mathematical Reviews (MathSciNet): MR1428510
Digital Object Identifier: doi:10.1214/aop/1024404289
Project Euclid: euclid.aop/1024404289
[24] TALAGRAND, M. (1996). New concentration inequalities for product spaces. Invent. Math. 126 505-563.
Mathematical Reviews (MathSciNet): MR99b:60030
Zentralblatt MATH: 0893.60001
Digital Object Identifier: doi:10.1007/s002220050108
[25] TALAGRAND, M. (1995). Concentration of measure and isoperimetric inequalities in product spaces. Publ. Math. IHES 81 73-205.
Mathematical Reviews (MathSciNet): MR97h:60016
Digital Object Identifier: doi:10.1007/BF02699376
[26] VAN DER VAART, A. and WELLNER, J. (1996). Weak Convergence and Empirical Processes. Springer, New York.
Mathematical Reviews (MathSciNet): MR97g:60035
Zentralblatt MATH: 0862.60002
[27] VAN DER VAART, A. (1998). Asy mptotic Statistics. Cambridge Univ. Press.
Mathematical Reviews (MathSciNet): MR2000c:62003
Zentralblatt MATH: 0910.62001
[28] WU, L. M. (1994). Large deviations, moderate deviations and LIL for empirical processes. Ann. Probab. 22 17-27.
Zentralblatt MATH: 0793.60032
Mathematical Reviews (MathSciNet): MR1258864
Digital Object Identifier: doi:10.1214/aop/1176988846
Project Euclid: euclid.aop/1176988846

2012 © Institute of Mathematical Statistics

The Annals of Probability

The Annals of Probability