Source: Ann. Probab. Volume 32, Number 3B
(2004), 2570-2605.
Let fn denote a kernel density estimator of a continuous density f in d dimensions, bounded and positive. Let Ψ(t) be a positive continuous function such that ‖Ψfβ‖∞<∞ for some 0<β<1/2. Under natural smoothness conditions, necessary and sufficient conditions for the sequence
to be stochastically bounded and to converge a.s. to a constant are obtained. Also, the case of larger values of β is studied where a similar sequence with a different norming converges a.s. either to 0 or to +∞, depending on convergence or divergence of a certain integral involving the tail probabilities of Ψ(X). The results apply as well to some discontinuous not strictly positive densities.
References
Deheuvels, P. (2000). Uniform limit laws for kernel density estimators on possibly unbounded intervals. In Recent Advances in Reliability Theory: Methodology, Practice and Inference (N. Limnios and M. Nikulin, eds.) 477--492. Birkhäuser, Boston.
de la Peña, V. and Giné, E. (1999). Decoupling, from Dependence to Independence. Springer, New York.
Dudley, R. M. (1999). Uniform Central Limit Theorems. Cambridge Univ. Press.
Einmahl, J. H. J. and Mason, D. (1985a). Bounds for weighted multivariate empirical distribution functions. Z. Wahrsch. Verw. Gebiete 70 563--571.
Mathematical Reviews (MathSciNet):
MR807337
Einmahl, J. H. J. and Mason, D. (1985b). Laws of the iterated logarithm in the tails for weighted uniform empirical processes Ann. Probab. 16 126--141.
Mathematical Reviews (MathSciNet):
MR920259
Einmahl, J. H. J. and Mason, D. (1988). Strong limit theorems for weighted quantile processes. Ann. Probab. 16 1623--1643.
Mathematical Reviews (MathSciNet):
MR958207
Einmahl, U. and Mason, D. (2000). An empirical process approach to the uniform consistency of kernel-type function estimators. J. Theoret. Probab. 13 1--37.
Feller, W. (1971). An Introduction to Probability Theory and Its Applications 2. Wiley, New York.
Mathematical Reviews (MathSciNet):
MR270403
Giné, E. and Guillou, A. (2001). On consistency of kernel density estimators for randomly censored data: Rates holding uniformly over adaptive intervals. Ann. Inst. H. Poincaré Probab. Statist. 37 503--522.
Giné, E. and Guillou, A. (2002). Rates of strong consistency for multivariate kernel density estimators. Ann. Inst. H. Poincaré Probab. Statist. 38 907--922.
Giné, E. and Zinn, J. (1984). Some limit theorems for empirical processes. Ann. Probab. 12 929--989.
Mathematical Reviews (MathSciNet):
MR757767
Koltchinskii, V. and Sakhanenko, L. (2000). Testing for ellipsoidal symmetry of a multivariate distribution. In High Dimensional Probability II (E. Giné, D. M. Mason and J. A. Wellner, eds.) 493--510. Birkhäuser, Boston.
Mason, D. (2004). A uniform functional law of logarithm for the local empirical process. Ann. Probab. 32 1391--1418.
Montgomery-Smith, S. J. (1993). Comparison of sums of independent identically distributed random vectors. Probab. Math. Statist. 14 281--285.
Nolan, D. and Pollard, D. (1987). $U$-processes: Rates of convergence. Ann. Statist. 15 780--799.
Mathematical Reviews (MathSciNet):
MR888439
Parzen, E. (1962). On the estimation of a probability density function and the mode. Ann. Math. Statist. 33 1065--1076.
Mathematical Reviews (MathSciNet):
MR143282
Pollard, D. (1984). Convergence of Stochastic Processes. Springer, New York.
Mathematical Reviews (MathSciNet):
MR762984
Rosenblatt, M. (1956). Remarks on some nonparametric estimates of a density function. Ann. Math. Statist. 27 832--835.
Mathematical Reviews (MathSciNet):
MR79873
Silverman, B. W. (1978). Weak and strong uniform consistency of the kernel estimate of a density and its derivatives. Ann. Statist. 6 177--189.
Mathematical Reviews (MathSciNet):
MR471166
Stout, W. (1974). Almost Sure Convergence. Academic Press, New York.
Mathematical Reviews (MathSciNet):
MR455094
Stute, W. (1982). A law of the logarithm for kernel density estimators. Ann. Probab. 10 414--422.
Mathematical Reviews (MathSciNet):
MR647513
Stute, W. (1984). The oscillation behavior of empirical processes: The multivariate case. Ann. Probab. 12 361--379.
Mathematical Reviews (MathSciNet):
MR735843
Talagrand, M. (1994). Sharper bounds for Gaussian and empirical processes. Ann. Probab. 22 28--76.
Talagrand, M. (1996). New concentration inequalities in product spaces. Invent. Math. 126 505--563.