The Annals of Statistics

On Bickel and Ritov's conjecture about adaptive estimation of the integral of the square of density derivative

Sam Efromovich and Mark Low

Source: Ann. Statist. Volume 24, Number 2 (1996), 682-686.

Abstract

Bickel and Ritov suggested an optimal estimator for the integral of the square of the kth derivative of a density when the unknown density belongs to a Lipschitz class of a given order $\beta$. In this context optimality means that the estimate is asymptotically efficient, that is, it has the best constant and rate of risk convergence, whenever $\beta > 2k + 1/4$, and it is rate optimal otherwise. The suggested optimal estimator crucially depends on the value of $\beta$ which is obviously unknown. Bickel and Ritov conjectured that the method of cross validation leads to a corresponding adaptive estimator which has the same optimal statistical properties as the optimal estimator based on prior knowledge of $\beta$.

We show for probability densities supported over a finite interval that when $\beta > 2k + 1/4$ adaptation is not necessary for the construction of an asymptotically efficient estimator. On the other hand, it is not possible to construct an adaptive estimator which has the same rate of convergence as the optimal nonadaptive estimator as soon as $k < \beta \leq 2k + 1/4$.

Primary Subjects: 62C05
Secondary Subjects: 62E20, 62J02, 62G05, 62M99
Keywords: Functional estimation; adaptation; probability density

Full-text: Open access

Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aos/1032894459
Mathematical Reviews number (MathSciNet): MR1394982
Digital Object Identifier: doi:10.1214/aos/1032894459
Zentralblatt MATH identifier: 0859.62039

References

BICKEL, P. J. and RITOV, Y. 1988 . Estimating integrated squared density derivatives: sharp best order of convergence estimates. Sankhy a Ser. A 50 381 393. Z .
Mathematical Reviews (MathSciNet): MR91e:62079
BROWN, L. D. and LOW, M. G. 1993 . A constrained risk inequality with applications to nonparametric functional estimation. Ann. Statist. To appear. Z .
DEVROy E, L. and Gy ORFI, L. 1985 . Nonparametric Density Estimation. Wiley, New York. ¨ Z .
Mathematical Reviews (MathSciNet): MR86i:62065
DONOHO, D. and NUSSBAUM, M. 1990 . Minimax quadratic estimation of a quadratic functional. J. Complexity 6 290 323. Z .
Mathematical Reviews (MathSciNet): MR91m:65343
Zentralblatt MATH: 0724.62039
EFROMOVICH, S. 1985 . Nonparametric estimation of a density with unknown smoothness. Theory Probab. Appl. 30 557 568. Z .
EFROMOVICH, S. and LOW, M. 1996 . On optimal adaptive estimation of a quadratic functional. Z . Ann. Statist. 24 3 . Z .
Mathematical Reviews (MathSciNet): MR97k:62078
FAN, J. 1991 . On the estimation of quadratic functionals. Ann. Statist. 19 1273 1294. Z .
INGSTER, YU. V. 1986 . On minimax testing of statistical hy potheses for probability distributions in L . Theory Probab. Appl. 31 384 389. pZ .
SERFLING, R. J. 1980 . Approximation Theorems of Mathematical Statistics. Wiley, New York.
Mathematical Reviews (MathSciNet): MR82a:62003
ALBUQUERQUE, NEW MEXICO 17131 PHILADELPHIA, PENNSy LVANIA 19104 E-mail: efrom@math.unm.edu E-mail: mlow@stat.wharton.upenn.edu

2010 © Institute of Mathematical Statistics