The Annals of Statistics

An adaptation theory for nonparametric confidence intervals

T. Tony Cai and Mark G. Low

Source: Ann. Statist. Volume 32, Number 5 (2004), 1805-1840.

Abstract

A nonparametric adaptation theory is developed for the construction of confidence intervals for linear functionals. A between class modulus of continuity captures the expected length of adaptive confidence intervals. Sharp lower bounds are given for the expected length and an ordered modulus of continuity is used to construct adaptive confidence procedures which are within a constant factor of the lower bounds. In addition, minimax theory over nonconvex parameter spaces is developed.

Primary Subjects: 62G99
Secondary Subjects: 62F12, 62F35, 62M99
Keywords: Adaptation; between class modulus; confidence intervals; coverage; expected length; linear functionals; minimax estimation; modulus of continuity; white noise model

Full-text: Open access

Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aos/1098883773
Digital Object Identifier: doi:10.1214/009053604000000049
Mathematical Reviews number (MathSciNet): MR2102494
Zentralblatt MATH identifier: 1056.62060

References

Abramovich, F., Benjamini, Y., Donoho, D. and Johnstone, I. (2000). Adapting to unknown sparsity by controlling the false discovery rate. Technical Report 2000-19, Dept. Statistics, Stanford Univ.
Baraud, Y. (2002). Non-asymptotic minimax rates of testing in signal detection. Bernoulli 8 577--606.
Mathematical Reviews (MathSciNet): MR1935648
Project Euclid: euclid.bj/1078435219
Beran, R. and Dümbgen, L. (1998). Modulation of estimators and confidence sets. Ann. Statist. 26 1826--1856.
Mathematical Reviews (MathSciNet): MR1673280
Digital Object Identifier: doi:10.1214/aos/1024691359
Project Euclid: euclid.aos/1024691359
Brown, L. D. and Low, M. G. (1996). Asymptotic equivalence of nonparametric regression and white noise. Ann. Statist. 24 2384--2398.
Mathematical Reviews (MathSciNet): MR1425958
Digital Object Identifier: doi:10.1214/aos/1032181159
Project Euclid: euclid.aos/1032181159
Cai, T. and Low, M. (2002). On modulus of continuity and adaptability in nonparametric functional estimation. Technical report, Dept. Statistics, Univ. Pennsylvania.
Cai, T. and Low, M. (2003). Adaptive estimation and confidence intervals for convex functions and monotone functions. Technical report, Dept. Statistics, Univ. Pennsylvania.
Cai, T. and Low, M. (2004). Minimax estimation of linear functionals over nonconvex parameter spaces. Ann. Statist. 32 552--576.
Mathematical Reviews (MathSciNet): MR2060169
Digital Object Identifier: doi:10.1214/009053604000000094
Project Euclid: euclid.aos/1083178938
Donoho, D. L. (1994). Statistical estimation and optimal recovery. Ann. Statist. 22 238--270.
Mathematical Reviews (MathSciNet): MR1272082
Donoho, D. L., Johnstone, I. M., Hoch, J. C. and Stern, A. S. (1992). Maximum entropy and the nearly black object (with discussion). J. Roy. Statist. Soc. Ser. B. 54 41--81.
Mathematical Reviews (MathSciNet): MR1157714
Donoho, D. L. and Liu, R. C. (1987). Geometrizing rates of convergence. I. Technical Report 137, Dept. Statistics, Univ. California, Berkeley.
Donoho, D. L. and Liu, R. C. (1991). Geometrizing rates of convergence. III. Ann. Statist. 19 668--701.
Mathematical Reviews (MathSciNet): MR1105839
Dudley, R. (1999). Uniform Central Limit Theorems. Cambridge Univ. Press.
Mathematical Reviews (MathSciNet): MR1720712
Zentralblatt MATH: 0951.60033
Dümbgen, L. (1998). New goodness-of-fit tests and their application to nonparametric confidence sets. Ann. Statist. 26 288--314.
Mathematical Reviews (MathSciNet): MR1611768
Digital Object Identifier: doi:10.1214/aos/1030563987
Project Euclid: euclid.aos/1030563987
Feller, W. (1968). An Introduction to Probability Theory and Its Applications 1, 3rd ed. Wiley, New York.
Mathematical Reviews (MathSciNet): MR228020
Genovese, C. R. and Wasserman, L. (2002). Confidence sets for nonparametric wavelet regression. Technical report, Dept. Statistics, Carnegie Mellon Univ.
Hall, P. (1992). Effect of bias estimation on coverage accuracy of bootstrap confidence intervals for a probability density. Ann. Statist. 20 675--694.
Mathematical Reviews (MathSciNet): MR1165587
Ha\"rdle, W. and Marron, J. S. (1991). Bootstrap simultaneous error bars for nonparametric regression. Ann. Statist. 19 778--796.
Mathematical Reviews (MathSciNet): MR1105844
Hengartner, N. W. and Stark, P. B. (1995). Finite-sample confidence envelopes for shape-restricted densities. Ann. Statist. 23 525--550.
Mathematical Reviews (MathSciNet): MR1332580
Ibragimov, I. A. and Hasminskii, R. Z. (1984). Nonparametric estimation of the value of a linear functional in Gaussian white noise. Theory Probab. Appl. 29 18--32.
Mathematical Reviews (MathSciNet): MR739497
Li, K.-C. (1989). Honest confidence regions for nonparametric regression. Ann. Statist. 17 1001--1008.
Mathematical Reviews (MathSciNet): MR1015135
Low, M. G. (1995). Bias-variance tradeoffs in functional estimation problems. Ann. Statist. 23 824--835.
Mathematical Reviews (MathSciNet): MR1345202
Low, M. G. (1997). On nonparametric confidence intervals. Ann. Statist. 25 2547--2554.
Mathematical Reviews (MathSciNet): MR1604412
Digital Object Identifier: doi:10.1214/aos/1030741084
Project Euclid: euclid.aos/1030741084
Picard, D. and Tribouley, K. (2000). Adaptive confidence interval for pointwise curve estimation. Ann. Statist. 28 298--335.
Mathematical Reviews (MathSciNet): MR1762913
Digital Object Identifier: doi:10.1214/aos/1016120374
Project Euclid: euclid.aos/1016120374
Pratt, J. W. (1961). Length of confidence intervals. J. Amer. Statist. Assoc. 56 549--567.
Mathematical Reviews (MathSciNet): MR125678
Stark, P. B. (1992). Affine minimax confidence intervals for a bounded normal mean. Statist. Probab. Lett. 13 39--44.
Mathematical Reviews (MathSciNet): MR1147637
Zeytinoglu, M. and Mintz, M. (1984). Optimal fixed size confidence procedures for a restricted parameter space. Ann. Statist. 12 945--957.
Mathematical Reviews (MathSciNet): MR751284

2009 © Institute of Mathematical Statistics