Adaptive variance function estimation in heteroscedastic nonparametric regression



The Annals of Statistics

Adaptive variance function estimation in heteroscedastic nonparametric regression

T. Tony Cai and Lie Wang

Source: Ann. Statist. Volume 36, Number 5 (2008), 2025-2054.

Abstract

We consider a wavelet thresholding approach to adaptive variance function estimation in heteroscedastic nonparametric regression. A data-driven estimator is constructed by applying wavelet thresholding to the squared first-order differences of the observations. We show that the variance function estimator is nearly optimally adaptive to the smoothness of both the mean and variance functions. The estimator is shown to achieve the optimal adaptive rate of convergence under the pointwise squared error simultaneously over a range of smoothness classes. The estimator is also adaptively within a logarithmic factor of the minimax risk under the global mean integrated squared error over a collection of spatially inhomogeneous function classes. Numerical implementation and simulation results are also discussed.

Primary Subjects: 62G08, 62G20
Keywords: Adaptive estimation; nonparametric regression; thresholding; variance function estimation; wavelets

Full-text: Access denied (no subscription detected)

We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber.
If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription. Read more about accessing full-text
This document is available for purchase at a cost of $15. Select the "buy article" button below to make a credit card purchase of this document through a secure payment site.
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aos/1223908083
Digital Object Identifier: doi:10.1214/07-AOS509

References

Berger, J. (1976). Minimax estimation of a multivariate normal mean under arbitrary quadratic loss. J. Multivariate Anal. 4 642–648.
Mathematical Reviews (MathSciNet): MR408057
Digital Object Identifier: doi:10.1016/0047-259X(76)90035-X
Brown, L. D. and Levine, M. (2007). Variance estimation in nonparametric regression via the difference sequence method. Ann. Statist. 35 2219–2232.
Mathematical Reviews (MathSciNet): MR2363969
Digital Object Identifier: doi:10.1214/009053607000000145
Project Euclid: euclid.aos/1194461728
Brown, L. D. and Low, M. G. (1996). A constrained risk inequality with applications to nonparametric functional estimations. Ann. Statist. 24 2524–2535.
Mathematical Reviews (MathSciNet): MR1425965
Digital Object Identifier: doi:10.1214/aos/1032181166
Project Euclid: euclid.aos/1032181166
Cai, T. (1999). Adaptive wavelet estimation: A block thresholding and oracle inequality approach. Ann. Statist. 27 898–924.
Mathematical Reviews (MathSciNet): MR1724035
Digital Object Identifier: doi:10.1214/aos/1018031262
Project Euclid: euclid.aos/1018031262
Cai, T. (2002). On block thresholding in wavelet regression: Adaptivity, block size, and threshold level. Statist. Sinica 12 1241–1273.
Mathematical Reviews (MathSciNet): MR1947074
Zentralblatt MATH: 1004.62036
Cai, T. and Silverman, B. W. (2001). Incorporating information on neighboring coefficients into wavelet estimation. Sankhyā Ser. B 63 127–148.
Mathematical Reviews (MathSciNet): MR1895786
Cai, T. and Wang, L. (2007). Adaptive variance function estimation in heteroscedastic nonparametric regression. Technical report.
Daubechies, I. (1992). Ten Lectures on Wavelets. SIAM, Philadelphia.
Mathematical Reviews (MathSciNet): MR1162107
Zentralblatt MATH: 0776.42018
Donoho, D. L. and Johnstone, I. M. (1994). Ideal spatial adaptation via wavelet shrinkage. Biometrika 81 425–455.
Mathematical Reviews (MathSciNet): MR1311089
Zentralblatt MATH: 0815.62019
Digital Object Identifier: doi:10.1093/biomet/81.3.425
Donoho, D. L., Johnstone, I. M., Kerkyacharian, G. and Picard, D. (1995). Wavelet shrinkage: Asymptopia? J. Roy. Statist. Soc. Ser. B 57 301–369.
Mathematical Reviews (MathSciNet): MR1323344
Fan, J. and Yao, Q. (1998). Efficient estimation of conditional variance functions in stochastic regression. Biometrika 85 645–660.
Mathematical Reviews (MathSciNet): MR1665822
Zentralblatt MATH: 0918.62065
Digital Object Identifier: doi:10.1093/biomet/85.3.645
Hall, P. and Carroll, R. J. (1989). Variance function estimation in regression: The effect of estimating the mean. J. Roy. Statist. Soc. Ser. B 51 3–14.
Mathematical Reviews (MathSciNet): MR984989
Hall, P., Kerkyacharian, G. and Picard, D. (1998). Block threshold rules for curve estimation using kernel and wavelet methods. Ann. Statist. 26 922–942.
Mathematical Reviews (MathSciNet): MR1635418
Digital Object Identifier: doi:10.1214/aos/1024691082
Project Euclid: euclid.aos/1024691082
Hall, P., Kerkyacharian, G. and Picard, D. (1999). On the minimax optimality of block thresholded wavelet estimators. Statist. Sinica 9 33–50.
Mathematical Reviews (MathSciNet): MR1678880
Hwang, H. K. (1996). Large deviations for combinatorial distributions. I. Central limit theorems. Ann. Appl. Probab. 6 297–319.
Mathematical Reviews (MathSciNet): MR1389841
Digital Object Identifier: doi:10.1214/aoap/1034968075
Project Euclid: euclid.aoap/1034968075
Johnstone, I. M. and Silverman, B. W. (2005). Empirical Bayes selection of wavelet thresholds. Ann. Statist. 33 1700–1752.
Mathematical Reviews (MathSciNet): MR2166560
Digital Object Identifier: doi:10.1214/009053605000000345
Project Euclid: euclid.aos/1123250227
Lepski, O. V. (1990). On a problem of adaptive estimation on white Gaussian noise. Theory Probab. Appl. 35 454–466.
Mathematical Reviews (MathSciNet): MR1091202
Meyer, Y. (1992). Wavelets and Operators. Cambridge Univ. Press.
Mathematical Reviews (MathSciNet): MR1228209
Zentralblatt MATH: 0776.42019
Müller, H. G. and Stadtmüller, U. (1987). Estimation of heteroscedasticity in regression analysis. Ann. Statist. 15 610–625.
Müller, H. G. and Stadtmüller, U. (1993). On variance function estimation with quadratic forms. J. Statist. Plann. Inference 35 213–231.
Ruppert, D., Wand, M. P., Holst, U. and Hössjer, O. (1997). Local polynomial variance function estimation. Technometrics 39 262–273.
Mathematical Reviews (MathSciNet): MR1462587
Digital Object Identifier: doi:10.2307/1271131
Triebel, H. (1983). Theory of Function Spaces. Birkhäuser, Basel.
Mathematical Reviews (MathSciNet): MR781540
Wang, L., Brown, L. D., Cai, T. and Levine, M. (2008). Effect of mean on variance function estimation on nonparametric regression. Ann. Statist. 36 646–664.

2009 © Institute of Mathematical Statistics