In this paper, we discuss the estimation of a nonparametric component of a nonparametric additive model . We allow the number q of additive components to grow to infinity and we make sparsity assumptions about the number of nonzero additive components. We compare this estimation problem with that of estimating in the oracle model , for which the additive components are known. We construct a two-step presmoothing-and-resmoothing estimator of and state finite-sample bounds for the difference between our estimator and a corresponding smoothing estimator in the oracle model. In an asymptotic setting, these bounds can be used to show asymptotic equivalence of our estimator and the oracle estimator; the paper thus shows that, asymptotically, under strong enough sparsity conditions, knowledge of has no effect on estimation accuracy. Our first step is to estimate with an undersmoothed estimator based on near-orthogonal projections with a group Lasso bias correction. In the second step, we construct pseudo responses by evaluating this undersmoothed estimator of at the design points and then apply the smoothing method of the oracle estimator to the nonparametric regression problem with “responses” and covariates . Our mathematical exposition centers primarily on establishing properties of the presmoothing estimator. We present simulation results demonstrating close-to-oracle performance of our estimator in practical applications.
Financial support by Deutsche Forschungsgemeinschaft (DFG) through the Research Training Group 1953 is gratefully acknowledged.
"Statistical inference in sparse high-dimensional additive models." Ann. Statist. 49 (3) 1514 - 1536, June 2021. https://doi.org/10.1214/20-AOS2011