Open Access
Translator Disclaimer
June 2005 Nonparametric regression penalizing deviations from additivity
M. Studer, B. Seifert, T. Gasser
Ann. Statist. 33(3): 1295-1329 (June 2005). DOI: 10.1214/009053604000001246


Due to the curse of dimensionality, estimation in a multidimensional nonparametric regression model is in general not feasible. Hence, additional restrictions are introduced, and the additive model takes a prominent place. The restrictions imposed can lead to serious bias. Here, a new estimator is proposed which allows penalizing the nonadditive part of a regression function. This offers a smooth choice between the full and the additive model. As a byproduct, this penalty leads to a regularization in sparse regions. If the additive model does not hold, a small penalty introduces an additional bias compared to the full model which is compensated by the reduced bias due to using smaller bandwidths.

For increasing penalties, this estimator converges to the additive smooth backfitting estimator of Mammen, Linton and Nielsen [Ann. Statist. 27 (1999) 1443–1490].

The structure of the estimator is investigated and two algorithms are provided. A proposal for selection of tuning parameters is made and the respective properties are studied. Finally, a finite sample evaluation is performed for simulated and ozone data.


Download Citation

M. Studer. B. Seifert. T. Gasser. "Nonparametric regression penalizing deviations from additivity." Ann. Statist. 33 (3) 1295 - 1329, June 2005.


Published: June 2005
First available in Project Euclid: 1 July 2005

zbMATH: 1072.62031
MathSciNet: MR2195636
Digital Object Identifier: 10.1214/009053604000001246

Primary: 62G08
Secondary: 62H99

Keywords: Additive models , AIC , curse of dimensionality , model choice , nonparametric estimation , parameter selection , regularization

Rights: Copyright © 2005 Institute of Mathematical Statistics


Vol.33 • No. 3 • June 2005
Back to Top