Bernoulli

A note on the backfitting estimation of additive models

Yingcun Xia
Source: Bernoulli Volume 15, Number 4 (2009), 1148-1153.

Abstract

The additive model is one of the most popular semi-parametric models. The backfitting estimation (Buja, Hastie and Tibshirani, Ann. Statist. 17 (1989) 453–555) for the model is intuitively easy to understand and theoretically most efficient (Opsomer and Ruppert, Ann. Statist. 25 (1997) 186–211); its implementation is equivalent to solving simple linear equations. However, convergence of the algorithm is very difficult to investigate and is still unsolved. For bivariate additive models, Opsomer and Ruppert (Ann. Statist. 25 (1997) 186–211) proved the convergence under a very strong condition and conjectured that a much weaker condition is sufficient. In this short note, we show that a weak condition can guarantee the convergence of the backfitting estimation algorithm when Nadaraya–Watson kernel smoothing is used.

First Page: Show Hide
Full-text: Access denied (no subscription detected)
We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber.
If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription. Read more about accessing full-text
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.bj/1262962229
Digital Object Identifier: doi:10.3150/09-BEJ183
Mathematical Reviews number (MathSciNet): MR2597586
Zentralblatt MATH identifier: 05816135

References

Buja, A., Hastie, T. and Tibshirani, R. (1989). Linear smoothers and additive models (with discussion). Ann. Statist. 17 453–555.
Mathematical Reviews (MathSciNet): MR994249
Zentralblatt MATH: 0689.62029
Digital Object Identifier: doi:10.1214/aos/1176347115
Project Euclid: euclid.aos/1176347115
David, H.A. and Nagaraja, H.N. (2003). Order Statistics. New Jersey: Wiley.
Mathematical Reviews (MathSciNet): MR1994955
Linton, O. and Nielsen, J.P. (1995). A kernel method of estimating structured nonparametric regression based on marginal integration. Biometrika 82 93–100.
Mathematical Reviews (MathSciNet): MR1332841
Zentralblatt MATH: 0823.62036
Digital Object Identifier: doi:10.1093/biomet/82.1.93
Mammen, E., Linton, O. and Nielsen, J.P. (1999). The existence and asymptotic properties of a backfitting projection algorithm under weak conditions. Ann. Statist. 27 1443–1490.
Mathematical Reviews (MathSciNet): MR1742496
Zentralblatt MATH: 0986.62028
Project Euclid: euclid.aos/1017939138
Minc, H. (1988). Nonnegative Matrices. New York: Wiley.
Mathematical Reviews (MathSciNet): MR932967
Opsomer, J.D. and Ruppert, D. (1997). Fitting a bivariate additive model by local polynomial regression. Ann. Statist. 25 186–211.
Mathematical Reviews (MathSciNet): MR1429922
Zentralblatt MATH: 0869.62026
Digital Object Identifier: doi:10.1214/aos/1034276626
Project Euclid: euclid.aos/1034276626
Romanovsky, V.I. (1970). Discrete Markov Chains. Groningen, Netherlands: Wolters-Noordhoff.
Mathematical Reviews (MathSciNet): MR266312
Zentralblatt MATH: 0201.20002
Tjøstheim, D. and Auestad, B. (1994). Nonparametric identification of nonlinear time series: Projections. J. Amer. Statist. Assoc. 89 1398–1409.
Wang, L. and Yang, L. (2007). Spline-backfitted kernel smoothing of nonlinear additive autoregression model. Ann. Statist. 35 2474–2503.
Mathematical Reviews (MathSciNet): MR2382655
Zentralblatt MATH: 1129.62038
Digital Object Identifier: doi:10.1214/009053607000000488
Project Euclid: euclid.aos/1201012969

2012 © Bernoulli Society for Mathematical Statistics and Probability

Bernoulli

Bernoulli

Turn MathJax Off
What is MathJax?