The Annals of Statistics

Spline-backfitted kernel smoothing of nonlinear additive autoregression model

Li Wang and Lijian Yang
Source: Ann. Statist. Volume 35, Number 6 (2007), 2474-2503.

Abstract

Application of nonparametric and semiparametric regression techniques to high-dimensional time series data has been hampered due to the lack of effective tools to address the “curse of dimensionality.” Under rather weak conditions, we propose spline-backfitted kernel estimators of the component functions for the nonlinear additive time series data that are both computationally expedient so they are usable for analyzing very high-dimensional time series, and theoretically reliable so inference can be made on the component functions with confidence. Simulation experiments have provided strong evidence that corroborates the asymptotic theory.

First Page: Show Hide
Primary Subjects: 62M10
Secondary Subjects: 62G08
Full-text: Open access
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aos/1201012969
Digital Object Identifier: doi:10.1214/009053607000000488
Mathematical Reviews number (MathSciNet): MR2382655
Zentralblatt MATH identifier: 1129.62038

References

Bosq, D. (1998). Nonparametric Statistics for Stochastic Processes, 2nd ed. Lecture Notes in Statist. 110. Springer, New York.
Mathematical Reviews (MathSciNet): MR1640691
Chen, R. and Tsay, R. S. (1993). Nonlinear additive ARX models. J. Amer. Statist. Assoc. 88 955–967.
de Boor, C. (2001). A Practical Guide to Splines, rev. ed. Springer, New York.
Mathematical Reviews (MathSciNet): MR1900298
Doukhan, P. (1994). Mixing: Properties and Examples. Lecture Notes in Statist. 85. Springer, New York.
Mathematical Reviews (MathSciNet): MR1312160
Fan, J. and Gijbels, I. (1996). Local Polynomial Modelling and Its Applications. Chapman and Hall, London.
Mathematical Reviews (MathSciNet): MR1383587
Zentralblatt MATH: 0873.62037
Fan, J., Härdle, W. and Mammen, E. (1998). Direct estimation of low-dimensional components in additive models. Ann. Statist. 26 943–971.
Mathematical Reviews (MathSciNet): MR1635422
Zentralblatt MATH: 1073.62527
Digital Object Identifier: doi:10.1214/aos/1024691083
Project Euclid: euclid.aos/1024691083
Fan, J. and Jiang, J. (2005). Nonparametric inferences for additive models. J. Amer. Statist. Assoc. 100 890–907.
Mathematical Reviews (MathSciNet): MR2201017
Zentralblatt MATH: 1117.62328
Digital Object Identifier: doi:10.1198/016214504000001439
Härdle, W., Hlávka, Z. and Klinke, S. (2000). XploRe Application Guide. Springer, Berlin.
Mathematical Reviews (MathSciNet): MR1752528
Hastie, T. J. and Tibshirani, R. J. (1990). Generalized Additive Models. Chapman and Hall, London.
Mathematical Reviews (MathSciNet): MR1082147
Hengartner, N. W. and Sperlich, S. (2005). Rate optimal estimation with the integration method in the presence of many covariates. J. Multivariate Anal. 95 246–272.
Mathematical Reviews (MathSciNet): MR2170397
Zentralblatt MATH: 1070.62021
Digital Object Identifier: doi:10.1016/j.jmva.2004.09.010
Horowitz, J., Klemelä, J. and Mammen, E. (2006). Optimal estimation in additive regression. Bernoulli 12 271–298.
Mathematical Reviews (MathSciNet): MR2218556
Digital Object Identifier: doi:10.3150/bj/1145993975
Project Euclid: euclid.bj/1145993975
Horowitz, J. and Mammen, E. (2004). Nonparametric estimation of an additive model with a link function. Ann. Statist. 32 2412–2443.
Mathematical Reviews (MathSciNet): MR2153990
Zentralblatt MATH: 1069.62035
Digital Object Identifier: doi:10.1214/009053604000000814
Project Euclid: euclid.aos/1107794874
Huang, J. Z. (1998). Projection estimation in multiple regression with application to functional ANOVA models. Ann. Statist. 26 242–272.
Mathematical Reviews (MathSciNet): MR1611780
Zentralblatt MATH: 0930.62042
Digital Object Identifier: doi:10.1214/aos/1030563984
Project Euclid: euclid.aos/1030563984
Huang, J. Z. and Yang, L. (2004). Identification of nonlinear additive autoregressive models. J. R. Stat. Soc. Ser. B Stat. Methodol. 66 463–477.
Mathematical Reviews (MathSciNet): MR2062388
Digital Object Identifier: doi:10.1111/j.1369-7412.2004.05500.x
Linton, O. B. (1997). Efficient estimation of additive nonparametric regression models. Biometrika 84 469–473.
Mathematical Reviews (MathSciNet): MR1467061
Zentralblatt MATH: 0882.62038
Digital Object Identifier: doi:10.1093/biomet/84.2.469
Linton, O. B. and Härdle, W. (1996). Estimation of additive regression models with known links. Biometrika 83 529–540.
Mathematical Reviews (MathSciNet): MR1423873
Zentralblatt MATH: 0866.62017
Digital Object Identifier: doi:10.1093/biomet/83.3.529
Linton, O. B. and Nielsen, J. P. (1995). A kernel method of estimating structured nonparametric regression based on marginal integration. Biometrika 82 93–100.
Mathematical Reviews (MathSciNet): MR1332841
Zentralblatt MATH: 0823.62036
Digital Object Identifier: doi:10.1093/biomet/82.1.93
Mammen, E., Linton, O. and Nielsen, J. (1999). The existence and asymptotic properties of a backfitting projection algorithm under weak conditions. Ann. Statist. 27 1443–1490.
Mathematical Reviews (MathSciNet): MR1742496
Zentralblatt MATH: 0986.62028
Project Euclid: euclid.aos/1017939138
Opsomer, J. D. and Ruppert, D. (1997). Fitting a bivariate additive model by local polynomial regression. Ann. Statist. 25 186–211.
Mathematical Reviews (MathSciNet): MR1429922
Zentralblatt MATH: 0869.62026
Digital Object Identifier: doi:10.1214/aos/1034276626
Project Euclid: euclid.aos/1034276626
Pham, D. T. (1986). The mixing property of bilinear and generalized random coefficient autoregressive models. Stochastic Process. Appl. 23 291–300.
Mathematical Reviews (MathSciNet): MR0876051
Zentralblatt MATH: 0614.60062
Digital Object Identifier: doi:10.1016/0304-4149(86)90042-6
Robinson, P. M. (1983). Nonparametric estimators for time series. J. Time Ser. Anal. 4 185–207.
Mathematical Reviews (MathSciNet): MR0732897
Zentralblatt MATH: 0544.62082
Digital Object Identifier: doi:10.1111/j.1467-9892.1983.tb00368.x
Sperlich, S., Tjøstheim, D. and Yang, L. (2002). Nonparametric estimation and testing of interaction in additive models. Econometric Theory 18 197–251.
Mathematical Reviews (MathSciNet): MR1891823
Zentralblatt MATH: 1109.62310
Digital Object Identifier: doi:10.1017/S0266466602182016
Stone, C. J. (1985). Additive regression and other nonparametric models. Ann. Statist. 13 689–705.
Mathematical Reviews (MathSciNet): MR0790566
Zentralblatt MATH: 0605.62065
Digital Object Identifier: doi:10.1214/aos/1176349548
Project Euclid: euclid.aos/1176349548
Stone, C. J. (1994). The use of polynomial splines and their tensor products in multivariate function estimation (with discussion). Ann. Statist. 22 118–184.
Mathematical Reviews (MathSciNet): MR1272079
Zentralblatt MATH: 0827.62038
Digital Object Identifier: doi:10.1214/aos/1176325361
Project Euclid: euclid.aos/1176325361
Tjøstheim, D. and Auestad, B. (1994). Nonparametric identification of nonlinear time series: Projections. J. Amer. Statist. Assoc. 89 1398–1409.
Mathematical Reviews (MathSciNet): MR1310230
Zentralblatt MATH: 0813.62036
Wang, L. and Yang, L. (2006). Spline-backfitted kernel smoothing of nonlinear additive autoregression model. Manuscript. Available at www.arxiv.org/abs/math/0612677.
Xue, L. and Yang, L. (2006). Estimation of semiparametric additive coefficient model. J. Statist. Plann. Inference 136 2506–2534.
Mathematical Reviews (MathSciNet): MR2279819
Zentralblatt MATH: 1090.62041
Digital Object Identifier: doi:10.1016/j.jspi.2004.11.003
Xue, L. and Yang, L. (2006). Additive coefficient modeling via polynomial spline. Statist. Sinica 16 1423–1446.
Mathematical Reviews (MathSciNet): MR2327498
Zentralblatt MATH: 1109.62030
Yang, L., Härdle, W. and Nielsen, J. P. (1999). Nonparametric autoregression with multiplicative volatility and additive mean. J. Time Ser. Anal. 20 579–604.
Mathematical Reviews (MathSciNet): MR1720162
Zentralblatt MATH: 0932.62106
Digital Object Identifier: doi:10.1111/1467-9892.00159
Yang, L., Sperlich, S. and Härdle, W. (2003). Derivative estimation and testing in generalized additive models. J. Statist. Plann. Inference 115 521–542.
Mathematical Reviews (MathSciNet): MR1985882
Zentralblatt MATH: 1015.62071
Digital Object Identifier: doi:10.1016/S0378-3758(02)00163-5

2013 © Institute of Mathematical Statistics

The Annals of Statistics

The Annals of Statistics

Turn MathJax Off
What is MathJax?