The Annals of Statistics

Spline-backfitted kernel smoothing of nonlinear additive autoregression model

Li Wang and Lijian Yang
Source: Ann. Statist. Volume 35, Number 6 (2007), 2474-2503.

Abstract

Application of nonparametric and semiparametric regression techniques to high-dimensional time series data has been hampered due to the lack of effective tools to address the “curse of dimensionality.” Under rather weak conditions, we propose spline-backfitted kernel estimators of the component functions for the nonlinear additive time series data that are both computationally expedient so they are usable for analyzing very high-dimensional time series, and theoretically reliable so inference can be made on the component functions with confidence. Simulation experiments have provided strong evidence that corroborates the asymptotic theory.

First Page: Show Hide
Primary Subjects: 62M10
Secondary Subjects: 62G08
Full-text: Open access
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aos/1201012969
Digital Object Identifier: doi:10.1214/009053607000000488
Mathematical Reviews number (MathSciNet): MR2382655
Zentralblatt MATH identifier: 1129.62038

References

Bosq, D. (1998). Nonparametric Statistics for Stochastic Processes, 2nd ed. Lecture Notes in Statist. 110. Springer, New York.
Mathematical Reviews (MathSciNet): MR1640691
Zentralblatt MATH: 0902.62099
Chen, R. and Tsay, R. S. (1993). Nonlinear additive ARX models. J. Amer. Statist. Assoc. 88 955--967.
de Boor, C. (2001). A Practical Guide to Splines, rev. ed. Springer, New York.
Mathematical Reviews (MathSciNet): MR1900298
Zentralblatt MATH: 0987.65015
Doukhan, P. (1994). Mixing: Properties and Examples. Lecture Notes in Statist. 85. Springer, New York.
Mathematical Reviews (MathSciNet): MR1312160
Fan, J. and Gijbels, I. (1996). Local Polynomial Modelling and Its Applications. Chapman and Hall, London.
Mathematical Reviews (MathSciNet): MR1383587
Zentralblatt MATH: 0873.62037
Fan, J., Härdle, W. and Mammen, E. (1998). Direct estimation of low-dimensional components in additive models. Ann. Statist. 26 943--971.
Mathematical Reviews (MathSciNet): MR1635422
Digital Object Identifier: doi:10.1214/aos/1024691083
Project Euclid: euclid.aos/1024691083
Zentralblatt MATH: 1073.62527
Fan, J. and Jiang, J. (2005). Nonparametric inferences for additive models. J. Amer. Statist. Assoc. 100 890--907.
Mathematical Reviews (MathSciNet): MR2201017
Digital Object Identifier: doi:10.1198/016214504000001439
Zentralblatt MATH: 1117.62328
Härdle, W., Hlávka, Z. and Klinke, S. (2000). XploRe Application Guide. Springer, Berlin.
Mathematical Reviews (MathSciNet): MR1752528
Hastie, T. J. and Tibshirani, R. J. (1990). Generalized Additive Models. Chapman and Hall, London.
Mathematical Reviews (MathSciNet): MR1082147
Zentralblatt MATH: 0747.62061
Hengartner, N. W. and Sperlich, S. (2005). Rate optimal estimation with the integration method in the presence of many covariates. J. Multivariate Anal. 95 246--272.
Mathematical Reviews (MathSciNet): MR2170397
Digital Object Identifier: doi:10.1016/j.jmva.2004.09.010
Zentralblatt MATH: 1070.62021
Horowitz, J., Klemelä, J. and Mammen, E. (2006). Optimal estimation in additive regression. Bernoulli 12 271--298.
Mathematical Reviews (MathSciNet): MR2218556
Digital Object Identifier: doi:10.3150/bj/1145993975
Project Euclid: euclid.bj/1145993975
Zentralblatt MATH: 1098.62043
Horowitz, J. and Mammen, E. (2004). Nonparametric estimation of an additive model with a link function. Ann. Statist. 32 2412--2443.
Mathematical Reviews (MathSciNet): MR2153990
Digital Object Identifier: doi:10.1214/009053604000000814
Project Euclid: euclid.aos/1107794874
Zentralblatt MATH: 1069.62035
Huang, J. Z. (1998). Projection estimation in multiple regression with application to functional ANOVA models. Ann. Statist. 26 242--272.
Mathematical Reviews (MathSciNet): MR1611780
Digital Object Identifier: doi:10.1214/aos/1030563984
Project Euclid: euclid.aos/1030563984
Zentralblatt MATH: 0930.62042
Huang, J. Z. and Yang, L. (2004). Identification of nonlinear additive autoregressive models. J. R. Stat. Soc. Ser. B Stat. Methodol. 66 463--477.
Mathematical Reviews (MathSciNet): MR2062388
Digital Object Identifier: doi:10.1111/j.1369-7412.2004.05500.x
Linton, O. B. (1997). Efficient estimation of additive nonparametric regression models. Biometrika 84 469--473.
Mathematical Reviews (MathSciNet): MR1467061
Zentralblatt MATH: 0882.62038
Digital Object Identifier: doi:10.1093/biomet/84.2.469
Linton, O. B. and Härdle, W. (1996). Estimation of additive regression models with known links. Biometrika 83 529--540.
Mathematical Reviews (MathSciNet): MR1423873
Zentralblatt MATH: 0866.62017
Digital Object Identifier: doi:10.1093/biomet/83.3.529
Linton, O. B. and Nielsen, J. P. (1995). A kernel method of estimating structured nonparametric regression based on marginal integration. Biometrika 82 93--100.
Mathematical Reviews (MathSciNet): MR1332841
Zentralblatt MATH: 0823.62036
Digital Object Identifier: doi:10.1093/biomet/82.1.93
Mammen, E., Linton, O. and Nielsen, J. (1999). The existence and asymptotic properties of a backfitting projection algorithm under weak conditions. Ann. Statist. 27 1443--1490.
Mathematical Reviews (MathSciNet): MR1742496
Project Euclid: euclid.aos/1017939138
Opsomer, J. D. and Ruppert, D. (1997). Fitting a bivariate additive model by local polynomial regression. Ann. Statist. 25 186--211.
Mathematical Reviews (MathSciNet): MR1429922
Digital Object Identifier: doi:10.1214/aos/1034276626
Project Euclid: euclid.aos/1034276626
Zentralblatt MATH: 0869.62026
Pham, D. T. (1986). The mixing property of bilinear and generalized random coefficient autoregressive models. Stochastic Process. Appl. 23 291--300.
Mathematical Reviews (MathSciNet): MR0876051
Digital Object Identifier: doi:10.1016/0304-4149(86)90042-6
Zentralblatt MATH: 0614.60062
Robinson, P. M. (1983). Nonparametric estimators for time series. J. Time Ser. Anal. 4 185--207.
Mathematical Reviews (MathSciNet): MR0732897
Digital Object Identifier: doi:10.1111/j.1467-9892.1983.tb00368.x
Zentralblatt MATH: 0544.62082
Sperlich, S., Tjøstheim, D. and Yang, L. (2002). Nonparametric estimation and testing of interaction in additive models. Econometric Theory 18 197--251.
Mathematical Reviews (MathSciNet): MR1891823
Digital Object Identifier: doi:10.1017/S0266466602182016
Zentralblatt MATH: 1109.62310
Stone, C. J. (1985). Additive regression and other nonparametric models. Ann. Statist. 13 689--705.
Mathematical Reviews (MathSciNet): MR0790566
Digital Object Identifier: doi:10.1214/aos/1176349548
Project Euclid: euclid.aos/1176349548
Zentralblatt MATH: 0605.62065
Stone, C. J. (1994). The use of polynomial splines and their tensor products in multivariate function estimation (with discussion). Ann. Statist. 22 118--184.
Mathematical Reviews (MathSciNet): MR1272079
Digital Object Identifier: doi:10.1214/aos/1176325361
Project Euclid: euclid.aos/1176325361
Zentralblatt MATH: 0827.62038
Tjøstheim, D. and Auestad, B. (1994). Nonparametric identification of nonlinear time series: Projections. J. Amer. Statist. Assoc. 89 1398--1409.
Mathematical Reviews (MathSciNet): MR1310230
Digital Object Identifier: doi:10.2307/2291002
Zentralblatt MATH: 0813.62036
Wang, L. and Yang, L. (2006). Spline-backfitted kernel smoothing of nonlinear additive autoregression model. Manuscript. Available at www.arxiv.org/abs/math/0612677.
Xue, L. and Yang, L. (2006). Estimation of semiparametric additive coefficient model. J. Statist. Plann. Inference 136 2506--2534.
Mathematical Reviews (MathSciNet): MR2279819
Digital Object Identifier: doi:10.1016/j.jspi.2004.11.003
Zentralblatt MATH: 1090.62041
Xue, L. and Yang, L. (2006). Additive coefficient modeling via polynomial spline. Statist. Sinica 16 1423--1446.
Mathematical Reviews (MathSciNet): MR2327498
Yang, L., Härdle, W. and Nielsen, J. P. (1999). Nonparametric autoregression with multiplicative volatility and additive mean. J. Time Ser. Anal. 20 579--604.
Mathematical Reviews (MathSciNet): MR1720162
Digital Object Identifier: doi:10.1111/1467-9892.00159
Zentralblatt MATH: 0932.62106
Yang, L., Sperlich, S. and Härdle, W. (2003). Derivative estimation and testing in generalized additive models. J. Statist. Plann. Inference 115 521--542.
Mathematical Reviews (MathSciNet): MR1985882
Digital Object Identifier: doi:10.1016/S0378-3758(02)00163-5
Zentralblatt MATH: 1015.62071

2012 © Institute of Mathematical Statistics

The Annals of Statistics

The Annals of Statistics