The Annals of Statistics

Order selection for same-realization predictions in autoregressive processes

Ching-Kang Ing and Ching-Zong Wei

Full-text: Open access


Assume that observations are generated from an infinite-order autoregressive [AR(∞)] process. Shibata [Ann. Statist. 8 (1980) 147–164] considered the problem of choosing a finite-order AR model, allowing the order to become infinite as the number of observations does in order to obtain a better approximation. He showed that, for the purpose of predicting the future of an independent replicate, Akaike’s information criterion (AIC) and its variants are asymptotically efficient. Although Shibata’s concept of asymptotic efficiency has been widely accepted in the literature, it is not a natural property for time series analysis. This is because when new observations of a time series become available, they are not independent of the previous data. To overcome this difficulty, in this paper we focus on order selection for forecasting the future of an observed time series, referred to as same-realization prediction. We present the first theoretical verification that AIC and its variants are still asymptotically efficient (in the sense defined in Section 4) for same-realization predictions. To obtain this result, a technical condition, easily met in common practice, is introduced to simplify the complicated dependent structures among the selected orders, estimated parameters and future observations. In addition, a simulation study is conducted to illustrate the practical implications of AIC. This study shows that AIC also yields a satisfactory same-realization prediction in finite samples. On the other hand, a limitation of AIC in same-realization settings is pointed out. It is interesting to note that this limitation of AIC does not exist for corresponding independent cases.

Article information

Ann. Statist., Volume 33, Number 5 (2005), 2423-2474.

First available in Project Euclid: 25 November 2005

Permanent link to this document

Digital Object Identifier

Mathematical Reviews number (MathSciNet)

Zentralblatt MATH identifier

Primary: 60M20
Secondary: 62M10: Time series, auto-correlation, regression, etc. [See also 91B84]

Akaike’s information criterion asymptotic efficiency autoregressive process same-realization prediction order selection


Ing, Ching-Kang; Wei, Ching-Zong. Order selection for same-realization predictions in autoregressive processes. Ann. Statist. 33 (2005), no. 5, 2423--2474. doi:10.1214/009053605000000525.

Export citation


  • Akaike, H. (1969). Fitting autoregressive models for prediction. Ann. Inst. Statist. Math. 21 243--247.
  • Akaike, H. (1974). A new look at the statistical model identification. IEEE Trans. Automatic Control 19 716--723.
  • Akaike, H. (1979). A Bayesian extension of the minimum AIC procedure of autoregressive model fitting. Biometrika 66 237--242.
  • Berk, K. N. (1974). Consistent autoregressive spectral estimates. Ann. Statist. 2 489--502.
  • Bhansali, R. J. (1996). Asymptotically efficient autoregressive model selection for multistep prediction. Ann. Inst. Statist. Math. 48 577--602.
  • Bhansali, R. J. and Downham, D. Y. (1977). Some properties of the order of an autoregressive model selected by a generalization of Akaike's FPE criterion. Biometrika 64 547--551.
  • Breiman, L. and Freedman. D. (1983). How many variables should be entered in a regression equation? J. Amer. Statist. Assoc. 78 131--136.
  • Brillinger, D. R. (1975). Time Series: Data Analysis and Theory. Holt, Rinehart and Winston, New York.
  • Burnham, K. P. and Anderson, D. R. (2002). Model Selection and Multimodel Inference: A Practical Information---Theoretic Approach, 2nd ed. Springer, New York.
  • Findley, D. F. and Parzen, E. (1995). A conversation with Hirotugu Akaike. Statist. Sci. 10 104--117.
  • Findley, D. F. and Wei, C.-Z. (1993). Moment bounds for deriving time series CLT's and model selection procedures. Statist. Sinica 3 453--480.
  • Findley, D. F. and Wei, C.-Z. (2002). AIC, overfitting principles, and the boundedness of moments of inverse matrices for vector autoregressions and related models. J. Multivariate Anal. 83 415--450.
  • Hannan, E. J. and Quinn, B. G. (1979). The determination of the order of an autoregression. J. Roy. Statist. Soc. Ser. B 41 190--195.
  • Hocking, R. R. (1976). The analysis and selection of variables in linear regression. Biometrics 32 1--49.
  • Ing, C.-K. (2001). A note on mean-squared prediction errors of the least squares predictors in random walk models. J. Time Ser. Anal. 22 711--724.
  • Ing, C.-K. (2003). Multistep prediction in autoregressive processes. Econometric Theory 19 254--279.
  • Ing, C.-K. and Wei, C.-Z. (2003). On same-realization prediction in an infinite-order autoregressive process. J. Multivariate Anal. 85 130--155.
  • Ing, C.-K. and Yu, S.-H. (2003). On estimating conditional mean-squared prediction error in autoregressive models. J. Time Ser. Anal. 24 401--422.
  • Karagrigoriou, A. (1997). Asymptotic efficiency of the order selection of a non-Gaussian AR process. Statist. Sinica 7 407--423.
  • Kunitomo, N. and Yamamoto, T. (1985). Properties of predictors in misspecified autoregressive time series models. J. Amer. Statist. Assoc. 80 941--950.
  • Lee, S. and Karagrigoriou, A. (2001). An asymptotically optimal selection of the order of a linear process. Sankhyā Ser. A 63 93--106.
  • Mallows, C. L. (1973). Some comments on $C_p$. Technometrics 15 661--675.
  • Schorfheide, F. (2005). VAR forecasting under misspecification. J. Econometrics 128 99--136.
  • Schwarz, G. (1978). Estimating the dimension of a model. Ann. Statist. 6 461--464.
  • Shao, J. (1997). An asymptotic theory for linear model selection (with discussion). Statist. Sinica 7 221--264.
  • Shibata, R. (1976). Selection of the order of an autoregressive model by Akaike's information criterion. Biometrika 63 117--126.
  • Shibata, R. (1980). Asymptotically efficient selection of the order of the model for estimating parameters of a linear process. Ann. Statist. 8 147--164.
  • Shibata, R. (1981). An optimal selection of regression variables. Biometrika 68 45--54.
  • Wei, C.-Z. (1987). Adaptive prediction by least squares predictors in stochastic regression models with applications to time series. Ann. Statist. 15 1667--1682.
  • Zygmund, A. (1959). Trigonometric Series, 2nd ed. Cambridge Univ. Press.