This paper provides an entire inference procedure for the autoregressive model under (conditional) heteroscedasticity of unknown form with a finite variance. We first establish the asymptotic normality of the weighted least absolute deviations estimator (LADE) for the model. Second, we develop the random weighting (RW) method to estimate its asymptotic covariance matrix, leading to the implementation of the Wald test. Third, we construct a portmanteau test for model checking, and use the RW method to obtain its critical values. As a special weighted LADE, the feasible adaptive LADE (ALADE) is proposed and proved to have the same efficiency as its infeasible counterpart. The importance of our entire methodology based on the feasible ALADE is illustrated by simulation results and the real data analysis on three U.S. economic data sets.
References
Amado, C. and Teräsvirta, T. (2013). Modelling volatility by variance decomposition. J. Econometrics 175 142–153. 1283.62180 10.1016/j.jeconom.2013.03.006Amado, C. and Teräsvirta, T. (2013). Modelling volatility by variance decomposition. J. Econometrics 175 142–153. 1283.62180 10.1016/j.jeconom.2013.03.006
Bassett, G. Jr. and Koenker, R. (1978). Asymptotic theory of least absolute error regression. J. Amer. Statist. Assoc. 73 618–622. 0391.62046 10.1080/01621459.1978.10480065Bassett, G. Jr. and Koenker, R. (1978). Asymptotic theory of least absolute error regression. J. Amer. Statist. Assoc. 73 618–622. 0391.62046 10.1080/01621459.1978.10480065
Billingsley, P. (1968). Convergence of Probability Measures. Wiley, New York. 0172.21201Billingsley, P. (1968). Convergence of Probability Measures. Wiley, New York. 0172.21201
Bollerslev, T. (1986). Generalized autoregressive conditional heteroskedasticity. J. Econometrics 31 307–327. MR853051 0616.62119 10.1016/0304-4076(86)90063-1Bollerslev, T. (1986). Generalized autoregressive conditional heteroskedasticity. J. Econometrics 31 307–327. MR853051 0616.62119 10.1016/0304-4076(86)90063-1
Carrasco, M. and Chen, X. (2002). Mixing and moment properties of various GARCH and stochastic volatility models. Econometric Theory 18 17–39. 1181.62125 10.1017/S0266466602181023Carrasco, M. and Chen, X. (2002). Mixing and moment properties of various GARCH and stochastic volatility models. Econometric Theory 18 17–39. 1181.62125 10.1017/S0266466602181023
Carroll, R. J. (1982). Adapting for heteroscedasticity in linear models. Ann. Statist. 10 1224–1233. MR673657 0571.62058 10.1214/aos/1176345987 euclid.aos/1176345987Carroll, R. J. (1982). Adapting for heteroscedasticity in linear models. Ann. Statist. 10 1224–1233. MR673657 0571.62058 10.1214/aos/1176345987 euclid.aos/1176345987
Cavaliere, G. (2004). Unit root tests under time-varying variances. Econometric Rev. 23 259–292. 1133.62350 10.1081/ETC-200028215Cavaliere, G. (2004). Unit root tests under time-varying variances. Econometric Rev. 23 259–292. 1133.62350 10.1081/ETC-200028215
Cavaliere, G. and Taylor, A. M. R. (2007). Testing for unit roots in time series models with non-stationary volatility. J. Econometrics 140 919–947. 1247.91131 10.1016/j.jeconom.2006.07.019Cavaliere, G. and Taylor, A. M. R. (2007). Testing for unit roots in time series models with non-stationary volatility. J. Econometrics 140 919–947. 1247.91131 10.1016/j.jeconom.2006.07.019
Chen, B. and Hong, Y. (2016). Detecting for smooth structural changes in GARCH models. Econometric Theory 32 740–791. 1441.62634 10.1017/S0266466614000942Chen, B. and Hong, Y. (2016). Detecting for smooth structural changes in GARCH models. Econometric Theory 32 740–791. 1441.62634 10.1017/S0266466614000942
Cragg, J. G. (1983). More efficient estimation in the presence of heteroscedasticity of unknown form. Econometrica 51 751–763. 0513.62069 10.2307/1912156Cragg, J. G. (1983). More efficient estimation in the presence of heteroscedasticity of unknown form. Econometrica 51 751–763. 0513.62069 10.2307/1912156
Davidson, J. (2002). Establishing conditions for the functional central limit theorem in nonlinear and semiparametric time series processes. J. Econometrics 106 243–269. 1041.60032 10.1016/S0304-4076(01)00100-2Davidson, J. (2002). Establishing conditions for the functional central limit theorem in nonlinear and semiparametric time series processes. J. Econometrics 106 243–269. 1041.60032 10.1016/S0304-4076(01)00100-2
Davidson, J. (2004). Moment and memory properties of linear conditional heteroscedasticity models, and a new model. J. Bus. Econom. Statist. 22 16–29.Davidson, J. (2004). Moment and memory properties of linear conditional heteroscedasticity models, and a new model. J. Bus. Econom. Statist. 22 16–29.
Davis, R. A. (1996). Gauss–Newton and $M$-estimation for ARMA processes with infinite variance. Stochastic Process. Appl. 63 75–95. MR1411191 10.1016/0304-4149(96)00063-4Davis, R. A. (1996). Gauss–Newton and $M$-estimation for ARMA processes with infinite variance. Stochastic Process. Appl. 63 75–95. MR1411191 10.1016/0304-4149(96)00063-4
Davis, R. A. and Dunsmuir, W. T. M. (1997). Least absolute deviation estimation for regression with ARMA errors. Dedicated to Murray Rosenblatt. J. Theoret. Probab. 10 481–497. 0883.62097 10.1023/A:1022620818679Davis, R. A. and Dunsmuir, W. T. M. (1997). Least absolute deviation estimation for regression with ARMA errors. Dedicated to Murray Rosenblatt. J. Theoret. Probab. 10 481–497. 0883.62097 10.1023/A:1022620818679
Drost, F. C. and Nijman, T. E. (1993). Temporal aggregation of GARCH processes. Econometrica 61 909–927. 0780.62099 10.2307/2951767Drost, F. C. and Nijman, T. E. (1993). Temporal aggregation of GARCH processes. Econometrica 61 909–927. 0780.62099 10.2307/2951767
Engle, R. F. (1982). Autoregressive conditional heteroscedasticity with estimates of the variance of United Kingdom inflation. Econometrica 50 987–1007. 0491.62099 10.2307/1912773Engle, R. F. (1982). Autoregressive conditional heteroscedasticity with estimates of the variance of United Kingdom inflation. Econometrica 50 987–1007. 0491.62099 10.2307/1912773
Escanciano, J. C. (2006). Goodness-of-fit tests for linear and nonlinear time series models. J. Amer. Statist. Assoc. 101 531–541. 1119.62359 10.1198/016214505000001050Escanciano, J. C. (2006). Goodness-of-fit tests for linear and nonlinear time series models. J. Amer. Statist. Assoc. 101 531–541. 1119.62359 10.1198/016214505000001050
Fan, J. and Yao, Q. (1998). Efficient estimation of conditional variance functions in stochastic regression. Biometrika 85 645–660. 0918.62065 10.1093/biomet/85.3.645Fan, J. and Yao, Q. (1998). Efficient estimation of conditional variance functions in stochastic regression. Biometrika 85 645–660. 0918.62065 10.1093/biomet/85.3.645
Fryzlewicz, P., Sapatinas, T. and Subba Rao, S. (2006). A Haar–Fisz technique for locally stationary volatility estimation. Biometrika 93 687–704. 1109.62095 10.1093/biomet/93.3.687Fryzlewicz, P., Sapatinas, T. and Subba Rao, S. (2006). A Haar–Fisz technique for locally stationary volatility estimation. Biometrika 93 687–704. 1109.62095 10.1093/biomet/93.3.687
Giraitis, L., Kokoszka, P. and Leipus, R. (2000). Stationary ARCH models: Dependence structure and central limit theorem. Econometric Theory 16 3–22. 0986.60030 10.1017/S0266466600161018Giraitis, L., Kokoszka, P. and Leipus, R. (2000). Stationary ARCH models: Dependence structure and central limit theorem. Econometric Theory 16 3–22. 0986.60030 10.1017/S0266466600161018
Gonçalves, S. and Kilian, L. (2004). Bootstrapping autoregressions with conditional heteroskedasticity of unknown form. J. Econometrics 123 89–120. 1328.62517 10.1016/j.jeconom.2003.10.030Gonçalves, S. and Kilian, L. (2004). Bootstrapping autoregressions with conditional heteroskedasticity of unknown form. J. Econometrics 123 89–120. 1328.62517 10.1016/j.jeconom.2003.10.030
Gutenbrunner, C. and Jurečková, J. (1992). Regression rank scores and regression quantiles. Ann. Statist. 20 305–330. MR1150346 0759.62015 10.1214/aos/1176348524 euclid.aos/1176348524Gutenbrunner, C. and Jurečková, J. (1992). Regression rank scores and regression quantiles. Ann. Statist. 20 305–330. MR1150346 0759.62015 10.1214/aos/1176348524 euclid.aos/1176348524
Hong, Y. (1996). Consistent testing for serial correlation of unknown form. Econometrica 64 837–864. 0960.62559 10.2307/2171847Hong, Y. (1996). Consistent testing for serial correlation of unknown form. Econometrica 64 837–864. 0960.62559 10.2307/2171847
Hong, Y. and Lee, Y.-J. (2005). Generalized spectral tests for conditional mean models in time series with conditional heteroscedasticity of unknown form. Rev. Econ. Stud. 72 499–541. 1181.91272 10.1111/j.1467-937X.2005.00341.xHong, Y. and Lee, Y.-J. (2005). Generalized spectral tests for conditional mean models in time series with conditional heteroscedasticity of unknown form. Rev. Econ. Stud. 72 499–541. 1181.91272 10.1111/j.1467-937X.2005.00341.x
Jin, Z., Ying, Z. and Wei, L. J. (2001). A simple resampling method by perturbing the minimand. Biometrika 88 381–390. MR1844838 0984.62033 10.1093/biomet/88.2.381Jin, Z., Ying, Z. and Wei, L. J. (2001). A simple resampling method by perturbing the minimand. Biometrika 88 381–390. MR1844838 0984.62033 10.1093/biomet/88.2.381
Kato, K. (2009). Asymptotics for argmin processes: Convexity arguments. J. Multivariate Anal. 100 1816–1829. 1330.62311 10.1016/j.jmva.2009.02.008Kato, K. (2009). Asymptotics for argmin processes: Convexity arguments. J. Multivariate Anal. 100 1816–1829. 1330.62311 10.1016/j.jmva.2009.02.008
Kuersteiner, G. M. (2002). Efficient IV estimation for autoregressive models with conditional heteroskedasticity. Econometric Theory 18 547–583. 1109.62338 10.1017/S0266466602183010Kuersteiner, G. M. (2002). Efficient IV estimation for autoregressive models with conditional heteroskedasticity. Econometric Theory 18 547–583. 1109.62338 10.1017/S0266466602183010
Liu, R. Y. (1988). Bootstrap procedures under some non-i.i.d. models. Ann. Statist. 16 1696–1708. 0655.62031 10.1214/aos/1176351062 euclid.aos/1176351062Liu, R. Y. (1988). Bootstrap procedures under some non-i.i.d. models. Ann. Statist. 16 1696–1708. 0655.62031 10.1214/aos/1176351062 euclid.aos/1176351062
Mikosch, T. and Stǎricǎ, C. (2004). Nonstationarities in financial time series, the long-range dependence, and the IGARCH effects. Rev. Econ. Stat. 86 378–390.Mikosch, T. and Stǎricǎ, C. (2004). Nonstationarities in financial time series, the long-range dependence, and the IGARCH effects. Rev. Econ. Stat. 86 378–390.
Nicholls, D. F. and Pagan, A. R. (1983). Heteroscedasticity in models with lagged dependent variables. Econometrica 51 1233–1242. 0531.62098 10.2307/1912061Nicholls, D. F. and Pagan, A. R. (1983). Heteroscedasticity in models with lagged dependent variables. Econometrica 51 1233–1242. 0531.62098 10.2307/1912061
Pan, J., Wang, H. and Yao, Q. (2007). Weighted least absolute deviations estimation for ARMA models with infinite variance. Econometric Theory 23 852–879. 1237.62122 10.1017/S0266466607070363Pan, J., Wang, H. and Yao, Q. (2007). Weighted least absolute deviations estimation for ARMA models with infinite variance. Econometric Theory 23 852–879. 1237.62122 10.1017/S0266466607070363
Phillips, P. C. B. and Xu, K.-L. (2006). Inference in autoregression under heteroskedasticity. J. Time Series Anal. 27 289–308. 1111.62082 10.1111/j.1467-9892.2005.00466.xPhillips, P. C. B. and Xu, K.-L. (2006). Inference in autoregression under heteroskedasticity. J. Time Series Anal. 27 289–308. 1111.62082 10.1111/j.1467-9892.2005.00466.x
Pollard, D. (1984). Convergence of Stochastic Processes. Springer Series in Statistics. Springer, New York. MR762984 0544.60045Pollard, D. (1984). Convergence of Stochastic Processes. Springer Series in Statistics. Springer, New York. MR762984 0544.60045
Robinson, P. M. (1987). Asymptotically efficient estimation in the presence of heteroskedasticity of unknown form. Econometrica 55 875–891. 0651.62107 10.2307/1911033Robinson, P. M. (1987). Asymptotically efficient estimation in the presence of heteroskedasticity of unknown form. Econometrica 55 875–891. 0651.62107 10.2307/1911033
Robinson, P. M. (1989). Nonparametric estimation of time-varying parameters. In Statistical Analysis and Forecasting of Economic Structural Change (P. Hackl, ed.) 253–264. Springer, Berlin.Robinson, P. M. (1989). Nonparametric estimation of time-varying parameters. In Statistical Analysis and Forecasting of Economic Structural Change (P. Hackl, ed.) 253–264. Springer, Berlin.
Robinson, P. M. (1991). Testing for strong serial correlation and dynamic conditional heteroskedasticity in multiple regression. J. Econometrics 47 67–84. 0734.62070 10.1016/0304-4076(91)90078-RRobinson, P. M. (1991). Testing for strong serial correlation and dynamic conditional heteroskedasticity in multiple regression. J. Econometrics 47 67–84. 0734.62070 10.1016/0304-4076(91)90078-R
Robinson, P. M. (2012). Nonparametric trending regression with cross-sectional dependence. J. Econometrics 169 4–14. 1443.62105 10.1016/j.jeconom.2012.01.005Robinson, P. M. (2012). Nonparametric trending regression with cross-sectional dependence. J. Econometrics 169 4–14. 1443.62105 10.1016/j.jeconom.2012.01.005
Shao, Q.-M. and Yu, H. (1996). Weak convergence for weighted empirical processes of dependent sequences. Ann. Probab. 24 2098–2127. 0874.60006 10.1214/aop/1065725185 euclid.aop/1041903220Shao, Q.-M. and Yu, H. (1996). Weak convergence for weighted empirical processes of dependent sequences. Ann. Probab. 24 2098–2127. 0874.60006 10.1214/aop/1065725185 euclid.aop/1041903220
Wu, C.-F. J. (1986). Jackknife, bootstrap and other resampling methods in regression analysis. Ann. Statist. 14 1261–1350. 0618.62072 10.1214/aos/1176350142 euclid.aos/1176350142Wu, C.-F. J. (1986). Jackknife, bootstrap and other resampling methods in regression analysis. Ann. Statist. 14 1261–1350. 0618.62072 10.1214/aos/1176350142 euclid.aos/1176350142
Wu, W. B. (2005). Nonlinear system theory: Another look at dependence. Proc. Natl. Acad. Sci. USA 102 14150–14154. 1135.62075 10.1073/pnas.0506715102Wu, W. B. (2005). Nonlinear system theory: Another look at dependence. Proc. Natl. Acad. Sci. USA 102 14150–14154. 1135.62075 10.1073/pnas.0506715102
Xu, K.-L. and Phillips, P. C. B. (2008). Adaptive estimation of autoregressive models with time-varying variances. J. Econometrics 142 265–280. MR2408736 1418.62359 10.1016/j.jeconom.2007.06.001Xu, K.-L. and Phillips, P. C. B. (2008). Adaptive estimation of autoregressive models with time-varying variances. J. Econometrics 142 265–280. MR2408736 1418.62359 10.1016/j.jeconom.2007.06.001
Yao, Q. and Brockwell, P. J. (2006). Gaussian maximum likelihood estimation for ARMA models. I. Time series. J. Time Series Anal. 27 857–875. 1141.62074 10.1111/j.1467-9892.2006.00492.xYao, Q. and Brockwell, P. J. (2006). Gaussian maximum likelihood estimation for ARMA models. I. Time series. J. Time Series Anal. 27 857–875. 1141.62074 10.1111/j.1467-9892.2006.00492.x
Yu, K. and Jones, M. C. (2004). Likelihood-based local linear estimation of the conditional variance function. J. Amer. Statist. Assoc. 99 139–144. 1089.62507 10.1198/016214504000000133Yu, K. and Jones, M. C. (2004). Likelihood-based local linear estimation of the conditional variance function. J. Amer. Statist. Assoc. 99 139–144. 1089.62507 10.1198/016214504000000133
Zhang, R. and Ling, S. (2015). Asymptotic inference for AR models with heavy-tailed G-GARCH noises. Econometric Theory 31 880–890. 1441.62913 10.1017/S0266466614000632Zhang, R. and Ling, S. (2015). Asymptotic inference for AR models with heavy-tailed G-GARCH noises. Econometric Theory 31 880–890. 1441.62913 10.1017/S0266466614000632
Zhao, Q. (2001). Asymptotically efficient median regression in the presence of heteroskedasticity of unknown form. Econometric Theory 17 765–784. 1109.62327 10.1017/S0266466601174050Zhao, Q. (2001). Asymptotically efficient median regression in the presence of heteroskedasticity of unknown form. Econometric Theory 17 765–784. 1109.62327 10.1017/S0266466601174050
Zhou, Z. and Wu, W. B. (2009). Local linear quantile estimation for nonstationary time series. Ann. Statist. 37 2696–2729. 1173.62066 10.1214/08-AOS636 euclid.aos/1247836666Zhou, Z. and Wu, W. B. (2009). Local linear quantile estimation for nonstationary time series. Ann. Statist. 37 2696–2729. 1173.62066 10.1214/08-AOS636 euclid.aos/1247836666
Zhu, K. (2016). Bootstrapping the portmanteau tests in weak auto-regressive moving average models. J. R. Stat. Soc. Ser. B. Stat. Methodol. 78 463–485. 1414.62345 10.1111/rssb.12112Zhu, K. (2016). Bootstrapping the portmanteau tests in weak auto-regressive moving average models. J. R. Stat. Soc. Ser. B. Stat. Methodol. 78 463–485. 1414.62345 10.1111/rssb.12112
Zhu, K. (2019). Supplement to “Statistical inference for autoregressive models under heteroscedasticity of unknown form.” DOI:10.1214/18-AOS1775SUPP. 1436.62444 10.1214/18-AOS1775 euclid.aos/1572487390Zhu, K. (2019). Supplement to “Statistical inference for autoregressive models under heteroscedasticity of unknown form.” DOI:10.1214/18-AOS1775SUPP. 1436.62444 10.1214/18-AOS1775 euclid.aos/1572487390
Zhu, K. and Li, W. K. (2015). A bootstrapped spectral test for adequacy in weak ARMA models. J. Econometrics 187 113–130. 1337.62285 10.1016/j.jeconom.2015.02.005Zhu, K. and Li, W. K. (2015). A bootstrapped spectral test for adequacy in weak ARMA models. J. Econometrics 187 113–130. 1337.62285 10.1016/j.jeconom.2015.02.005
Zhu, K. and Ling, S. (2012). The global weighted LAD estimators for finite/infinite variance $\operatorname{ARMA}(p,q)$ models. Econometric Theory 28 1065–1086. 1251.91048 10.1017/S0266466612000059Zhu, K. and Ling, S. (2012). The global weighted LAD estimators for finite/infinite variance $\operatorname{ARMA}(p,q)$ models. Econometric Theory 28 1065–1086. 1251.91048 10.1017/S0266466612000059
Zhu, K. and Ling, S. (2015). LADE-based inference for ARMA models with unspecified and heavy-tailed heteroscedastic noises. J. Amer. Statist. Assoc. 110 784–794. 1373.62440 10.1080/01621459.2014.977386Zhu, K. and Ling, S. (2015). LADE-based inference for ARMA models with unspecified and heavy-tailed heteroscedastic noises. J. Amer. Statist. Assoc. 110 784–794. 1373.62440 10.1080/01621459.2014.977386
