Electronic Journal of Statistics

The Hodrick-Prescott Filter: A special case of penalized spline smoothing

Robert L. Paige and A. Alexandre Trindade

Full-text: Open access

Abstract

We prove that the Hodrick-Prescott Filter (HPF), a commonly used method for smoothing econometric time series, is a special case of a linear penalized spline model with knots placed at all observed time points (except the first and last) and uncorrelated residuals. This equivalence then furnishes a rich variety of existing data-driven parameter estimation methods, particularly restricted maximum likelihood (REML) and generalized cross-validation (GCV). This has profound implications for users of HPF who have hitherto typically relied on subjective choice, rather than estimation, for the smoothing parameter. By viewing estimates as roots of an appropriate quadratic estimating equation, we also present a new approach for constructing confidence intervals for the smoothing parameter. The method is akin to a parametric bootstrap where Monte Carlo simulation is replaced by saddlepoint approximation, and provides a fast and accurate alternative to exact methods, when they exist, e.g. REML. More importantly, it is also the only computationally feasible method when no other methods, exact or otherwise, exist, e.g. GCV. The methodology is demonstrated on the Gross National Product (GNP) series originally analyzed by Hodrick and Prescott (1997). With proper attention paid to residual correlation structure, we show that REML-based estimation delivers an appropriate smooth for both the GNP series and its returns.

Article information

Source
Electron. J. Statist. Volume 4 (2010), 856-874.

Dates
First available in Project Euclid: 15 September 2010

Permanent link to this document
https://projecteuclid.org/euclid.ejs/1284557751

Digital Object Identifier
doi:10.1214/10-EJS570

Mathematical Reviews number (MathSciNet)
MR2721036

Zentralblatt MATH identifier
1329.62200

Subjects
Primary: 62F25: Tolerance and confidence regions
Secondary: 62G09: Resampling methods

Keywords
Semiparametric model parametric bootstrap confidence interval saddlepoint approximation econometric smoothing gross national product

Citation

Paige, Robert L.; Trindade, A. Alexandre. The Hodrick-Prescott Filter: A special case of penalized spline smoothing. Electron. J. Statist. 4 (2010), 856--874. doi:10.1214/10-EJS570. https://projecteuclid.org/euclid.ejs/1284557751.


Export citation

References

  • Brumback, B. A., Ruppert, D. and Wand, M. P. (1999). Comment on “Variable selection and function estimation in additive nonparametric regression using a data-based prior”., Journal of the American Statistical Association 94 794-797.
  • Christensen, R. (1996)., Plane Answers to Complex Questions: The theory of Linear Models. Springer, New York.
  • Crainiceanu, C. and Ruppert, D. (2004). Likelihood ratio tests in linear mixed models with one variance component., Journal of the Royal Statistical Society, Series B 66 165-185.
  • Crainiceanu, C., Ruppert, D., Claeskens, G. and Wand, M. (2005). Exact likelihood ratio tests for penalized splines., Biometrika 92 91-103.
  • Dermoune, A., Djehiche, B. and Rahmania, N. (2008). A consistent estimator of the smoothing parameter in the Hodrick-Prescott filter., Journal of the Japanese Statistical Society 38 225-241.
  • Eilers, P. H. and Marx, B. D. (1996). Flexible smoothing with B-splines and penalties (with discussion)., Statistical Science 11 89-121.
  • Eubank, R. L. (1999)., Nonparametric Regression and Spline Smoothing. Marcel Dekker, New York.
  • Greiner, A. (2009). Estimating penalized spline regressions: Theory and application to economics., Applied Economics Letters 16 1831-1835.
  • Harvey, A. C. and Jaeger, A. (1993). Detrending, stylized facts and the business cycle., Journal of Applied Econometrics 8 231-247.
  • Harvey, A. C. and Trimbur, T. M. (2008). Trend estimation and the Hodrick-Prescott filter., Journal of the Japanese Statistical Society 38 41-49.
  • Harville, D. A. (1977). Maximum likelihood approaches to variance component estimation and to related problems (with discussion)., 72 320-340.
  • Hastie, T. J., Tibshirani, R. and Friedman, J. (2009)., The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd ed. Springer, New York.
  • Hodrick, R. J. and Prescott, E. C. (1981). Postwar U.S. business cycles: an empirical investigation Technical Report No. 451, Northwestern University, Center for Mathematical Studies in Economics & Management, Science.
  • Hodrick, R. J. and Prescott, E. C. (1997). Postwar U.S. business cycles: an empirical investigation., Journal of Money, Credit, and Banking 29 1-16.
  • Kim, S. J., Koh, K., Boyd, S. and Gorinevsky, D. (2009)., 1 trend filtering. SIAM Review 51 339-360.
  • King, R. G. and Rebelo, S. T. (1993). Low frequency filtering and real business cycles., Journal of Economic Dynamics and Control 17 207-231.
  • Krivobokova, T. and Kauermann, G. (2007). A Note on penalized spline smoothing with correlated errors., Journal of the American Statistical Association 102 1328-1337.
  • Li, Y. and Ruppert, D. (2008). On the asymptotics of penalized splines., Biometrika 95 415-436.
  • Opsomer, J., Wang, Y. and Yang, Y. (2001). Nonparametric regression with correlated errors., Statistical Science 16 134-153.
  • Paige, R. L., Trindade, A. A. and Fernando, P. H. (2009). Saddlepoint-based bootstrap inference for quadratic estimating equations., Scandinavian Journal of Statistics 36 98-111.
  • Paige, R. L. and Trindade, A. A. (2010). Fast and accurate inference for the smoothing parameter in semiparametric models Technical Report, Missouri University of Science and Technology/Texas Tech, University.
  • Parker, R. L. and Rice, J. A. (1985). Comments on “Some aspects of the spline smoothing approach to non-parametric regression curve fitting”., Journal of the Royal Statistical Society, Series B 47 40-42.
  • Ruppert, D., Wand, M. P. and Carroll, R. J. (2003)., Semiparametric Regression. Cambridge, London.
  • Ruppert, D., Wand, M. P. and Carroll, R. J. (2009). Semiparametric regression during 2003-2007., Electronic Journal of Statistics 3 1193-1256.
  • Schlicht, E. (2005). Estimating the smoothing parameter in the so-called Hodrick-Prescott filter., Journal of the Japanese Statistical Society 35 99-119.
  • Schlicht, E. (2008). Trend extraction from time series with structural breaks and missing observations., Journal of the Japanese Statistical Society 38 285-292.
  • Trimbur, T. M. (2006). Detrending economic time series: A Bayesian generalization of the Hodrick-Prescott filter., Journal of Forecasting 25 247-273.
  • Wang, X., Shen, J. and Ruppert, D. (2010). Local asymptotics of P-spline smoothing Technical Report, http://arxiv.org/abs/0912.1824.
  • Welham, S. J., Cullis, B. R., Kenward, M. G. and Thompson, R. (2007). A comparison of mixed model splines for curve fitting., Australian and New Zealand Journal of Statistics 49 1-23.