The Annals of Applied Statistics

Exact asymptotic distribution of change-point mle for change in the mean of Gaussian sequences

Stergios B. Fotopoulos, Venkata K. Jandhyala, and Elena Khapalova

Full-text: Open access

Abstract

We derive exact computable expressions for the asymptotic distribution of the change-point mle when a change in the mean occurred at an unknown point of a sequence of time-ordered independent Gaussian random variables. The derivation, which assumes that nuisance parameters such as the amount of change and variance are known, is based on ladder heights of Gaussian random walks hitting the half-line. We then show that the exact distribution easily extends to the distribution of the change-point mle when a change occurs in the mean vector of a multivariate Gaussian process. We perform simulations to examine the accuracy of the derived distribution when nuisance parameters have to be estimated as well as robustness of the derived distribution to deviations from Gaussianity. Through simulations, we also compare it with the well-known conditional distribution of the mle, which may be interpreted as a Bayesian solution to the change-point problem. Finally, we apply the derived methodology to monthly averages of water discharges of the Nacetinsky creek, Germany.

Article information

Source
Ann. Appl. Stat. Volume 4, Number 2 (2010), 1081-1104.

Dates
First available: 3 August 2010

Permanent link to this document
http://projecteuclid.org/euclid.aoas/1280842153

Digital Object Identifier
doi:10.1214/09-AOAS294

Mathematical Reviews number (MathSciNet)
MR2758434

Citation

Fotopoulos, Stergios B.; Jandhyala, Venkata K.; Khapalova, Elena. Exact asymptotic distribution of change-point mle for change in the mean of Gaussian sequences. The Annals of Applied Statistics 4 (2010), no. 2, 1081--1104. doi:10.1214/09-AOAS294. http://projecteuclid.org/euclid.aoas/1280842153.


Export citation

References

  • Andrews, D. W. K. and Ploberger, W. (1994). Optimal tests when a nuisance parameter is present only under the alternative. Econometrica 62 1383–1414.
  • Asmussen, S. (1987). Applied Probability and Queues. Wiley, New York.
  • Basseville, M. and Nikiforov, I. V. (1993). Detection of Abrupt Changes: Theory and Application. Prentice Hall, Englewood Cliffs, NJ.
  • Borovkov, A. A. (1999). Asymptotically optimal solutions in the change-point problem. Theory Probab. Appl. 43 539–561.
  • Braun, J. V. and Müller, H.-G. (1998). Statistical methods for DNA sequence segmentation. Statist. Sci. 13 142–162.
  • Brodsky, B. E. and Darkhovsky, B. S. (1993). Nonparametric Methods in Change-point Problems. Springer, New York.
  • Brodsky, B. E. and Darkhovsky, B. S. (2000). Non-parametric Statistical Diagnosis: Problems and Methods. Mathematics and Its Applications 509. Kluwer Academic, Dordrecht.
  • Chen, J. and Gupta, A. K. (2000). Parametric Statistical Change Point Analysis. Birkhäuser, New York.
  • Chover, J., Ney, P. and Wainger, S. (1973). Functions on probability measures. J. Anal. Math. 26 255–302.
  • Cobb, G. W. (1978). The problem of the Nile: Conditional solution to a change-point problem. Biometrika 65 243–251.
  • Csörgő, M. and Horváth, L. (1997). Limit Theorems in Change-Point Analysis. Wiley, New York.
  • DeGaetano, A. T. (2006). Attributes of several methods for detecting discontinuities in temperature series: Prospects for a hybrid homogenization procedure. J. Climate 9 1646–1660.
  • Fealy, R. and Sweeney, J. (2005). Detection of a possible change point in atmospheric variability in the North Atlantic and its effect on Scandinavian glacier mass balance. Int. J. Climatol. 25 1819–1833.
  • Fearnhead, P. (2006). Exact and efficient Bayesian inference for multiple change-point problems. Stat. Comput. 16 203–213.
  • Fearnhead, P. and Liu, Z. (2007). On-line inference for multiple change points problems. J. Roy. Statist. Soc. Ser. B 69 589–605.
  • Feller, W. R. (1971). An Introduction to Probability Theory and Its Applications, Vol. II. Wiley, New York.
  • Fotopoulos, S. B. and Jandhyala, V. K. (2001). Maximum likelihood estimation of a change-point for exponentially distributed random variables. Statist. Probab. Lett. 51 423–429.
  • Fotopoulos, S. B. (2009). The geometric convergence rate of the classical change-point estimate. Statist. Probab. Lett. 79 131–137.
  • Girón, F. J., Moreno, E. and Casella, G. (2007). Objective Bayesian analysis of multiple changepoints for linear models (with discussion). In Bayesian Statistics 8 (J. M. Bernardo, M. J. Bayarri and J. O. Berger, eds) 227–252. Oxford Univ. Press, Oxford.
  • Gombay, E. and Horváth, L. (1997). An application of the likelihood method to change-point detection. Environmetrics 8 459–467.
  • Hansen, B. E. (2000). Testing for structural change in conditional models. J. Econometrics 97 93–115.
  • Hinkley, D. V. (1970). Inference about the change-point in a sequence of random variables. Biometrika 57 1–17.
  • Hinkley, D. V. (1971). Inference about the change-point from cumulative sum tests. Biometrika 58 509–523.
  • Hinkley, D. V. (1972). Time ordered classification. Biometrika 59 509–523.
  • Hu, I. and Rukhin, A. L. (1995). A lower bound for error probability in change-point estimation. Statist. Sinica 5 319–331.
  • Jandhyala, V. K. and Fotopoulos, S. B. (1999). Capturing the distributional behavior of the maximum likelihood estimator of a change-point. Biometrika 86 129–140.
  • Jandhyala, V. K. and Fotopoulos, S. B. (2001). Rate of convergence of the maximum likelihood estimate of a change-point. Sankhyā Ser. A 63 277–285.
  • Jarušková, D. (1996). Change-point measurement in meteorological measurement. Mon. Weather Rev. 124 1535–1543.
  • Kaplan, A. Y. and Shishkin, S. L. (2000). Application of the change-point analysis to the investigation of the brain’s electrical activity. In Non-Parametric Statistical Diagnosis: Problems and Methods (B. E. Brodsky and B. S. Darkhovsky, eds.) 333–388. Kluwer, Dordrecht.
  • Lai, T. L. (1995). Sequential change-point detection in quality control and dynamical systems. J. Roy. Statist. Soc. Ser. B 57 613–658.
  • Lebarbier, L. (2005). Detecting multiple change-points in the mean of Gaussian process by model selection. Sign. Proc. 85 717–736.
  • Page, E. S. (1955). A test for a change in a parameter occurring at an unknown point. Biometrika 42 523–526.
  • Perreault, L., Bernier, J., Bobée, B. and Parent, E. (2000a). Bayesian change-point analysis in hydrometeorological time series. Part 1. Normal model revisited. J. Hydrol. 235 221–241.
  • Perreault, L., Bernier, J., Bobée, B. and Parent, E. (2000b). Bayesian change-point analysis in hydrometeorological time series. Part 2. Comparison of change-point models and forecasting. J. Hydrol. 235 242–263.
  • Ruggieri, E., Herbert, T., Lawrence, K. T. and Lawrence, C. E. (2009). Change point method for detecting regime shifts in paleoclimatic time series: Application to δ18O time series of the Plio-Pleistocene. Paleoceanography 24 PA1204, DOI: 10.1029/2007PA001568.
  • Seidou, O. and Ouarda, T. B. M. J. (2007). Recursion-based multiple changepoint detection in multiple linear regression and application to river streamflows. Water Resour. Res. 43, DOI: 10.1029/2006WR005021.
  • Shiryaev, A. N., Kabanov, Y. M., Kramkov, D. O. and Melnikov, A. V. (1994). Towards the theory of pricing of options of both European and American types, II, continuous time. Theory Probab. Appl. 39 61–102.
  • Wu, Y. (2005). Inference for Change-Point and Post-Change Means After a CUSUM Test. Lecture Notes in Math. 180. Springer, New York.
  • Wu, Q.-Z., Cheng, H.-Y. and Jeng, B.-S. (2005). Motion detection via change-point detection for cumulative histograms of ratio images. Pattern. Recog. Lett. 26 555–563.
  • Zou, C., Qiu, P. and Hawkins, D. (2009). Nonparametric control chart for monitoring profiles using change point formulation and adaptive smoothing. Statist. Sinica 19 1337–1357.