The Annals of Statistics

Sequential change-point detection when unknown parameters are present in the pre-change distribution

Yajun Mei

Full-text: Open access


In the sequential change-point detection literature, most research specifies a required frequency of false alarms at a given pre-change distribution fθ and tries to minimize the detection delay for every possible post-change distribution gλ. In this paper, motivated by a number of practical examples, we first consider the reverse question by specifying a required detection delay at a given post-change distribution and trying to minimize the frequency of false alarms for every possible pre-change distribution fθ. We present asymptotically optimal procedures for one-parameter exponential families. Next, we develop a general theory for change-point problems when both the pre-change distribution fθ and the post-change distribution gλ involve unknown parameters. We also apply our approach to the special case of detecting shifts in the mean of independent normal observations.

Article information

Ann. Statist., Volume 34, Number 1 (2006), 92-122.

First available in Project Euclid: 2 May 2006

Permanent link to this document

Digital Object Identifier

Mathematical Reviews number (MathSciNet)

Zentralblatt MATH identifier

Primary: 62L10: Sequential analysis 62L15: Optimal stopping [See also 60G40, 91A60]
Secondary: 62F05: Asymptotic properties of tests

Asymptotic optimality change-point optimizer power one tests quality control statistical process control surveillance


Mei, Yajun. Sequential change-point detection when unknown parameters are present in the pre-change distribution. Ann. Statist. 34 (2006), no. 1, 92--122. doi:10.1214/009053605000000859.

Export citation


  • Basseville, M. and Nikiforov, I. (1993). Detection of Abrupt Changes: Theory and Application. Prentice–Hall, Englewood Cliffs, NJ.
  • Berger, R. L. and Hsu, J. C. (1996). Bioequivalence trials, intersection-union tests and equivalence confidence sets (with discussion). Statist. Sci. 11 283–319.
  • Chow, Y. S., Hsiung, C. A. and Lai, T. L. (1979). Extended renewal theory and moment convergence in Anscombe's theorem. Ann. Probab. 7 304–318.
  • Feller, W. (1971). An Introduction to Probability Theory and Its Applications 2, 2nd ed. Wiley, New York.
  • Gordon, L. and Pollak, M. (1995). A robust surveillance scheme for stochastically ordered alternatives. Ann. Statist. 23 1350–1375.
  • Gordon, L. and Pollak, M. (1997). Average run length to false alarm for surveillance schemes designed with partially specified pre-change distribution. Ann. Statist. 25 1284–1310.
  • Kiefer, J. and Sacks, J. (1963). Asymptotically optimum sequential inference and design. Ann. Math. Statist. 34 705–750.
  • Krieger, A. M., Pollak, M. and Yakir, B. (2003). Surveillance of a simple linear regression. J. Amer. Statist. Assoc. 98 456–469.
  • Lai, T. L. (1995). Sequential change-point detection in quality control and dynamical systems (with discussion). J. Roy. Statist. Soc. Ser. B 57 613–658.
  • Lai, T. L. (1998). Information bounds and quick detection of parameter changes in stochastic systems. IEEE Trans. Inform. Theory 44 2917–2929.
  • Lai, T. L. (2001). Sequential analysis: Some classical problems and new challenges (with discussion). Statist. Sinica 11 303–408.
  • Lehmann, E. L. (1959). Testing Statistical Hypotheses. Wiley, New York.
  • Lorden, G. (1970). On excess over the boundary. Ann. Math. Statist. 41 520–527.
  • Lorden, G. (1971). Procedures for reacting to a change in distribution. Ann. Math. Statist. 42 1897–1908.
  • Lorden, G. (1973). Open-ended tests for Koopman–Darmois families. Ann. Statist. 1 633–643.
  • Moustakides, G. V. (1986). Optimal stopping times for detecting changes in distributions. Ann. Statist. 14 1379–1387.
  • Page, E. S. (1954). Continuous inspection schemes. Biometrika 41 100–115.
  • Pollak, M. (1978). Optimality and almost optimality of mixture stopping rules. Ann. Statist. 6 910–916.
  • Pollak, M. (1985). Optimal detection of a change in distribution. Ann. Statist. 13 206–227.
  • Pollak, M. (1987). Average run lengths of an optimal method of detecting a change in distribution. Ann. Statist. 15 749–779.
  • Pollak, M. and Siegmund, D. (1985). A diffusion process and its applications to detecting a change in the drift of Brownian motion. Biometrika 72 267–280.
  • Pollak, M. and Siegmund, D. (1991). Sequential detection of a change in a normal mean when the initial value is unknown. Ann. Statist. 19 394–416.
  • Ritov, Y. (1990). Decision theoretic optimality of the CUSUM procedure. Ann. Statist. 18 1464–1469.
  • Roberts, S. W. (1966). A comparison of some control chart procedures. Technometrics 8 411–430.
  • Shiryayev, A. N. (1963). On optimum methods in quickest detection problems. Theory Probab. Appl. 8 22–46.
  • Shiryayev, A. N. (1978). Optimal Stopping Rules. Springer, New York.
  • Siegmund, D. (1969). The variance of one-sided stopping rules. Ann. Math. Statist. 40 1074–1077.
  • Siegmund, D. (1985). Sequential Analysis: Tests and Confidence Intervals. Springer, New York.
  • Siegmund, D. and Venkatraman, E. S. (1995). Using the generalized likelihood ratio statistics for sequential detection of a change-point. Ann. Statist. 23 255–271.
  • Stoumbos, Z., Reynolds, M. R. Jr., Ryan, T. P. and Woodall, W. H. (2000). The state of statistical process control as we proceed into the 21st Century. J. Amer. Statist. Assoc. 95 992–998.
  • Van Dobben de Bruyn, C. S. (1968). Cumulative Sum Tests. Hafner, New York.
  • Wald, A. and Wolfowitz, J. (1948). Optimum character of the sequential probability ratio test. Ann. Math. Statist. 19 326–339.
  • Yakir, B. (1998). On the average run length to false alarm in surveillance problems which possess an invariance structure. Ann. Statist. 26 1198–1214.
  • Yakir, B., Krieger, A. M. and Pollak, M. (1999). Detecting a change in regression: First order optimality. Ann. Statist. 27 1896–1913.