The Annals of Statistics
- Ann. Statist.
- Volume 37, Number 6B (2009), 4131-4152.
Subspace estimation and prediction methods for hidden Markov models
Hidden Markov models (HMMs) are probabilistic functions of finite Markov chains, or, put in other words, state space models with finite state space. In this paper, we examine subspace estimation methods for HMMs whose output lies a finite set as well. In particular, we study the geometric structure arising from the nonminimality of the linear state space representation of HMMs, and consistency of a subspace algorithm arising from a certain factorization of the singular value decomposition of the estimated linear prediction matrix. For this algorithm, we show that the estimates of the transition and emission probability matrices are consistent up to a similarity transformation, and that the m-step linear predictor computed from the estimated system matrices is consistent, i.e., converges to the true optimal linear m-step predictor.
Ann. Statist., Volume 37, Number 6B (2009), 4131-4152.
First available in Project Euclid: 23 October 2009
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Primary: 62M09: Non-Markovian processes: estimation
Secondary: 62M10: Time series, auto-correlation, regression, etc. [See also 91B84] 62M20: Prediction [See also 60G25]; filtering [See also 60G35, 93E10, 93E11] 93B15: Realizations from input-output data 93B30: System identification
Andersson, Sofia; Rydén, Tobias. Subspace estimation and prediction methods for hidden Markov models. Ann. Statist. 37 (2009), no. 6B, 4131--4152. doi:10.1214/09-AOS711. https://projecteuclid.org/euclid.aos/1256303539