The Annals of Applied Probability

Forgetting of the initial distribution for nonergodic Hidden Markov Chains

Randal Douc, Elisabeth Gassiat, Benoit Landelle, and Eric Moulines
Source: Ann. Appl. Probab. Volume 20, Number 5 (2010), 1638-1662.

Abstract

In this paper, the forgetting of the initial distribution for a nonergodic Hidden Markov Models (HMM) is studied. A new set of conditions is proposed to establish the forgetting property of the filter. Both a pathwise and mean convergence of the total variation distance of the filter started from two different initial distributions are obtained. The results are illustrated using a generic nonergodic state-space model for which both pathwise and mean exponential stability is established.

First Page: Show Hide
Primary Subjects: 93E11, 60G35
Secondary Subjects: 62C10
Full-text: Access denied (no subscription detected)
We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber.
If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription. Read more about accessing full-text
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aoap/1282747396
Digital Object Identifier: doi:10.1214/09-AAP632
Zentralblatt MATH identifier: 05795066
Mathematical Reviews number (MathSciNet): MR2724416

References

[1] Atar, R. and Zeitouni, O. (1997). Exponential stability for nonlinear filtering. Ann. Inst. H. Poincaré Probab. Statist. 33 697–725.
Mathematical Reviews (MathSciNet): MR1484538
Zentralblatt MATH: 0888.93057
Digital Object Identifier: doi:10.1016/S0246-0203(97)80110-0
[2] Budhiraja, A. and Ocone, D. (1997). Exponential stability of discrete-time filters for bounded observation noise. Systems Control Lett. 30 185–193.
Mathematical Reviews (MathSciNet): MR1455877
[3] Budhiraja, A. and Ocone, D. (1999). Exponential stability in discrete-time filtering for non-ergodic signals. Stochastic Process. Appl. 82 245–257.
Mathematical Reviews (MathSciNet): MR1700008
Digital Object Identifier: doi:10.1016/S0304-4149(99)00032-0
[4] Chigansky, P., Liptser, R. and van Handel, R. (2009). Intrinsic methods in filter stability. In Handbook of Nonlinear Filtering. Oxford Univ. Press, Oxford.
[5] Crisan, D. and Heine, K. (2008). Stability of the discrete time filter in terms of the tails of noise distributions. J. Lond. Math. Soc. (2) 78 441–458.
Mathematical Reviews (MathSciNet): MR2439634
Zentralblatt MATH: 1148.93036
Digital Object Identifier: doi:10.1112/jlms/jdn032
[6] Del Moral, P. (2004). Feynman–Kac Formulae: Genealogical and Interacting Particle Systems With Applications. Springer, New York.
Mathematical Reviews (MathSciNet): MR2044973
[7] Douc, R., Fort, G., Moulines, E. and Priouret, P. (2009). Forgetting the initial distribution for hidden Markov models. Stochastic Process. Appl. 119 1235–1256.
Mathematical Reviews (MathSciNet): MR2508572
Zentralblatt MATH: 1159.93357
Digital Object Identifier: doi:10.1016/j.spa.2008.05.007
[8] Douc, R., Moulines, É. and Rydén, T. (2004). Asymptotic properties of the maximum likelihood estimator in autoregressive models with Markov regime. Ann. Statist. 32 2254–2304.
Mathematical Reviews (MathSciNet): MR2102510
Zentralblatt MATH: 1056.62028
Digital Object Identifier: doi:10.1214/009053604000000021
Project Euclid: euclid.aos/1098883789
[9] Doucet, A., De Freitas, N. and Gordon, N. (2001). Sequential Monte Carlo Methods in Practice. Information Science and Statistics. Springer, New York.
Mathematical Reviews (MathSciNet): MR1847783
[10] Hu, Z.-C. and Sun, W. (2006). A note on exponential stability of the nonlinear filter for denumerable Markov chains. Systems Control Lett. 55 955–960.
Mathematical Reviews (MathSciNet): MR2260782
[11] Kleptsyna, M. L. and Veretennikov, A. Y. (2008). On discrete time ergodic filters with wrong initial data. Probab. Theory Related Fields 141 411–444.
Mathematical Reviews (MathSciNet): MR2391160
Zentralblatt MATH: 1141.60337
Digital Object Identifier: doi:10.1007/s00440-007-0089-7
[12] Le Gland, F. and Oudjane, N. (2004). Stability and uniform approximation of nonlinear filters using the Hilbert metric and application to particle filters. Ann. Appl. Probab. 14 144–187.
Mathematical Reviews (MathSciNet): MR2023019
Zentralblatt MATH: 1060.93094
Digital Object Identifier: doi:10.1214/aoap/1075828050
Project Euclid: euclid.aoap/1075828050
[13] LeGland, F. and Oudjane, N. (2003). A robustification approach to stability and to uniform particle approximation of nonlinear filters: The example of pseudo-mixing signals. Stochastic Process. Appl. 106 279–316.
Mathematical Reviews (MathSciNet): MR1989630
Zentralblatt MATH: 1075.93541
Digital Object Identifier: doi:10.1016/S0304-4149(03)00041-3
[14] Ocone, D. and Pardoux, E. (1996). Asymptotic stability of the optimal filter with respect to its initial condition. SIAM J. Control Optim. 34 226–243.
Mathematical Reviews (MathSciNet): MR1372912
Zentralblatt MATH: 1035.93508
Digital Object Identifier: doi:10.1137/S0363012993256617
[15] Oudjane, N. and Rubenthaler, S. (2005). Stability and uniform particle approximation of nonlinear filters in case of nonergodic signals. Stoch. Anal. Appl. 23 421–448.
Mathematical Reviews (MathSciNet): MR2140972
Zentralblatt MATH: 1140.93485
Digital Object Identifier: doi:10.1081/SAP-200056643
[16] Ristic, B., Arulampalam, M. and Gordon, A. (2004). Beyond Kalman Filters: Particle Filters for Tracking Applications. Artech House, Boston.
[17] Van Handel, R. (2008). Discrete time nonlinear filters with informative observations are stable. Electron. Commun. Probab. 13 562–575.
Mathematical Reviews (MathSciNet): MR2461532
Zentralblatt MATH: 1189.60133
[18] Van Handel, R. (2009). Uniform observability of hidden Markov models and filter stability for unstable signals. Ann. Appl. Probab. 19 1172–1199.
Mathematical Reviews (MathSciNet): MR2537203
Zentralblatt MATH: 1165.93034
Digital Object Identifier: doi:10.1214/08-AAP576
Project Euclid: euclid.aoap/1245071023
[19] Veretennikov, A. Y. (2002). Coupling method for Markov chains under integral Doeblin type condition. Theory Stoch. Process. 8 383–390.
Mathematical Reviews (MathSciNet): MR2027410
Zentralblatt MATH: 1026.60087

2012 © Institute of Mathematical Statistics

The Annals of Applied Probability

The Annals of Applied Probability