The exponential stability and the concentration properties of a class of extended Kalman-Bucy filters are analyzed. New estimation concentration inequalities around partially observed signals are derived in terms of the stability properties of the filters. These non asymptotic exponential inequalities allow to design confidence interval type estimates in terms of the filter forgetting properties with respect to erroneous initial conditions. For uniformly stable and fully observable signals, we also provide explicit non-asymptotic estimates for the exponential forgetting rate of the filters and the associated stochastic Riccati equations w.r.t. Frobenius norms. These non asymptotic exponential concentration and quantitative stability estimates seem to be the first results of this type for this class of nonlinear filters. Our techniques combine $\chi $-square concentration inequalities and Laplace estimates with spectral and random matrices theory, and the non asymptotic stability theory of quadratic type stochastic processes.
References
[1] H. Abou-Kandil, G. Freiling, V. Ionescu, G. Jank. Matrix Riccati Equations in Control and Systems Theory. Birkhäuser, Basel, Switzerland (2003). 1027.93001[1] H. Abou-Kandil, G. Freiling, V. Ionescu, G. Jank. Matrix Riccati Equations in Control and Systems Theory. Birkhäuser, Basel, Switzerland (2003). 1027.93001
[2] B. D. O. Anderson. Stability properties of Kalman-Bucy filters. Journal of the Franklin Institute 291, no. 2, pp. 137–144 (1971). 0275.93044 10.1016/0016-0032(71)90016-0[2] B. D. O. Anderson. Stability properties of Kalman-Bucy filters. Journal of the Franklin Institute 291, no. 2, pp. 137–144 (1971). 0275.93044 10.1016/0016-0032(71)90016-0
[3] J. S. Baras, A. Bensoussan, M. R. James. Dynamic observers as asymptotic limits of recursive filters: special cases. SIAM J. Appl. Math. 48, pp. 1147–1158 (1988). 0658.93017 10.1137/0148068[3] J. S. Baras, A. Bensoussan, M. R. James. Dynamic observers as asymptotic limits of recursive filters: special cases. SIAM J. Appl. Math. 48, pp. 1147–1158 (1988). 0658.93017 10.1137/0148068
[4] T. Berry, J. Harlim. Linear theory for filtering nonlinear multiscale systems with model error. Proc. R. Soc. Lond. Ser. A Math. Phys. Eng. Sci. 470, no. 2167 (2014). 1371.60068 10.1098/rspa.2014.0168[4] T. Berry, J. Harlim. Linear theory for filtering nonlinear multiscale systems with model error. Proc. R. Soc. Lond. Ser. A Math. Phys. Eng. Sci. 470, no. 2167 (2014). 1371.60068 10.1098/rspa.2014.0168
[5] M. Boutayeb, H. Rafaralahy, M. Darouach. Convergence analysis of the extended Kalman filter used as an observer for nonlinear deterministic discrete-time systems. IEEE Transactions on Automatic Control 42 (1997). 0876.93089 10.1109/9.566674[5] M. Boutayeb, H. Rafaralahy, M. Darouach. Convergence analysis of the extended Kalman filter used as an observer for nonlinear deterministic discrete-time systems. IEEE Transactions on Automatic Control 42 (1997). 0876.93089 10.1109/9.566674
[6] S. Bonnabel, J. J. Slotine. A contraction theory-based analysis of the stability of the Extended Kalman Filter. IEEE Trans. Automatic Control 60, no. 2, pp. 565–569 (2015). 1360.93688 10.1109/TAC.2014.2336991[6] S. Bonnabel, J. J. Slotine. A contraction theory-based analysis of the stability of the Extended Kalman Filter. IEEE Trans. Automatic Control 60, no. 2, pp. 565–569 (2015). 1360.93688 10.1109/TAC.2014.2336991
[7] R. S. Bucy, P. D. Joseph. Filtering for Stochastic Processes with Applications to Guidance, John Wiley & Sons (1968); 2nd Edition, AMS Chelsea Publ. (2005). 0174.21903[7] R. S. Bucy, P. D. Joseph. Filtering for Stochastic Processes with Applications to Guidance, John Wiley & Sons (1968); 2nd Edition, AMS Chelsea Publ. (2005). 0174.21903
[8] R. S. Bucy, R. E Kalman. New Results in Linear Filtering and Prediction Theory. Transactions of the ASME – Journal of Basic Engineering 83, pp. 95–107 (1961).[8] R. S. Bucy, R. E Kalman. New Results in Linear Filtering and Prediction Theory. Transactions of the ASME – Journal of Basic Engineering 83, pp. 95–107 (1961).
[9] R. Carmona, J.-P. Fouque, L.-H. Sun. Mean Field Games and Systemic Risk. Communications in Mathematical Sciences 13, no. 4, pp. 911–933 (2015). 1337.91031 10.4310/CMS.2015.v13.n4.a4[9] R. Carmona, J.-P. Fouque, L.-H. Sun. Mean Field Games and Systemic Risk. Communications in Mathematical Sciences 13, no. 4, pp. 911–933 (2015). 1337.91031 10.4310/CMS.2015.v13.n4.a4
[10] A. Cuzol, P. Hellier, E. Mémin. A low dimensional fluid motion estimator. International Journal of Computer Vision 75, no. 3, pp. 329–349 (2007).[10] A. Cuzol, P. Hellier, E. Mémin. A low dimensional fluid motion estimator. International Journal of Computer Vision 75, no. 3, pp. 329–349 (2007).
[11] A. Cuzol, E. Mémin. Vortex and source particles for fluid motion estimation. 5th Int. Conf. on Scale-Space and PDE methods in Computer Vision, Scale-Space’05, Hofgeismar, Germany, Apr. (2005). 1119.68467[11] A. Cuzol, E. Mémin. Vortex and source particles for fluid motion estimation. 5th Int. Conf. on Scale-Space and PDE methods in Computer Vision, Scale-Space’05, Hofgeismar, Germany, Apr. (2005). 1119.68467
[12] A. Cuzol, E. Mémin. A stochastic filter for fluid motion tracking. 10th IEEE International Conference on Computer Vision, ICCV’05, Beijing, China, Oct. (2005).[12] A. Cuzol, E. Mémin. A stochastic filter for fluid motion tracking. 10th IEEE International Conference on Computer Vision, ICCV’05, Beijing, China, Oct. (2005).
[13] A. Cuzol, E. Mémin. A stochastic filtering technique for fluid flows velocity fields tracking. IEEE PAMI (Pattern Analysis and Machine Intelligence) 31, no. 7, pp. 1278–1293 (2009).[13] A. Cuzol, E. Mémin. A stochastic filtering technique for fluid flows velocity fields tracking. IEEE PAMI (Pattern Analysis and Machine Intelligence) 31, no. 7, pp. 1278–1293 (2009).
[15] P. Del Moral, A. Kurtzmann, J. Tugaut. On the stability and the uniform propagation of chaos of a class of extended ensemble Kalman-Bucy filters. SIAM J. Control Optim 55, no. 1, pp. 119–155 (2017). 1356.60065 10.1137/16M1087497[15] P. Del Moral, A. Kurtzmann, J. Tugaut. On the stability and the uniform propagation of chaos of a class of extended ensemble Kalman-Bucy filters. SIAM J. Control Optim 55, no. 1, pp. 119–155 (2017). 1356.60065 10.1137/16M1087497
[16] P. Del Moral, J. Tugaut. On the stability and the uniform propagation of chaos properties of Ensemble Kalman-Bucy filters. Ann. Appl. Probab. 28, no. 2, pp. 790–850 (2018). 1391.60082 10.1214/17-AAP1317 euclid.aoap/1523433625[16] P. Del Moral, J. Tugaut. On the stability and the uniform propagation of chaos properties of Ensemble Kalman-Bucy filters. Ann. Appl. Probab. 28, no. 2, pp. 790–850 (2018). 1391.60082 10.1214/17-AAP1317 euclid.aoap/1523433625
[17] J.-P. Fouque and L.-H. Sun. Systemic Risk Illustrated, Handbook on Systemic Risk, Eds. J.-P. Fouque and J. Langsam. Cambridge University Press (2013). 1305.91014[17] J.-P. Fouque and L.-H. Sun. Systemic Risk Illustrated, Handbook on Systemic Risk, Eds. J.-P. Fouque and J. Langsam. Cambridge University Press (2013). 1305.91014
[18] G. Freiling, V. Ionescu, H. Abou-Kandil and G. Jank. Matrix Riccati Equations in Control and Systems Theory, Birkhauser, Boston (2003). 1027.93001[18] G. Freiling, V. Ionescu, H. Abou-Kandil and G. Jank. Matrix Riccati Equations in Control and Systems Theory, Birkhauser, Boston (2003). 1027.93001
[21] V. Karvonen. Stability of linear and non-linear Kalman filters Master thesis, University of Helsinki (2014).[21] V. Karvonen. Stability of linear and non-linear Kalman filters Master thesis, University of Helsinki (2014).
[22] A. J. Krener. The convergence of the extended Kalman filter. In Rantzer, A. and Byrnes, C. I., editors. Directions in Mathematical Systems Theory and Optimization. vol. 286, Lecture Notes in Control and Information Sciences, Chapter 12, pp. 173–182. Springer-Verlag, Berlin, Heidelberg (2003). 1041.93053[22] A. J. Krener. The convergence of the extended Kalman filter. In Rantzer, A. and Byrnes, C. I., editors. Directions in Mathematical Systems Theory and Optimization. vol. 286, Lecture Notes in Control and Information Sciences, Chapter 12, pp. 173–182. Springer-Verlag, Berlin, Heidelberg (2003). 1041.93053
[23] W. Lohmiller and J. J. E. Slotine. On contraction analysis for nonlinear systems. Automatica, 34, no. 6, pp. 683–696 (1998). 0934.93034 10.1016/S0005-1098(98)00019-3[23] W. Lohmiller and J. J. E. Slotine. On contraction analysis for nonlinear systems. Automatica, 34, no. 6, pp. 683–696 (1998). 0934.93034 10.1016/S0005-1098(98)00019-3
[24] W. Lohmiller, J. J. E. Slotine. Contraction Analysis of Nonlinear Distributed Systems. International Journal of Control 78, no. 9 (2005). 1108.93047 10.1080/00207170500130952[24] W. Lohmiller, J. J. E. Slotine. Contraction Analysis of Nonlinear Distributed Systems. International Journal of Control 78, no. 9 (2005). 1108.93047 10.1080/00207170500130952
[26] P. A. Markowich, C. Villani. On the trend to equilibrium for the Fokker-Planck equation: An interplay between physics and functional analysis. VI Workshop on Partial Differential Equations, Part II, Rio de Janeiro. Mat. Contemp. 19, pp. 1–29 (2000).[26] P. A. Markowich, C. Villani. On the trend to equilibrium for the Fokker-Planck equation: An interplay between physics and functional analysis. VI Workshop on Partial Differential Equations, Part II, Rio de Janeiro. Mat. Contemp. 19, pp. 1–29 (2000).
[27] L. Ozbek, E. Koksal Babacan, M. Efe. Stochastic stability of the discrete-time constrained extended Kalman filter. Turk. J. Elec. Eng. & Comp. Sci. 18, no. 2 (2010).[27] L. Ozbek, E. Koksal Babacan, M. Efe. Stochastic stability of the discrete-time constrained extended Kalman filter. Turk. J. Elec. Eng. & Comp. Sci. 18, no. 2 (2010).
[28] N. Papadakis, E. Mémin, A. Cuzol, N. Gengembre. Data assimilation with the weighted ensemble Kalman filter. Tellus A 62, no. 5, pp. 673–697 (2010).[28] N. Papadakis, E. Mémin, A. Cuzol, N. Gengembre. Data assimilation with the weighted ensemble Kalman filter. Tellus A 62, no. 5, pp. 673–697 (2010).
[29] K. Reif, S. Gunther, E. Yaz, R. Unbehauen. Stochastic stability of the discrete-time extended Kalman filter. IEEE Transactions on Automatic Control 44, no. 4, pp. 714–728 (1999). 0967.93090 10.1109/9.754809[29] K. Reif, S. Gunther, E. Yaz, R. Unbehauen. Stochastic stability of the discrete-time extended Kalman filter. IEEE Transactions on Automatic Control 44, no. 4, pp. 714–728 (1999). 0967.93090 10.1109/9.754809
[30] K. Reif, S. Gunther, E. Yaz, R. Unbehauen. Stochastic stability of the continuous-time extended Kalman filter. IEE Proceedings - Control Theory and Applications 147, no. 1, pp. 45–52 (2000). MR1684426 0967.93090 10.1109/9.754809[30] K. Reif, S. Gunther, E. Yaz, R. Unbehauen. Stochastic stability of the continuous-time extended Kalman filter. IEE Proceedings - Control Theory and Applications 147, no. 1, pp. 45–52 (2000). MR1684426 0967.93090 10.1109/9.754809
[31] M. B. Rhudy, Y. Gu. Online Stochastic Convergence Analysis of the Kalman Filter. International Journal of Stochastic Analysis 2013, Article ID 240295 (2013).[31] M. B. Rhudy, Y. Gu. Online Stochastic Convergence Analysis of the Kalman Filter. International Journal of Stochastic Analysis 2013, Article ID 240295 (2013).
[33] Y. K. Song, J. W. Grizzle. The extended Kalman filter as a local asymptotic observer. Estimation and Control 5, pp. 59–78 (1995). 0827.93009[33] Y. K. Song, J. W. Grizzle. The extended Kalman filter as a local asymptotic observer. Estimation and Control 5, pp. 59–78 (1995). 0827.93009
[34] F. Sonnemann Reif, K. and R. Unbehauen. An EKF-based nonlinear observer with a prescribed degree of stability. Automatica 34, pp. 1119–1123, (1998). 0938.93504 10.1016/S0005-1098(98)00053-3[34] F. Sonnemann Reif, K. and R. Unbehauen. An EKF-based nonlinear observer with a prescribed degree of stability. Automatica 34, pp. 1119–1123, (1998). 0938.93504 10.1016/S0005-1098(98)00053-3
[35] E. D. Sontag. Mathematical Control Theory. Springer-Verlag, New York, NY, 2nd edition (1998). 0945.93001[35] E. D. Sontag. Mathematical Control Theory. Springer-Verlag, New York, NY, 2nd edition (1998). 0945.93001
[36] X. T. Tong, A. J. Majda, D. Kelly. Nonlinear stability and ergodicity of ensemble based Kalman filters. Nonlinearity 29, no. 2, pp. 657–691 (2016). 1334.60060 10.1088/0951-7715/29/2/657[36] X. T. Tong, A. J. Majda, D. Kelly. Nonlinear stability and ergodicity of ensemble based Kalman filters. Nonlinearity 29, no. 2, pp. 657–691 (2016). 1334.60060 10.1088/0951-7715/29/2/657
[37] W. M. Wonham. On a Matrix Riccati Equation of Stochastic Control. SIAM Journal on Control 6, no. 4, pp. 681–697 (1968). 0182.20803 10.1137/0306044[37] W. M. Wonham. On a Matrix Riccati Equation of Stochastic Control. SIAM Journal on Control 6, no. 4, pp. 681–697 (1968). 0182.20803 10.1137/0306044
[38] M. I. Zelikin. On the theory of the matrix Riccati equation. Mat. Sb. 182, no. 7 pp. 970–984 (1991).[38] M. I. Zelikin. On the theory of the matrix Riccati equation. Mat. Sb. 182, no. 7 pp. 970–984 (1991).
