## The Annals of Applied Probability

### Phase transitions and metastability in Markovian and molecular systems

#### Abstract

Diffusion models arising in analysis of large biochemical models and other complex systems are typically far too complex for exact solution or even meaningful simulation. The purpose of this paper is to develop foundations for model reduction and new modeling techniques for diffusion models.

These foundations are all based upon the recent spectral theory of Markov processes. The main assumption imposed is $V$-uniform ergodicity of the process. This is equivalent to any common formulation of exponential ergodicity and is known to be far weaker than the Donsker--Varadahn conditions in large deviations theory. Under this assumption it is shown that the associated semigroup admits a spectral gap in a weighted $L_\infty$-norm and real eigenfunctions provide a decomposition of the state space into "almost"-absorbing subsets. It is shown that the process mixes rapidly in each of these subsets prior to exiting and that the conditional distributions of exit times are approximately exponential.

These results represent a significant expansion of the classical Wentzell--Freidlin theory. In particular, the results require no special structure beyond geometric ergodicity; reversibility is not assumed and meaningful conclusions can be drawn even for models with significant variability.

#### Article information

Source
Ann. Appl. Probab., Volume 14, Number 1 (2004), 419-458.

Dates
First available in Project Euclid: 3 February 2004

Permanent link to this document
https://projecteuclid.org/euclid.aoap/1075828057

Digital Object Identifier
doi:10.1214/aoap/1075828057

Mathematical Reviews number (MathSciNet)
MR2023026

Zentralblatt MATH identifier
1041.60026

Keywords
Markov process large deviations

#### Citation

Huisinga, Wilhelm; Meyn, Sean; Schütte, Christof. Phase transitions and metastability in Markovian and molecular systems. Ann. Appl. Probab. 14 (2004), no. 1, 419--458. doi:10.1214/aoap/1075828057. https://projecteuclid.org/euclid.aoap/1075828057

#### References

• Balaji, S. and Meyn, S. P. (2000). Multiplicative ergodicity and large deviations for an irreducible Markov chain. Stochastic Process. Appl. 90 123--144.
• Bolthausen, E., Deuschel, J.-D. and Tamura, Y. (1995). Laplace approximations for large deviations of nonreversible Markov processes. The nondegenerate case. Ann. Probab. 23 236--267.
• Bovier, A., Eckhoff, M., Gayrard, V. and Klein, M. (2001). Metastability in stochastic dynamics of disordered mean-field models. Probab. Theory Related Fields 119 99--161.
• Bovier, A., Eckhoff, M., Gayrard, V. and Klein, M. (2002). Metastability in reversible diffusion processes. I. Sharp asymptotics for capacities and exit times. Technical report.
• Bovier, A., Eckhoff, M., Gayrard, V. and Klein, M. (2002). Metastability in reversible diffusion processes. II. Precise asymptotics for small eigenvalues. Technical report.
• Bovier, A. and Manzo, F. (2001). Metastability in Glauber dynamics in the low-temerature limit: Beyond exponential asymptotics. Preprint, Weierstrass-Institute für Angewandte Analysis und Stochastik.
• Deuflhard, P., Huisinga, W., Fischer, A. and Schütte, Ch. (2000). Identification of almost invariant aggregates in reversible nearly uncoupled Markov chains. Linear Algebra Appl. 315 39--59.
• Donsker, M. D. and Varadhan, S. R. S. (1983). Asymptotic evaluation of certain Markov process expectations for large time. IV. Comm. Pure Appl. Math. 36 183--212.
• Down, D., Meyn, S. P. and Tweedie, R. L. (1995). Exponential and uniform ergodicity of Markov processes. Ann. Probab. 23 1671--1691.
• Feng, J. and Kurtz, T. G. (2000). Large deviations for stochastic processes. Preprint.
• Fleming, W. H. (1978). Exit probabilities and optimal stochastic control. Appl. Math. Optim. 4 329--346.
• Fleming, W. H. and James, M. R. (1992). Asymptotic series and exit time probabilities. Ann. Probab. 20 1369--1384.
• Fleming, W. H. and McEneaney, W. M. (1995). Risk-sensitive control on an infinite time horizon. SIAM J. Control Optim. 33 1881--1915.
• Fleming, W. H. and Sheu, S.-J. (1997). Asymptotics for the principal eigenvalue and eigenfunction of a nearly first-order operator with large potential. Ann. Probab. 25 1953--1994.
• Freidlin, M. I. and Wentzell, A. D. (1984). Random Perturbations of Dynamical Systems. Springer, New York.
• Glynn, P. W. and Thorisson, H. (2001). Two-sided taboo limits for Markov processes and associated perfect simulation. Stochastic Process. Appl. 91 1--20.
• Glynn, P. W. and Thorisson, H. (2002). Structural characterization of taboo-stationarity for general processes in two-sided time. Stochastic Process. Appl. 102 311--318.
• Huisinga, W. (2001). Metastability of Markovian systems: A transfer operator approach in application to molecular dynamics. Ph.D. thesis, Free Univ. Berlin.
• Jensen, J. L. (1987). A note on asymptotic expansions for Markov chains using operator theory. Adv. in Appl. Math. 8 377--392.
• Kontoyiannis, I. and Meyn, S. P. (2002). Large deviation asymptotics and the spectral theory of multiplicatively regular Markov processes. Submitted for publication.
• Kontoyiannis, I. and Meyn, S. P. (2003). Spectral theory and limit theorems for geometrically ergodic Markov processes. Ann. Appl. Probab. 13 304--362.
• Kunita, H. (1978). Supports of diffusion processes and controllability problems. In Proceedings of the International Symposium on Stochastic Differential Equations (K. Itô, ed.) 163--185. Wiley, New York.
• Kunita, H. (1990). Stochastic Flows and Stochastic Differential Equations. Cambridge Univ. Press.
• Liberzon, D. and Brockett, R. W. (2000). Spectral analysis of Fokker--Planck and related operators arising from linear stochastic differential equations. SIAM J. Control Optim. 38 1453--1467.
• Lobry, C. (1970). Contrôlabilité des systèmes non linéaires. SIAM J. Control 8 573--605.
• Mattingly, J., Stuart, A. M. and Higham, D. J. (2001). Ergodicity for SDEs and approximations: Locally Lipschitz vector fields and degenerated noise. To appear.
• Meyn, S. P. and Tweedie, R. L. (1993). Generalized resolvents and Harris recurrence of Markov processes. Contemp. Math. 149 227--250.
• Meyn, S. P. and Tweedie, R. L. (1993). Markov Chains and Stochastic Stability. Springer, London.
• Meyn, S. P. and Tweedie, R. L. (1993). Stability of Markovian processes II: Continuous time processes and sampled chains. Adv. in Appl. Probab. 25 487--517.
• Neveu, J. (1964). Chaî nes de Markov et théorie du potentiel. Ann. Fac. Sci. Univ. Clermont-Ferrand 24 37--89.
• Nummelin, E. (1984). General Irreducible Markov Chains and Nonnegative Operators. Cambridge Univ. Press.
• Rey-Bellet, L. and Thomas, L. E. (2000). Asymptotic behavior of thermal nonequilibrium steady states for a driven chain of anharmonic oscillators. Comm. Math. Phys. 215 1--24.
• Rey-Bellet, L. and Thomas, L. E. (2001). Fluctuations of the entropy production in anharmonic chains. To appear.
• Schütte, Ch., Fischer, A., Huisinga, W. and Deuflhard, P. (1999). A direct approach to conformational dynamics based on hybrid Monte Carlo. J. Comput. Phys. Special Issue on Computational Biophysics 151 146--168.
• Schütte, Ch. and Huisinga, W. (2000). On conformational dynamics induced by Langevin processes. In EQUADIFF 99--International Conference on Differential Equations (B. Fiedler, K. Gröger and J. Sprekels, eds.) 2 1247--1262. World Scientific, Singapore.
• Schütte, Ch., Huisinga, W. and Deuflhard, P. (2001). Transfer operator approach to conformational dynamics in biomolecular systems. In Ergodic Theory, Analysis, and Efficient Simulation of Dynamical Systems (B. Fiedler, ed.). Springer, New York.
• Seneta, E. and Vere-Jones, D. (1966). On quasi-stationary distributions in discrete-time Markov chains with a denumerable infinity of states. J. Appl. Probab. 3 403--434.
• Stroock, D. W. and Varadhan, S. R. S. (1972). On the support of diffusion processes with applications to the strong maximum principle. Proc. Sixth Berkeley Symp. Math. Statist. Probab. 333--359. Univ. California Press, Berkeley.
• Sussmann, H. J. and Jurdjevic, V. (1972). Controllability of nonlinear systems. J. Differential Equations 12 95--116.
• Thorisson, H. (2000). Coupling, Stationarity and Regeneration. Springer, New York.
• Tweedie, R. L. (1974). Quasi-stationary distributions for Markov chains on a general state space. J. Appl. Probab. 11 726--741.
• Varadhan, S. R. S. (1984). Large Deviations and Applications. SIAM, Philadelphia, PA.