Open Access
August 1998 On the problem of exit from cycles for simulated annealing processes--a backward equation approach
Tzuu-Shuh Chiang, Yunshyong Chow
Ann. Appl. Probab. 8(3): 896-916 (August 1998). DOI: 10.1214/aoap/1028903456
Abstract

For a simulated annealing process $X_t$ on S with transition rates $q_{ij}(t) = p_{ij} \exp (-(U(i, j))/T(t))$ where $i, j \epsilon S$ and $T(t) \downarrow 0$ in a suitable way, we study the exit distribution $P_{t,i}(X_{\tau} = a)$ and mean exit time $E_{t,i}(\tau)$ of $X_t$ from a cycle c as $t \to \infty$. A cycle is a particular subset of S whose precise definition will be given in Section 1. Here $\tau$ is the exit time of the process from c containing i and a is an arbitrary state not in c. We consider the differential (backward) equation of $P_{t,i}(X_{\tau} = a)$ and $E_{t,i}(\tau)$ and show that $\lim_{t\to\infty}P_{t,i}(X_{\tau} = a)/\exp (-U(c, a) - T(t))$ and $\lim_{t\to\infty E_{t,i}(\tau)/\exp(V(c)/T(t))$ exist and are independent of $i \epsilon c$. The constant $(U(c, a))$ is usually referred to as the cost from c to a and $V(c), (\leq U(c, a))$ is the minimal cost coming out of c. We also obtain estimates of $|P_{t,i}(X_{\tau} = a) - P_{t,j}(X_{\tau} = a)|$ and $|E_{t,i}(\tau)|$ for $i \not= j$ as $t \to \infty$. As an application, we shall show that similar results hold for the family of Markov processes with transition rates $q_{ij}^{\varepsilon} = p_{ij} \exp(-U(i, j)/\varepsilon)$ where $\varepsilon > 0$ is small.

References

1.

[1] Catoni, O. (1992). Rough large deviation estimates for simulated annealing-application to exponential schedules. Ann. Probab. 20 1109-1146.  MR93j:60092 0755.60021 10.1214/aop/1176989682 euclid.aop/1176989682 [1] Catoni, O. (1992). Rough large deviation estimates for simulated annealing-application to exponential schedules. Ann. Probab. 20 1109-1146.  MR93j:60092 0755.60021 10.1214/aop/1176989682 euclid.aop/1176989682

2.

[2] Chen, D., Feng, J. and Qian, M. (1995). The metastability of exponentially perturbed Markov chains. Chinese Sci. A 25 590-595.  MR1397231[2] Chen, D., Feng, J. and Qian, M. (1995). The metastability of exponentially perturbed Markov chains. Chinese Sci. A 25 590-595.  MR1397231

3.

[3] Chiang, T. S. and Chow, Y. (1989). On the asy mptotic behavior of some inhomogeneous Markov processes. Ann. Probab. 17 1483-1502.  MR1048941 0687.60070 10.1214/aop/1176991169 euclid.aop/1176991169 [3] Chiang, T. S. and Chow, Y. (1989). On the asy mptotic behavior of some inhomogeneous Markov processes. Ann. Probab. 17 1483-1502.  MR1048941 0687.60070 10.1214/aop/1176991169 euclid.aop/1176991169

4.

[4] Chiang, T. S. and Chow, Y. (1994). The asy mptotic behavior of simulated annelaing with absorption. SIAM J. Control Optim. 32 1247-1265.  MR1288249 0804.60063 10.1137/S0363012989166538[4] Chiang, T. S. and Chow, Y. (1994). The asy mptotic behavior of simulated annelaing with absorption. SIAM J. Control Optim. 32 1247-1265.  MR1288249 0804.60063 10.1137/S0363012989166538

5.

[5] Chow, Y. and Hsieh, J. (1992). On occupation times of annealing processes. Bull. Math. Academia Sinica 20 19-26.  0777.60069 MR1166214[5] Chow, Y. and Hsieh, J. (1992). On occupation times of annealing processes. Bull. Math. Academia Sinica 20 19-26.  0777.60069 MR1166214

6.

[6] Freidlin, M. I. and Wentzell, A. D. (1984). Random Perturbations of Dy namical Sy stems. Springer, New York.  MR85a:60064[6] Freidlin, M. I. and Wentzell, A. D. (1984). Random Perturbations of Dy namical Sy stems. Springer, New York.  MR85a:60064

7.

[7] Geman, S. and Geman, D. (1984). Stochastic relaxation, Gibbs distribution and the Bayesian restoration of images. IEEE Trans. Pattern Anal. Mach. Intelligence 6 721-741.[7] Geman, S. and Geman, D. (1984). Stochastic relaxation, Gibbs distribution and the Bayesian restoration of images. IEEE Trans. Pattern Anal. Mach. Intelligence 6 721-741.

8.

[8] Gidas, B. (1985). Global optimization via the Langevin equation. In Proceedings 24th IEEE Conference on Decision and Control, Fort Lauderdale, FL 774-778. IEEE, New York. [8] Gidas, B. (1985). Global optimization via the Langevin equation. In Proceedings 24th IEEE Conference on Decision and Control, Fort Lauderdale, FL 774-778. IEEE, New York.

9.

[9] Hajek, B. (1988). Cooling schedules for optimal annealing. Math. Oper. Res. 13 311-329.  MR89f:90140 0652.65050 10.1287/moor.13.2.311 0364-765X%28198805%2913%3A2%3C311%3ACSFOA%3E2.0.CO%3B2-0[9] Hajek, B. (1988). Cooling schedules for optimal annealing. Math. Oper. Res. 13 311-329.  MR89f:90140 0652.65050 10.1287/moor.13.2.311 0364-765X%28198805%2913%3A2%3C311%3ACSFOA%3E2.0.CO%3B2-0

10.

[10] Hwang, C. R. and Sheu, S. J. (1992). Singular perturbed Markov chains and exact behaviors of simulated annealing process. J. Theoret. Probab. 5 223-249.  MR1157983 0755.60047 10.1007/BF01046734[10] Hwang, C. R. and Sheu, S. J. (1992). Singular perturbed Markov chains and exact behaviors of simulated annealing process. J. Theoret. Probab. 5 223-249.  MR1157983 0755.60047 10.1007/BF01046734

11.

[11] Kirkpatrick, S., Gelatt, C. and Vecchi, M. (1983). Optimization by simulated annealing. Science 220 671-680.  MR85f:90091 10.1126/science.220.4598.671[11] Kirkpatrick, S., Gelatt, C. and Vecchi, M. (1983). Optimization by simulated annealing. Science 220 671-680.  MR85f:90091 10.1126/science.220.4598.671

12.

[12] Neves, E. J. and Schonmann, R. H. (1991). Critical droplets and metastability for a Glauber dy namics at very low temperatore. Comm. Math. Phy s. 137 209-230.  MR1101685 0722.60107 10.1007/BF02431878 euclid.cmp/1104202616 [12] Neves, E. J. and Schonmann, R. H. (1991). Critical droplets and metastability for a Glauber dy namics at very low temperatore. Comm. Math. Phy s. 137 209-230.  MR1101685 0722.60107 10.1007/BF02431878 euclid.cmp/1104202616

13.

[13] Olivieri, E. and Scoppola, E. (1996). Markov chains with exponentially small transition probabilities: First exit problem from a general domain II. J. Statist. Phy s. 84 987- 1041.  MR97h:60083 1081.60542 10.1007/BF02174126[13] Olivieri, E. and Scoppola, E. (1996). Markov chains with exponentially small transition probabilities: First exit problem from a general domain II. J. Statist. Phy s. 84 987- 1041.  MR97h:60083 1081.60542 10.1007/BF02174126

14.

[14] Schonmann, R. H. (1994). Slow droplet-driven relaxation of stochastic Ising models in the vicinity of the phase coexistence region. Comm. Math. Phy s. 161 1-49.  MR95f:82024 0796.60103 10.1007/BF02099411 euclid.cmp/1104269790 [14] Schonmann, R. H. (1994). Slow droplet-driven relaxation of stochastic Ising models in the vicinity of the phase coexistence region. Comm. Math. Phy s. 161 1-49.  MR95f:82024 0796.60103 10.1007/BF02099411 euclid.cmp/1104269790

15.

[15] Seneta, E. (1981). Nonnegative Matrices and Markov Chains, 2nd ed. Springer, New York.  MR85i:60058[15] Seneta, E. (1981). Nonnegative Matrices and Markov Chains, 2nd ed. Springer, New York.  MR85i:60058

16.

[16] Van Laarhoven, P. J. M. and Aarts, E. H. L. (1987). Simulated Annealing: Theory and Applications. Reidel, Dordrecht. MR88j:90176 0643.65028[16] Van Laarhoven, P. J. M. and Aarts, E. H. L. (1987). Simulated Annealing: Theory and Applications. Reidel, Dordrecht. MR88j:90176 0643.65028
Copyright © 1998 Institute of Mathematical Statistics
Tzuu-Shuh Chiang and Yunshyong Chow "On the problem of exit from cycles for simulated annealing processes--a backward equation approach," The Annals of Applied Probability 8(3), 896-916, (August 1998). https://doi.org/10.1214/aoap/1028903456
Published: August 1998
Vol.8 • No. 3 • August 1998
Back to Top