On time-inhomogeneous controlled diffusion processes in domains



The Annals of Probability

On time-inhomogeneous controlled diffusion processes in domains

Hongjie Dong and N. V. Krylov

Source: Ann. Probab. Volume 35, Number 1 (2007), 206-227.

Abstract

Time-inhomogeneous controlled diffusion processes in both cylindrical and noncylindrical domains are considered. Bellman’s principle and its applications to proving the continuity of value functions are investigated.

Primary Subjects: 93E20, 90C40
Keywords: Principle of optimality; Bellman’s principle; Bellman’s equations; continuity of value functions

Full-text: Access denied (no subscription detected)

We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber.
If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription. Read more about accessing full-text
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aop/1174324128
Digital Object Identifier: doi:10.1214/009117906000000395
Mathematical Reviews number (MathSciNet): MR2303952
Zentralblatt MATH identifier: 1127.93062

References

Bensoussan, A. and Lions, J.-L. (1978). Aplications des inéquations variationnelles en contrôle stochastique. Dunod, Paris.
Mathematical Reviews (MathSciNet): MR0513618
Borkar, V. S. (1989). Optimal Control of Diffusion Processes. Longman, Harlow, Essex, UK.
Mathematical Reviews (MathSciNet): MR1005532
Zentralblatt MATH: 0669.93065
Dong, H. and Krylov, N. V. (2006). On the rate of convergence of finite-difference approximations for parabolic Bellman equations with Lipschitz coefficients in cylindrical domains. Appl. Math. Optim. To appear.
Mathematical Reviews (MathSciNet): MR2334605
Digital Object Identifier: doi:10.1007/s00245-007-0879-4
Fleming, W. H. and Soner, H. M. (1993). Controlled Markov Processes and Viscosity Solutions. Springer, New York.
Mathematical Reviews (MathSciNet): MR1199811
Zentralblatt MATH: 0773.60070
Krylov, N. V. (1977). Controlled Diffusion Processes. Nauka, Moscow. (In Russian.) [English translation by A. B. Aries, (1980).]
Mathematical Reviews (MathSciNet): MR0508417
Krylov, N. V. (1981). On controlled diffusion processes with unbounded coefficients. Izv. Akad. Nauk SSSR Matem. 45 734--759. (In Russian.) English translation Math. USSR Izvestija (1982) 19 41--64.
Mathematical Reviews (MathSciNet): MR0631436
Krylov, N. V. (1999). On Kolmogorov's equations for finite dimensional diffusions. CIME Courses. Lecture Notes Math. 1715 1--63. Springer, Berlin.
Mathematical Reviews (MathSciNet): MR1731794
Zentralblatt MATH: 0943.60070
Digital Object Identifier: doi:10.1007/BFb0092417
Krylov, N. V. (2000). On the rate of convergence of finite-difference approximations for Bellman's equations with variable coefficients. Probab. Theory Related Fields. 117 1--16.
Mathematical Reviews (MathSciNet): MR1759507
Digital Object Identifier: doi:10.1007/s004400050264
Krylov, N. V. (2002). Adapting some ideas from stochastic control theory to studying the heat equation in closed smooth domain. Appl. Math Optim. 46 231--261.
Mathematical Reviews (MathSciNet): MR1944761
Digital Object Identifier: doi:10.1007/s00245-002-0745-3
Kurtz, T. (1987). Martingale problems for controlled processes. Stochastic Modelling and Filtering. Lecture Notes in Control and Inform. Sci. 91 75--90. Springer, Berlin.
Mathematical Reviews (MathSciNet): MR0894107
Zentralblatt MATH: 0642.93065
Digital Object Identifier: doi:10.1007/BFb0009051
Lions, P.-L. (1983). Optimal control of diffusion processes and Hamilton--Jacobi--Bellman equations. I. Comm. Partial Differential Equations 8 1101--1174.
Mathematical Reviews (MathSciNet): MR0709164
Digital Object Identifier: doi:10.1080/03605308308820297

2009 © Institute of Mathematical Statistics