The Annals of Applied Probability

A homing problem for diffusion processes with control-dependent variance

Mario Lefebvre
Source: Ann. Appl. Probab. Volume 14, Number 2 (2004), 786-795.

Abstract

Controlled one-dimensional diffusion processes, with infinitesimal variance (instead of the infinitesimal mean) depending on the control variable, are considered in an interval located on the positive half-line. The process is controlled until it reaches either end of the interval. The aim is to minimize the expected value of a cost criterion with quadratic control costs on the way and a final cost equal to zero (resp. a large constant) if the process exits the interval through its left (resp. right) end point. Explicit expressions are obtained both for the optimal value of the control variable and the value function when the infinitesimal parameters of the processes are proportional to a power of the state variable.

First Page: Show Hide
Primary Subjects: 93E20
Secondary Subjects: 60J60
Full-text: Open access
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aoap/1082737111
Digital Object Identifier: doi:10.1214/105051604000000107
Mathematical Reviews number (MathSciNet): MR2052902
Zentralblatt MATH identifier: 02100754

References

Karlin, S. and Taylor, H. (1981). A Second Course in Stochastic Processes. Academic Press, New York.
Mathematical Reviews (MathSciNet): MR611513
Zentralblatt MATH: 0469.60001
Kuhn, J. (1985). The risk-sensitive homing problem. J. Appl. Probab. 22 167--172.
Mathematical Reviews (MathSciNet): MR808859
Lefebvre, M. (1989). An extension of a stochastic control theorem due to Whittle. IEEE Trans. Automat. Control 34 567--568.
Mathematical Reviews (MathSciNet): MR991909
Digital Object Identifier: doi:10.1109/9.24219
Lefebvre, M. (1997). Reducing a nonlinear dynamic programming equation to a Kolmogorov equation. Optimization 42 125--137.
Mathematical Reviews (MathSciNet): MR1488096
Lefebvre, M. (2001). A different class of homing problems. Systems Control Lett. 42 347--352.
Mathematical Reviews (MathSciNet): MR2006862
Whittle, P. (1982). Optimization Over Time 1. Wiley, Chichester.
Mathematical Reviews (MathSciNet): MR670949
Whittle, P. (1990). Risk-Sensitive Optimal Control. Wiley, Chichester.
Mathematical Reviews (MathSciNet): MR1093001
Zentralblatt MATH: 0718.93068

2012 © Institute of Mathematical Statistics

The Annals of Applied Probability

The Annals of Applied Probability