A Degenerate Variance Control Problem with Discretionary Stopping
Daniel Ocone, Ananda Weerasinghe
Abstract
We consider an infinite horizon stochastic control problem with discretionary stopping. The state process is given by a one dimensional stochastic differential equation. The diffusion coefficient is chosen by an adaptive choice of the controller and it is allowed to take the value zero. The controller also chooses the quitting time to stop the system. Here we develop a martingale characterization of the value function and use it and the principle of smooth fit to derive an explicit optimal strategy when the drift coefficient of the state process is of the form b(x)=−θx where θ>0 is a constant.
Full-text: Open access
Permanent link to this document: http://projecteuclid.org/euclid.imsc/1233152941
Digital Object Identifier: doi:10.1214/074921708000000363
References
[1] Assaf, D. (1997). Estimating the state of a noisy continuous time Markov chain when dynamic sampling is feasible. Ann. Appl. Probab. 3 822–836.
[2] Davis, M. H. A. and Zervos, M. (1994). A problem of singular stochastic control with discretionary stopping. Ann. Appl. Probab. 4 226–240.
[3] Dubins, L. E. and Savage, L. J. (1965). How To Gamble If You Must: Inequalities for Stochastic Processes. McGraw-Hill Book Co., New York.
[4] Karatzas, I., Ocone, D., Wang, H. and Zervos, M. (2000). Finite fuel singular control with discretionary stopping. Stochastics 71 1–50.
[5] Karatzas, I. and Shreve, S. E. (1988). Brownian motion and stochastic calculus. Springer-Verlag, New York.
[6] Karatzas, I. and Wang, H. (2000). Utility maximization with discretionary stopping. SIAM J. Control and Opt. 39 306–329.
[7] Karatzas, I. and Zamfirescu, I.-M. (2006). Martingale approach to stochastic control with discretionary stopping. Appl. Math. Optim. 53 163–184.
[8] Kurtz, T. G. and Stockbridge, R. H. (1998). Existence of Markov controls and characterization of optimal Markov controls. SIAM J. Control and Opt. 36 609–653.
[9] Morimoto, H. (2003). Variational inequalities for combined control and stopping. SIAM J. Control and Opt. 42 686–708.
[10] Ocone, D. and Weerasinghe, A. (2000). Degenerate variance control of a one dimensional diffusion process. SIAM J. Control and Opt. 39 1–24.
[11] Ocone, D. and Weerasinghe, A. (2003). Degenerate variance control in the one dimensional stationary case. Elec. J. of Probab. 8 1–27.
[12] Øksendal, B. (2000). Stochastic differential equations, fifth edition. Springer-Verlag, New York.
[13] Weerasinghe, A. (2006). A controller and a stopper game with degenerate variance control. Elec. Comm. of Probab. 11 89–99.
Institute of Mathematical Statistics Collections
