Impulse Control of Piecewise Deterministic Markov Processes

Abstract

This paper concerns the optimal impulse control of piecewise deterministic Markov processes (PDPs). The PDP optimal (full) control problem with dynamic control plus impulse control is transformed to an equivalent dynamic control problem. The existence of an optimal full control and a generalized Bellman-Hamilton-Jacobi necessary and sufficient optimality condition for the PDP full control problem in terms of the value function for the new dynamic control problem are derived. It is shown that the value function of the original PDP optimal full control problem is Lipschitz continuous and satisfies a generalized quasivariational inequality with a boundary condition. A necessary and sufficient optimality condition is given in terms of the value function for the original full control problem.