Communications in Applied Mathematics and Computational Science
- Commun. Appl. Math. Comput. Sci.
- Volume 6, Number 1 (2011), 63-78.
Conditional path sampling for stochastic differential equations through drift relaxation
We present an algorithm for the efficient sampling of conditional paths of stochastic differential equations (SDEs). While unconditional path sampling of SDEs is straightforward, albeit expensive for high dimensional systems of SDEs, conditional path sampling can be difficult even for low dimensional systems. This is because we need to produce sample paths of the SDE that respect both the dynamics of the SDE and the initial and endpoint conditions. The dynamics of a SDE are governed by the deterministic term (drift) and the stochastic term (noise). Instead of producing conditional paths directly from the original SDE, one can consider a sequence of SDEs with modified drifts. The modified drifts should be chosen so that it is easier to produce sample paths that satisfy the initial and endpoint conditions. Also, the sequence of modified drifts should converge to the drift of the original SDE. We construct a simple Markov chain Monte Carlo algorithm that samples, in sequence, conditional paths from the modified SDEs, by taking the last sampled path at each level of the sequence as an initial condition for the sampling at the next level in the sequence. The algorithm can be thought of as a stochastic analog of deterministic homotopy methods for solving nonlinear algebraic equations or as a SDE generalization of simulated annealing. The algorithm is particularly suited for filtering/smoothing applications. We show how it can be used to improve the performance of particle filters. Numerical results for filtering of a stochastic differential equation are included.
Commun. Appl. Math. Comput. Sci., Volume 6, Number 1 (2011), 63-78.
Received: 30 August 2010
Revised: 23 February 2011
Accepted: 21 March 2011
First available in Project Euclid: 20 December 2017
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Primary: 60G35: Signal detection and filtering [See also 62M20, 93E10, 93E11, 94Axx] 62M20: Prediction [See also 60G25]; filtering [See also 60G35, 93E10, 93E11] 65C05: Monte Carlo methods 65C30: Stochastic differential and integral equations 93E10: Estimation and detection [See also 60G35]
Stinis, Panos. Conditional path sampling for stochastic differential equations through drift relaxation. Commun. Appl. Math. Comput. Sci. 6 (2011), no. 1, 63--78. doi:10.2140/camcos.2011.6.63. https://projecteuclid.org/euclid.camcos/1513732025