Open Access
October, 1988 Large Deviations Analysis of Some Recursive Algorithms with State Dependent Noise
Paul Dupuis
Ann. Probab. 16(4): 1509-1536 (October, 1988). DOI: 10.1214/aop/1176991581


Consider the recursive, stochastic algorithm $X^\varepsilon_{n+1} = X^\varepsilon_n + \varepsilon b(X^\varepsilon_n, \xi_n)$, where $\{\xi_n\}$ is a random process and $X^\varepsilon_n$ lives in $\mathbb{R}^d$. Algorithms of this type arise frequently in applications in control and communications, as well as elsewhere. In the study of the important long term behavior of such recursive algorithms the "large deviations" behavior of the system, which describes the asymptotics of the order 1 deviations of the system from its "mean" trajectory as $\varepsilon$ tends to 0, plays a central role. Typical systems arising in communication theory and control often use complicated forcing terms involving correlated and state dependent noises and forcing terms with discontinuities. This paper presents a general approach for proving large deviations type theorems for such systems. The problem of proving such a theorem is considered first for the general case of a stochastic process with Lipschitz continuous sample paths. The assumptions are stated in terms of the conditional distribution of time increments of the process. After giving the proof in this general framework, we give several examples (in both continuous and discrete time) of driving terms that satisfy the hypotheses. The results are subsequently extended to a "projected" version of the discrete time model. The paper concludes with an application of the results to an automatic routing mechanism.


Download Citation

Paul Dupuis. "Large Deviations Analysis of Some Recursive Algorithms with State Dependent Noise." Ann. Probab. 16 (4) 1509 - 1536, October, 1988.


Published: October, 1988
First available in Project Euclid: 19 April 2007

zbMATH: 0661.60045
MathSciNet: MR958200
Digital Object Identifier: 10.1214/aop/1176991581

Primary: 60F10
Secondary: 62L20

Keywords: asymptotic analysis , large deviations , recursive algorithms , state dependent noises

Rights: Copyright © 1988 Institute of Mathematical Statistics

Vol.16 • No. 4 • October, 1988
Back to Top