An almost sure invariance principle for stochastic approximation procedures in linear filtering theory

Abstract

In this paper we consider a class of stochastic approximation procedures that arises in linear filtering and regression theory. Our main result asserts that the stochastic approximation process satisfies an almost sure invariance principle (with a certain rate of convergence) if the partial sums of the errors do.