Abstract
Kesten proposed a method for adjusting the coefficients of a scalar stochastic approximation process, and proved w.p. 1 convergence. A family of multidimensional processes for function minimization are treated here. Each method consists of a sequence of truncated one-dimensional procedures of the Kesten type. The methods seem to offer a number of advantages over the usual Kiefer-Wolfowitz procedures, and are more natural analogs of the schemes in common use in deterministic optimization theory.
Citation
H. J. Kushner. T. Gavin. "Extensions of Kesten's Adaptive Stochastic Approximation Method." Ann. Statist. 1 (5) 851 - 861, September, 1973. https://doi.org/10.1214/aos/1176342506
Information