Communications in Information & Systems

A Model Reference Adaptive Search Method for Stochastic Global Optimization

Jiaqiao Hu, Michael C. Fu, and Steven I. Marcus

Full-text: Open access

Abstract

We propose a randomized search method called Stochastic Model Reference Adaptive Search (SMRAS) for solving stochastic optimization problems in situations where the objective functions cannot be evaluated exactly, but can be estimated with some noise (or uncertainty), e.g., via simulation. The method generalizes the recently proposed Model Reference Adaptive Search (MRAS) for deterministic optimization, which is motivated by the well-known Cross-Entropy (CE) method. We prove global convergence of SMRAS in a general stochastic setting, and carry out numerical studies to illustrate its performance. An emphasis of this paper is on the application of SMRAS for solving static stochastic optimization problems; its various applications for solving dynamic decision making problems can be found in H. S. Chang, M. C. Fu, J. Hu, and S. I. Marcus, Simulation-based Algorithms for Markov Decision Processes, Springer-Verlag, London, 2007.

Article information

Source
Commun. Inf. Syst. Volume 8, Number 3 (2008), 245-276.

Dates
First available in Project Euclid: 29 April 2009

Permanent link to this document
http://projecteuclid.org/euclid.cis/1241018503

Zentralblatt MATH identifier
05566118

Mathematical Reviews number (MathSciNet)
MR2495876

Citation

Hu, Jiaqiao; Fu, Michael C.; Marcus, Steven I. A Model Reference Adaptive Search Method for Stochastic Global Optimization. Communications in Information & Systems 8 (2008), no. 3, 245--276. http://projecteuclid.org/euclid.cis/1241018503.


Export citation