Translator Disclaimer
February 2016 Asymptotic optimality of myopic information-based strategies for Bayesian adaptive estimation
Janne V. Kujala
Bernoulli 22(1): 615-651 (February 2016). DOI: 10.3150/14-BEJ670

Abstract

This paper presents a general asymptotic theory of sequential Bayesian estimation giving results for the strongest, almost sure convergence. We show that under certain smoothness conditions on the probability model, the greedy information gain maximization algorithm for adaptive Bayesian estimation is asymptotically optimal in the sense that the determinant of the posterior covariance in a certain neighborhood of the true parameter value is asymptotically minimal. Using this result, we also obtain an asymptotic expression for the posterior entropy based on a novel definition of almost sure convergence on “most trials” (meaning that the convergence holds on a fraction of trials that converges to one). Then, we extend the results to a recently published framework, which generalizes the usual adaptive estimation setting by allowing different trial placements to be associated with different, random costs of observation. For this setting, the author has proposed the heuristic of maximizing the expected information gain divided by the expected cost of that placement. In this paper, we show that this myopic strategy satisfies an analogous asymptotic optimality result when the convergence of the posterior distribution is considered as a function of the total cost (as opposed to the number of observations).

Citation

Download Citation

Janne V. Kujala. "Asymptotic optimality of myopic information-based strategies for Bayesian adaptive estimation." Bernoulli 22 (1) 615 - 651, February 2016. https://doi.org/10.3150/14-BEJ670

Information

Received: 1 March 2012; Revised: 1 May 2014; Published: February 2016
First available in Project Euclid: 30 September 2015

zbMATH: 06543282
MathSciNet: MR3449795
Digital Object Identifier: 10.3150/14-BEJ670

Rights: Copyright © 2016 Bernoulli Society for Mathematical Statistics and Probability

JOURNAL ARTICLE
37 PAGES


SHARE
Vol.22 • No. 1 • February 2016
Back to Top