- Volume 25, Number 3 (2019), 2330-2358.
Bayesian mode and maximum estimation and accelerated rates of contraction
We study the problem of estimating the mode and maximum of an unknown regression function in the presence of noise. We adopt the Bayesian approach by using tensor-product B-splines and endowing the coefficients with Gaussian priors. In the usual fixed-in-advanced sampling plan, we establish posterior contraction rates for mode and maximum and show that they coincide with the minimax rates for this problem. To quantify estimation uncertainty, we construct credible sets for these two quantities that have high coverage probabilities with optimal sizes. If one is allowed to collect data sequentially, we further propose a Bayesian two-stage estimation procedure, where a second stage posterior is built based on samples collected within a credible set constructed from a first stage posterior. Under appropriate conditions on the radius of this credible set, we can accelerate optimal contraction rates from the fixed-in-advanced setting to the minimax sequential rates. A simulation experiment shows that our Bayesian two-stage procedure outperforms single-stage procedure and also slightly improves upon a non-Bayesian two-stage procedure.
Bernoulli, Volume 25, Number 3 (2019), 2330-2358.
Received: August 2017
Revised: March 2018
First available in Project Euclid: 12 June 2019
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Yoo, William Weimin; Ghosal, Subhashis. Bayesian mode and maximum estimation and accelerated rates of contraction. Bernoulli 25 (2019), no. 3, 2330--2358. doi:10.3150/18-BEJ1056. https://projecteuclid.org/euclid.bj/1560326447
- Supplement to “Bayesian mode and maximum estimation and accelerated rates of contraction”. The supplementary file contains detailed proofs of Corollary 4.2, Proposition 5.1 and Corollary 8.4.