Translator Disclaimer
March 2020 Adaptive Bayesian Nonparametric Regression Using a Kernel Mixture of Polynomials with Application to Partial Linear Models
Fangzheng Xie, Yanxun Xu
Bayesian Anal. 15(1): 159-186 (March 2020). DOI: 10.1214/19-BA1148

Abstract

We propose a kernel mixture of polynomials prior for Bayesian nonparametric regression. The regression function is modeled by local averages of polynomials with kernel mixture weights. We obtain the minimax-optimal contraction rate of the full posterior distribution up to a logarithmic factor by estimating metric entropies of certain function classes. Under the assumption that the degree of the polynomials is larger than the unknown smoothness level of the true function, the posterior contraction behavior can adapt to this smoothness level provided an upper bound is known. We also provide a frequentist sieve maximum likelihood estimator with a near-optimal convergence rate. We further investigate the application of the kernel mixture of polynomials to partial linear models and obtain both the near-optimal rate of contraction for the nonparametric component and the Bernstein-von Mises limit (i.e., asymptotic normality) of the parametric component. The proposed method is illustrated with numerical examples and shows superior performance in terms of computational efficiency, accuracy, and uncertainty quantification compared to the local polynomial regression, DiceKriging, and the robust Gaussian stochastic process.

Citation

Download Citation

Fangzheng Xie. Yanxun Xu. "Adaptive Bayesian Nonparametric Regression Using a Kernel Mixture of Polynomials with Application to Partial Linear Models." Bayesian Anal. 15 (1) 159 - 186, March 2020. https://doi.org/10.1214/19-BA1148

Information

Published: March 2020
First available in Project Euclid: 22 February 2019

zbMATH: 1437.62155
MathSciNet: MR4050881
Digital Object Identifier: 10.1214/19-BA1148

JOURNAL ARTICLE
28 PAGES


SHARE
Vol.15 • No. 1 • March 2020
Back to Top