- Bayesian Anal.
- Advance publication (2018), 28 pages.
Adaptive Bayesian Nonparametric Regression Using a Kernel Mixture of Polynomials with Application to Partial Linear Models
We propose a kernel mixture of polynomials prior for Bayesian nonparametric regression. The regression function is modeled by local averages of polynomials with kernel mixture weights. We obtain the minimax-optimal contraction rate of the full posterior distribution up to a logarithmic factor by estimating metric entropies of certain function classes. Under the assumption that the degree of the polynomials is larger than the unknown smoothness level of the true function, the posterior contraction behavior can adapt to this smoothness level provided an upper bound is known. We also provide a frequentist sieve maximum likelihood estimator with a near-optimal convergence rate. We further investigate the application of the kernel mixture of polynomials to partial linear models and obtain both the near-optimal rate of contraction for the nonparametric component and the Bernstein-von Mises limit (i.e., asymptotic normality) of the parametric component. The proposed method is illustrated with numerical examples and shows superior performance in terms of computational efficiency, accuracy, and uncertainty quantification compared to the local polynomial regression, DiceKriging, and the robust Gaussian stochastic process.
Bayesian Anal., Advance publication (2018), 28 pages.
First available in Project Euclid: 22 February 2019
Permanent link to this document
Digital Object Identifier
Xie, Fangzheng; Xu, Yanxun. Adaptive Bayesian Nonparametric Regression Using a Kernel Mixture of Polynomials with Application to Partial Linear Models. Bayesian Anal., advance publication, 22 February 2019. doi:10.1214/19-BA1148. https://projecteuclid.org/euclid.ba/1550826222
- Supplementary Material for “Adaptive Bayesian Nonparametric Regression Using a Kernel Mixture of Polynomials with Application to Partial Linear Models”. The supplementary material contains additional notations, proofs for Section 3, Section 4, posterior contraction for unknown $\sigma^2$ discussed in Section 6 and its proof, and cited theorems and results.