Open Access
Translator Disclaimer
December 2016 Context-Dependent Score Based Bayesian Information Criteria
N. T. Underhill, J. Q. Smith
Bayesian Anal. 11(4): 1005-1033 (December 2016). DOI: 10.1214/15-BA980

Abstract

In a number of applications, we argue that standard Bayes factor model comparison and selection may be inappropriate for decision making under specific, utility-based, criteria. It has been suggested that the use of scoring rules in this context allows greater flexibility: scores can be customised to a client’s utility and model selection can proceed on the basis of the highest scoring model. We argue here that the approach of comparing the cumulative scores of competing models is not ideal because it tends to ignore a model’s ability to ‘catch up’ through parameter learning. An alternative approach of selecting a model on its maximum posterior score based on a plug in or posterior expected value is problematic in that it uses the data twice in estimation and evaluation. We therefore introduce a new Bayesian posterior score information criterion (BPSIC), which is a generalisation of the Bayesian predictive information criterion proposed by Ando (2007). This allows the analyst both to tailor an appropriate scoring function to the needs of the ultimate decision maker and to correct appropriately for bias in using the data on a posterior basis to revise parameter estimates. We show that this criterion can provide a convenient method of initial model comparison when the number of models under consideration is large or when computational burdens are high. We illustrate the new methods with simulated examples and real data from the UK electricity imbalance market.

Citation

Download Citation

N. T. Underhill. J. Q. Smith. "Context-Dependent Score Based Bayesian Information Criteria." Bayesian Anal. 11 (4) 1005 - 1033, December 2016. https://doi.org/10.1214/15-BA980

Information

Published: December 2016
First available in Project Euclid: 29 October 2015

zbMATH: 1357.62135
MathSciNet: MR3545472
Digital Object Identifier: 10.1214/15-BA980

Rights: Copyright © 2016 International Society for Bayesian Analysis

JOURNAL ARTICLE
29 PAGES


SHARE
Vol.11 • No. 4 • December 2016
Back to Top