Open Access
October 2007 Computer model validation with functional output
M. J. Bayarri, D. Walsh, J. O. Berger, J. Cafeo, G. Garcia-Donato, F. Liu, J. Palomo, R. J. Parthasarathy, R. Paulo, J. Sacks
Ann. Statist. 35(5): 1874-1906 (October 2007). DOI: 10.1214/009053607000000163

Abstract

A key question in evaluation of computer models is Does the computer model adequately represent reality? A six-step process for computer model validation is set out in Bayarri et al. [Technometrics 49 (2007) 138–154] (and briefly summarized below), based on comparison of computer model runs with field data of the process being modeled. The methodology is particularly suited to treating the major issues associated with the validation process: quantifying multiple sources of error and uncertainty in computer models; combining multiple sources of information; and being able to adapt to different, but related scenarios.

Two complications that frequently arise in practice are the need to deal with highly irregular functional data and the need to acknowledge and incorporate uncertainty in the inputs. We develop methodology to deal with both complications. A key part of the approach utilizes a wavelet representation of the functional data, applies a hierarchical version of the scalar validation methodology to the wavelet coefficients, and transforms back, to ultimately compare computer model output with field output. The generality of the methodology is only limited by the capability of a combination of computational tools and the appropriateness of decompositions of the sort (wavelets) employed here.

The methods and analyses we present are illustrated with a test bed dynamic stress analysis for a particular engineering system.

Citation

Download Citation

M. J. Bayarri. D. Walsh. J. O. Berger. J. Cafeo. G. Garcia-Donato. F. Liu. J. Palomo. R. J. Parthasarathy. R. Paulo. J. Sacks. "Computer model validation with functional output." Ann. Statist. 35 (5) 1874 - 1906, October 2007. https://doi.org/10.1214/009053607000000163

Information

Published: October 2007
First available in Project Euclid: 7 November 2007

zbMATH: 1144.62368
MathSciNet: MR2363956
Digital Object Identifier: 10.1214/009053607000000163

Subjects:
Primary: 62Q05

Keywords: Bayesian analysis , bias , Computer models , functional data , uncertain inputs , validation

Rights: Copyright © 2007 Institute of Mathematical Statistics

Vol.35 • No. 5 • October 2007
Back to Top