- Statist. Sci.
- Volume 34, Number 1 (2019), 90-93.
Comment: Contributions of Model Features to BART Causal Inference Performance Using ACIC 2016 Competition Data
With a thorough exposition of the methods and results of the 2016 Atlantic Causal Inference Competition, Dorie et al. have set a new standard for reproducibility and comparability of evaluations of causal inference methods. In particular, the open-source R package aciccomp2016, which permits reproduction of all datasets used in the competition, will be an invaluable resource for evaluation of future methodological developments.
Building upon results from Dorie et al., we examine whether a set of potential modifications to Bayesian Additive Regression Trees (BART)—multiple chains in model fitting, using the propensity score as a covariate, targeted maximum likelihood estimation (TMLE), and computing symmetric confidence intervals—have a stronger impact on bias, RMSE, and confidence interval coverage in combination than they do alone. We find that bias in the estimate of SATT is minimal, regardless of the BART formulation. For purposes of CI coverage, however, all proposed modifications are beneficial—alone and in combination—but use of TMLE is least beneficial for coverage and results in considerably wider confidence intervals.
Statist. Sci., Volume 34, Number 1 (2019), 90-93.
First available in Project Euclid: 12 April 2019
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Carnegie, Nicole Bohme. Comment: Contributions of Model Features to BART Causal Inference Performance Using ACIC 2016 Competition Data. Statist. Sci. 34 (2019), no. 1, 90--93. doi:10.1214/18-STS682. https://projecteuclid.org/euclid.ss/1555056036
- Main article: Automated versus Do-It-Yourself Methods for Causal Inference: Lessons Learned from a Data Analysis Competition.