Bayesian Analysis

From Statistical Evidence to Evidence of Causality

A. Philip Dawid, Monica Musio, and Stephen E. Fienberg

Full-text: Open access

Abstract

While statisticians and quantitative social scientists typically study the “effects of causes” (EoC), Lawyers and the Courts are more concerned with understanding the “causes of effects” (CoE). EoC can be addressed using experimental design and statistical analysis, but it is less clear how to incorporate statistical or epidemiological evidence into CoE reasoning, as might be required for a case at Law. Some form of counterfactual reasoning, such as the “potential outcomes” approach championed by Rubin, appears unavoidable, but this typically yields “answers” that are sensitive to arbitrary and untestable assumptions. We must therefore recognise that a CoE question simply might not have a well-determined answer. It is nevertheless possible to use statistical data to set bounds within which any answer must lie. With less than perfect data these bounds will themselves be uncertain, leading to a compounding of different kinds of uncertainty. Still further care is required in the presence of possible confounding factors. In addition, even identifying the relevant “counterfactual contrast” may be a matter of Policy as much as of Science. Defining the question is as non-trivial a task as finding a route towards an answer.

This paper develops some technical elaborations of these philosophical points from a personalist Bayesian perspective, and illustrates them with a Bayesian analysis of a case study in child protection.

Article information

Source
Bayesian Anal., Volume 11, Number 3 (2016), 725-752.

Dates
First available in Project Euclid: 26 August 2015

Permanent link to this document
https://projecteuclid.org/euclid.ba/1440594950

Digital Object Identifier
doi:10.1214/15-BA968

Mathematical Reviews number (MathSciNet)
MR3498044

Zentralblatt MATH identifier
1357.62020

Keywords
benfluorex causes of effects counterfactual child protection effects of causes Fréchet bound potential outcome probability of causation

Citation

Dawid, A. Philip; Musio, Monica; Fienberg, Stephen E. From Statistical Evidence to Evidence of Causality. Bayesian Anal. 11 (2016), no. 3, 725--752. doi:10.1214/15-BA968. https://projecteuclid.org/euclid.ba/1440594950


Export citation

References

  • Altham, P. M. E. (1970). “The Measurement of Association of Rows and Columns for an $r \times s$ Contingency Table.” Journal of the Royal Statistical Society: Series B (Statistical Methodology), 32: 63–73. http://www.jstor.org/stable/2984403
  • Anon (17 November 2010). “500 Deaths Linked To Diabetes Drug Mediator, France.” Medical News Today. http://www.medicalnewstoday.com/articles/208343.php
  • Barankin, E. W. (1960). “Sufficient Parameters: Solution of the Minimal Dimensionality Problem.” Annals of the Institute of Statistical Mathematics, 12: 91–118.
  • Best, N., Ashby, D., Dunstan, F., Foreman, D., and McIntosh, N. (2013). “A Bayesian Approach to Complex Clinical Diagnoses: A Case-Study in Child Abuse (with Discussion).” Journal of the Royal Statistical Society: Series A (Statistics in Society), 176: 53–96.
  • Bishop, Y. M. M., Fienberg, S. E., and Holland, P. W. (1975). Discrete Multivariate Analysis: Theory and Practice. MIT Press. Reprinted by Springer-Verlag, New York (2007).
  • Bonferroni, C. E. (1936). “Teoria Statistica delle Classi e Calcolo delle Probabilità.” Publicazioni del R. Instituto Superiore di Scienze Economiche e Commerciali di Firenze, 8: 1–62.
  • Dawid, A. P. (1979). “Conditional Independence in Statistical Theory (with Discussion).” Journal of the Royal Statistical Society: Series B (Statistical Methodology), 41: 1–31.
  • — (2011). “The Role of Scientific and Statistical Evidence in Assessing Causality.” In: Goldberg, R. (ed.), Perspectives on Causation, 133–147. Oxford: Hart Publishing.
  • — (2015). “Statistical Causality from a Decision-Theoretic Perspective.” Annual Review of Statistics and Its Application, 2: 273–303.
  • Dawid, A. P., Faigman, D. L., and Fienberg, S. E. (2014). “Fitting Science Into Legal Contexts: Assessing Effects of Causes or Causes of Effects? (with Discussion).” Sociological Methods & Research, 43: 359–390.
  • — (2015). “On the Causes of Effects: Response to Pearl.” Sociological Methods & Research, 44: 165–174.
  • Farewell, V. (1979). “Some Results on the Estimation of Logistic Models Based on Retrospective Data.” Biometrika, 66: 27–32.
  • Fienberg, S. E. and Zellner, A. (eds.) (1974). Studies in Bayesian Econometrics and Statistics. Essays In Honor of Leonard J. Savage. North-Holland.
  • Fisher, R. A. (1935). The Design of Experiments. Edinburgh: Oliver and Boyd.
  • Frachon, I., Étienne, Y., Jobic, Y., Le Gal, G., Humbert, M., and Leroyer, C. (2010). “Benfluorex and Unexplained Valvular Heart Disease: A Case-Control Study.” PLOS One, 5(4): e10128.
  • Frachon, I. N. (2010). Médiator 150mg: Combien de Morts?. Brest: editions-dialogues.fr. http://www.editions-dialogues.fr/livre/mediator-150-mg/
  • Fréchet, M. (1940). Les Probabilités Associées à un Système d’Évènements Compatibles et Dépendants, volume 1. Paris: Hermann & Cie.
  • Gelman, A. and Imbens, G. (2013). “Why ask Why? Forward Causal Inference and Reverse Causal Questions.” Working Paper 19614, National Bureau of Economic Research, Cambridge, MA. http://www.stat.columbia.edu/~gelman/research/unpublished/reversecausal_13oct05.pdf
  • Green, M. D., Freedman, M. D., and Gordis, L. (2011). “Reference Guide on Epidemiology.” In: Reference Manual on Scientific Evidence: Third Edition, 549–632. Washington, D.C.: The National Academies Press.
  • Greenland, S. (2005). “Multiple-Bias Modelling for Analysis of Observational Data (with Discussion).” Journal of the Royal Statistical Society: Series A (Statistics in Society), 168: 267–306.
  • — (2009). “Relaxation Penalties and Priors for Plausible Modeling of Nonidentified Bias Sources.” Statistical Science, 24: 195–210.
  • Gustafson, P. (2005). “On Model Expansion, Model Contraction, Identifiability and Prior Information: Two Illustrative Scenarios Involving Mismeasured Variables.” Statistical Science, 20: 111–140.
  • — (2009). “What Are the Limits of Posterior Distributions Arising From Nonidentified Models, and Why Should We Care?” Journal of the American Statistical Association, 104: 1682–1695.
  • — (2012). “On the Behaviour of Bayesian Credible Intervals in Partially Identified Models.” Electronic Journal of Statistics, 6: 2107–2124.
  • Hill, A. B. (1951). “The Clinical Trial.” British Medical Bulletin, 7: 278–82.
  • Hill, C. (2011). “Mortalité Attribuable au Benfluorex (Mediator®).” La Presse Médicale, 40: 462–469.
  • Hoeffding, W. (1940). “Scale-Invariant Correlation Theory.” Schriften des Mathematischen Instituts und des Instituts für Angewandte Mathematik der Universität Berlin, 5: 181–233.
  • Holland, P. W. (1986). “Statistics and Causal Inference (with Discussion).” Journal of the American Statistical Association, 81: 945–970.
  • Holland, P. W. and Rubin, D. B. (1988). “Causal Inference in Retrospective Studies.” Evaluation Review, 12: 203–231.
  • Institute of Medicine (2011). Committee to Review the Health Effects in Vietnam Veterans of Exposure to Herbicides (Eighth Biennial Update): Veterans and Agent Orange: Update 2010. Washington, DC: The National Academies Press.
  • Kadane, J. B. (1974). “The Rôle of Identification in Bayesian Theory.” In: Fienberg and Zellner(1974), 175–91.
  • Laplace, P. S. (1986). “Memoir on the Probability of the Causes of Events.” Statistical Science, 1: 364–378.
  • Lunn, D., Jackson, C., Best, N., Thomas, A., and Spiegelhalter, D. (2012). The BUGS Book: A Practical Introduction to Bayesian Analysis. Texts in Statistical Science. Chapman & Hall/CRC.
  • Manski, C. F. (2003). Partial Identification of Probability Distributions. New York: Springer-Verlag.
  • — (2007). Identification for Prediction and Decision. Cambridge, MA: Harvard University Press.
  • Mill, J. S. (1843). A System of Logic, Ratiocinative and Inductive: Being a Connected View of the Principles of Evidence, and Methods of Scientific Investigation. London: John W. Harper.
  • Nicot, P., Frachon, I., and Hill, C. (2011). “À Propos de l’Expertise des Dossiers Benfluorex (Mediator® et Génériques).” La Presse Médicale, 42(4): 411–418.
  • Pearl, J. (2009). Causality: Models, Reasoning and Inference. Cambridge: Cambridge University Press, second edition.
  • — (2015). “Causes of Effects and Effects of Causes.” Sociological Methods & Research, 44: 149–164.
  • Price, H. (1992). “The Direction of Causation: Ramsey’s Ultimate Contingency.” In: PSA: Proceedings of the Biennial Meeting of the Philosophy of Science Association, volume 2: Symposia and Invited Papers, 253–267. The University of Chicago Press on behalf of the Philosophy of Science Association. http://www.jstor.org/stable/192840
  • Robins, J. and Greenland, S. (1989a). “Estimability and Estimation of Excess and Etiological Fractions.” Statistics in Medicine, 8: 845–859.
  • — (1989b). “The Probability of Causation Under a Stochastic Model for Individual Risk.” Biometrics, 45: 1125–1138.
  • Rubin, D. B. (1974). “Estimating Causal Effects of Treatments in Randomized and Nonrandomized Studies.” Journal of Educational Psychology, 66: 688–701.
  • Tian, J. and Pearl, J. (2000). “Probabilities of Causation: Bounds and Identification.” Annals of Mathematics and Artificial Intelligence, 28: 287–313.
  • Vansteelandt, S., Goetghebeur, E., Kenward, M. G., and Molenberghs, G. (2006). “Ignorance and Uncertainty Regions as Inferential Tools in a Sensitivity Analysis.” Statistica Sinica, 16: 953–979.
  • Weill, A., Pata, M., Tuppin, P., Fagot, J. P., Neumann, A., Simon, D., Ricordeau, P., Montastruc, J. L., and Allemond, H. (2010). “Benfluorex and Valvular Heart Disease: A Cohort Study of a Million People with Diabetes Mellitus.” Pharmacoepidemiology and Drug Safety, 19: 1256–1262.