## The Annals of Applied Statistics

- Ann. Appl. Stat.
- Volume 2, Number 3 (2008), 808-840.

### For objective causal inference, design trumps analysis

#### Abstract

For obtaining causal inferences that are objective, and therefore have the best chance of revealing scientific truths, carefully designed and executed randomized experiments are generally considered to be the gold standard. Observational studies, in contrast, are generally fraught with problems that compromise any claim for objectivity of the resulting causal inferences. The thesis here is that observational studies have to be carefully designed to approximate randomized experiments, in particular, without examining any final outcome data. Often a candidate data set will have to be rejected as inadequate because of lack of data on key covariates, or because of lack of overlap in the distributions of key covariates between treatment and control groups, often revealed by careful propensity score analyses. Sometimes the template for the approximating randomized experiment will have to be altered, and the use of principal stratification can be helpful in doing this. These issues are discussed and illustrated using the framework of potential outcomes to define causal effects, which greatly clarifies critical issues.

#### Article information

**Source**

Ann. Appl. Stat. Volume 2, Number 3 (2008), 808-840.

**Dates**

First available in Project Euclid: 13 October 2008

**Permanent link to this document**

http://projecteuclid.org/euclid.aoas/1223908042

**Digital Object Identifier**

doi:10.1214/08-AOAS187

**Mathematical Reviews number (MathSciNet)**

MR2516795

**Zentralblatt MATH identifier**

1149.62089

**Keywords**

Average causal effect causal effects complier average causal effect instrumental variables noncompliance observational studies propensity scores randomized experiments Rubin Causal Model

#### Citation

Rubin, Donald B. For objective causal inference, design trumps analysis. Ann. Appl. Stat. 2 (2008), no. 3, 808--840. doi:10.1214/08-AOAS187. http://projecteuclid.org/euclid.aoas/1223908042.