The Annals of Applied Statistics

Assessing surrogate endpoints in vaccine trials with case-cohort sampling and the Cox model

Li Qin, Peter B. Gilbert, Dean Follmann, and Dongfeng Li

Full-text: Open access


Assessing immune responses to study vaccines as surrogates of protection plays a central role in vaccine clinical trials. Motivated by three ongoing or pending HIV vaccine efficacy trials, we consider such surrogate endpoint assessment in a randomized placebo-controlled trial with case-cohort sampling of immune responses and a time to event endpoint. Based on the principal surrogate definition under the principal stratification framework proposed by Frangakis and Rubin [Biometrics 58 (2002) 21–29] and adapted by Gilbert and Hudgens (2006), we introduce estimands that measure the value of an immune response as a surrogate of protection in the context of the Cox proportional hazards model. The estimands are not identified because the immune response to vaccine is not measured in placebo recipients. We formulate the problem as a Cox model with missing covariates, and employ novel trial designs for predicting the missing immune responses and thereby identifying the estimands. The first design utilizes information from baseline predictors of the immune response, and bridges their relationship in the vaccine recipients to the placebo recipients. The second design provides a validation set for the unmeasured immune responses of uninfected placebo recipients by immunizing them with the study vaccine after trial closeout. A maximum estimated likelihood approach is proposed for estimation of the parameters. Simulated data examples are given to evaluate the proposed designs and study their properties.

Article information

Ann. Appl. Stat., Volume 2, Number 1 (2008), 386-407.

First available in Project Euclid: 24 March 2008

Permanent link to this document

Digital Object Identifier

Mathematical Reviews number (MathSciNet)

Zentralblatt MATH identifier

Clinical trial discrete failure time model missing data potential outcomes principal stratification surrogate marker


Qin, Li; Gilbert, Peter B.; Follmann, Dean; Li, Dongfeng. Assessing surrogate endpoints in vaccine trials with case-cohort sampling and the Cox model. Ann. Appl. Stat. 2 (2008), no. 1, 386--407. doi:10.1214/07-AOAS132.

Export citation


  • Borgan, O., Langholz, B., Samuelsen, O., Goldstein, L. and Pogod, J. (2000). Exposure stratified case-cohort designs., Lifetime Data Anal. 6 39–58.
  • Catanzaro, A., Koup, R., Roederer, M. et al. (2006). Safety and immunogenicity evaluation of a multiclade HIV-1 candidate vaccine delivered by a replication-defective recombinant adenovirus vector., J. Infectious Diseases 194 1638–1649.
  • Chan, I., Wang, W. and Heyse, J. (2003)., Vaccine Clinical Trials in Encyclopedia of Biopharmaceutical Statistics, 2nd ed. Dekker, New York.
  • Chen, H. Y. (2002). Double-semiparametric method for missing covariates in Cox regression models., J. Amer. Statist. Assoc. 97 565–576.
  • Chen, H. Y. and Little, R. J. A. (1999). Proportional hazards regression with missing covariates., J. Amer. Statist. Assoc. 94 896–908.
  • Cox, D. R. (1972). Regression models and life-tables (with discussion)., J. Roy. Statist. Soc. Ser. B 34 187–220.
  • Czeschinski, P., Binding, N. and Witting, U. (2000). Hepatitis A and hepatitis B vaccinations: immunogenicity of combined vaccine and of simultaneously or separately applied single vaccines., Vaccine 18 1074–1080.
  • DeGruttola, V. G., Clax, P., DeMets, D. L., Downing, G. J., Ellenberg, S. S., Friedman, L., Gail, M. H., Prentice, R., Wittes, J. and Zeger, S. L. (2002). Considerations in the evaluation of surrogate endpoints in clinical trials., Controlled Clinical Trials 22 485–502.
  • Follmann, D. (2006). Augmented designs to assess immune response in vaccine trials., Biometrics 62 1161–1169.
  • Frangakis, C. and Rubin, D. (2002). Principal stratification in causal inference., Biometrics 58 21–29.
  • Gilbert, P. B. and Hudgens, M. G. (2006). Evaluating causal effect predictiveness of candidate surrogate endpoints. Working Paper 291, UW Biostatistics Working Paper, Series.
  • Gilbert, P. B., Bosch, R. and Hudgens, M. G. (2003). Sensitivity analysis for the assessment of causal vaccine effects on viral loads in HIV vaccine trials., Biometrics 59 531–541.
  • Gilbert, P. B., Peterson, M., Follmann, D., Hudgens, M., Francis, D., Gurwith, M., Heyward, W., Jobes, D., Popovic, V., Self, S., Sinangil, F., Burke, D. and Berman, P. (2005). Correlation between immunologic responses to a recombinant glycoprotein 120 vaccine and incidence of HIV-1 infection in a phase 3 HIV-1 preventive vaccine trial., J. Infectious Diseases 191 666–677.
  • Halloran, M. E. (1998). Vaccine studies. In, Encyclopedia of Biostatistics (P. Armitage and T. Colton, eds.) 4687–4694. Wiley, New York.
  • Herring, A. H. and Ibrahim, J. G. (2001). Likelihood-based methods for missing covariates in the Cox proportional hazards model., J. Amer. Statist. Assoc. 96 292–302.
  • Holland, P. (1986). Statistics and causal inference (with discussion)., J. Amer. Statist. Assoc. 81 945–970.
  • Kulich, M. and Lin, D. Y. (2004). Improving the efficiency of relative-risk estimation in case-cohort studies., J. Amer. Statist. Assoc. 99 832–844.
  • Lin, D., Fleming, T. R. and De Gruttola, V. (1997). Estimating the proportion of treatment effect explained by a surrogate markers., Statistics in Medicine 16 1515–1527.
  • Lin, D. Y. and Ying, Z. (1993). Cox regression with incomplete covariate measurements., J. Amer. Statist. Assoc. 88 1341–1349.
  • Little, R. A. and Rubin, D. B. (2002)., Statistical Analysis of Missing Data, 2nd ed. Wiley, Hoboken, NJ.
  • Mehrotra, D. V., Li, X. and Gilbert, P. B. (2006). A comparison of eight methods for the dual-endpoint evaluation of efficacy in a proof-of-concept HIV vaccine trial., Biometrics 62 893–900.
  • Molenberghs, G., Buyse, M., Geys, H., Renard, D., Burzykowski, T. and Alonso, A. (2002). Statistical challenges in the evaluation of surrogate endpoints in randomized trials., Controlled Clinical Trials 23 607–625.
  • Paik, M. C. and Tsai, W. Y. (1997). On using the Cox proportional hazards model with missing covariates., Biometrika 84 579–593.
  • Pearl, J. (2000)., Causality: Models, Reasoning, and Inference. Cambridge Univ. Press.
  • Pepe, M. and Fleming, T. (1991). A nonparametric method for dealing with mismeasured covariate data., J. Amer. Statist. Assoc. 86 108–113.
  • Prentice, R. L. (1982). Covariate measurement errors and parameter estimation in a failure time regression model., Biometrika 69 331–342.
  • Prentice, R. L. (1986). A case-cohort design for epidemiologic cohort studies and disease prevention trials., Biometrika 73 1–11.
  • Prentice, R. L. (1989). Surrogate endpoints in clinical trials: Definition and operational criteria., Statistics in Medicine 8 431–440.
  • Robins, J. M., Rotnitzky, A. and Zhao, L. P. (1994). Estimation of regression coefficients when some regressors are not always observed., J. Amer. Statist. Assoc. 89 846–866.
  • Rubin, D. B. (2005). Causal inference using potential outcomes: Design, modeling, decisions., J. Amer. Statist. Assoc. 100 322–331.
  • Scheike, T. H. and Martinussen, T. (2004). Maximum likelihood estimation for Cox’s regression model under case-cohort sampling., Scand. J. Statist. 31 283–293.
  • Wang, C. Y., Hsu, L., Feng, Z. D. and Prentice, R. L. (1997). Regression calibration in failure time regression., Biometrics 53 131–145.
  • Weir, C. and Walley, R. (2006). Statistical evaluation of biomarkers as surrogate endpoints: A literature review., Statistics in Medicine 25 183–203.
  • Zhou, H. B. and Pepe, M. S. (1995). Auxiliary covariate data in failure time regression., Biometrika 82 139–149.