The Annals of Applied Statistics
- Ann. Appl. Stat.
- Volume 12, Number 3 (2018), 1655-1678.
Sequential double cross-validation for assessment of added predictive ability in high-dimensional omic applications
Enriching existing predictive models with new biomolecular markers is an important task in the new multi-omic era. Clinical studies increasingly include new sets of omic measurements which may prove their added value in terms of predictive performance. We introduce a two-step approach for the assessment of the added predictive ability of omic predictors, based on sequential double cross-validation and regularized regression models. We propose several performance indices to summarize the two-stage prediction procedure and a permutation test to formally assess the added predictive value of a second omic set of predictors over a primary omic source. The performance of the test is investigated through simulations. We illustrate the new method through the systematic assessment and comparison of the performance of transcriptomics and metabolomics sources in the prediction of body mass index (BMI) using longitudinal data from the Dietary, Lifestyle, and Genetic determinants of Obesity and Metabolic syndrome (DILGOM) study, a population-based cohort from Finland.
Ann. Appl. Stat., Volume 12, Number 3 (2018), 1655-1678.
Received: July 2016
Revised: November 2017
First available in Project Euclid: 11 September 2018
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Rodríguez-Girondo, Mar; Salo, Perttu; Burzykowski, Tomasz; Perola, Markus; Houwing-Duistermaat, Jeanine; Mertens, Bart. Sequential double cross-validation for assessment of added predictive ability in high-dimensional omic applications. Ann. Appl. Stat. 12 (2018), no. 3, 1655--1678. doi:10.1214/17-AOAS1125. https://projecteuclid.org/euclid.aoas/1536652969
- Supplement A: Application to DILGOM data. Supplementary analyses. We provide supplementary analyses in our data application to the DILGOM study.
- Supplement B: Simulation study. Alternative approaches. We provide supplementary simulation results from alternative approaches.