Translator Disclaimer
2019 Variability and stability of the false discovery proportion
Marc Ditzhaus, Arnold Janssen
Electron. J. Statist. 13(1): 882-910 (2019). DOI: 10.1214/19-EJS1544


Much effort has been done to control the “false discovery rate” (FDR) when $m$ hypotheses are tested simultaneously. The FDR is the expectation of the “false discovery proportion” $\text{FDP}=V/R$ given by the ratio of the number of false rejections $V$ and all rejections $R$. In this paper, we have a closer look at the FDP for adaptive linear step-up multiple tests. These tests extend the well known Benjamini and Hochberg test by estimating the unknown amount $m_{0}$ of the true null hypotheses. We give exact finite sample formulas for higher moments of the FDP and, in particular, for its variance. Using these allows us a precise discussion about the stability of the FDP, i.e., when the FDP is asymptotically close to its mean. We present sufficient and necessary conditions for this stability. They include the presence of a stable estimator for the proportion $m_{0}/m$. We apply our results to convex combinations of generalized Storey type estimators with various tuning parameters and (possibly) data-driven weights. The corresponding step-up tests allow a flexible adaptation. Moreover, these tests control the FDR at finite sample size. We compare these tests to the classical Benjamini and Hochberg test and discuss the advantages of them.


Download Citation

Marc Ditzhaus. Arnold Janssen. "Variability and stability of the false discovery proportion." Electron. J. Statist. 13 (1) 882 - 910, 2019.


Received: 1 August 2018; Published: 2019
First available in Project Euclid: 26 March 2019

zbMATH: 07056143
MathSciNet: MR3932610
Digital Object Identifier: 10.1214/19-EJS1544

Primary: 62G10
Secondary: 62G20


Vol.13 • No. 1 • 2019
Back to Top