Open Access
2017 Finite sample bounds for expected number of false rejections under martingale dependence with applications to FDR
Julia Benditkis, Arnold Janssen
Electron. J. Statist. 11(1): 1827-1857 (2017). DOI: 10.1214/17-EJS1268
Abstract

Much effort has been made to improve the famous step up procedure of Benjamini and Hochberg given by linear critical values $\frac{i\alpha}{n}$. It is pointed out by Gavrilov, Benjamini and Sarkar that step down multiple testing procedures based on the critical values $\beta_{i}=\frac{i\alpha}{n+1-i(1-\alpha)}$ still control the false discovery rate (FDR) at the upper bound $\alpha$ under basic independence assumptions. Since that result is no longer true for step up procedures and for step down procedures, if the p-values are dependent, a big discussion about the corresponding FDR starts in the literature. The present paper establishes finite sample formulas and bounds for the FDR and the expected number of false rejections for multiple testing procedures using critical values $\beta_{i}$ under martingale and reverse martingale dependence models. It is pointed out that martingale methods are natural tools for the treatment of local FDR estimators which are closely connected to the present coefficients $\beta_{i}$. The martingale approach also yields new results and further inside for the special basic independence model.

References

1.

[1] Benditkis, J. (2015) Martingale Methods for Control of False Discovery Rate and Expected Number of False Rejections., Dissertation. Heinrich Heine University Duesseldorf  http://docserv.uni-duesseldorf.de/servlets/DocumentServlet?id=35438[1] Benditkis, J. (2015) Martingale Methods for Control of False Discovery Rate and Expected Number of False Rejections., Dissertation. Heinrich Heine University Duesseldorf  http://docserv.uni-duesseldorf.de/servlets/DocumentServlet?id=35438

2.

[2] Benjamini, Y. and Hochberg, Y. (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing., J. R. Statist. Soc. B, 57, 289–300. 0809.62014 10.1111/j.2517-6161.1995.tb02031.x[2] Benjamini, Y. and Hochberg, Y. (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing., J. R. Statist. Soc. B, 57, 289–300. 0809.62014 10.1111/j.2517-6161.1995.tb02031.x

3.

[3] Benjamini, Y., Krieger, A. and Yekutieli, D. (2005) Adaptive linear step-up procedures that control the false discovery rate., Biometrika, 93, 491–507. 1108.62069 10.1093/biomet/93.3.491[3] Benjamini, Y., Krieger, A. and Yekutieli, D. (2005) Adaptive linear step-up procedures that control the false discovery rate., Biometrika, 93, 491–507. 1108.62069 10.1093/biomet/93.3.491

4.

[4] Benjamini, Y. and Liu, W. (1999) Step-down multiple hypothesis procedure that controls the false discovery rate under independence., J. Statist. Planng Inf., 82, 163–170. 1063.62558 10.1016/S0378-3758(99)00040-3[4] Benjamini, Y. and Liu, W. (1999) Step-down multiple hypothesis procedure that controls the false discovery rate under independence., J. Statist. Planng Inf., 82, 163–170. 1063.62558 10.1016/S0378-3758(99)00040-3

5.

[5] Benjamini, Y. and Yekutieli, D. (2001) The control of the false discovery rate in multiple testing under dependency., Ann. Statist., 29, 1165–1188. 1041.62061 10.1214/aos/1013699998 euclid.aos/1013699998[5] Benjamini, Y. and Yekutieli, D. (2001) The control of the false discovery rate in multiple testing under dependency., Ann. Statist., 29, 1165–1188. 1041.62061 10.1214/aos/1013699998 euclid.aos/1013699998

6.

[6] Blanchard, G. and Roquain, E. (2008) Two simple sufficient conditions for FDR control., Elect. J. Statis., 2, 963–992. 1320.62179 10.1214/08-EJS180[6] Blanchard, G. and Roquain, E. (2008) Two simple sufficient conditions for FDR control., Elect. J. Statis., 2, 963–992. 1320.62179 10.1214/08-EJS180

7.

[7] Dickhaus, T. (2008) False discovery rate and asymptotics., Dissertation, Heinrich-Heine-Universität Düsseldorf.[7] Dickhaus, T. (2008) False discovery rate and asymptotics., Dissertation, Heinrich-Heine-Universität Düsseldorf.

8.

[8] Finner, H., Dickhaus, T. and Roters, M. (2009) On the false discovery rate and an asymptotically optimal rejection curve., Ann. Statist., 37, 596–618. 1162.62068 10.1214/07-AOS569 euclid.aos/1236693143[8] Finner, H., Dickhaus, T. and Roters, M. (2009) On the false discovery rate and an asymptotically optimal rejection curve., Ann. Statist., 37, 596–618. 1162.62068 10.1214/07-AOS569 euclid.aos/1236693143

9.

[9] Finner, H. and Roters, M. (2001) On the false discovery rate and expected type I errors., Biom. J., 43, 985–1005. 0989.62061 10.1002/1521-4036(200112)43:8<985::AID-BIMJ985>3.0.CO;2-4[9] Finner, H. and Roters, M. (2001) On the false discovery rate and expected type I errors., Biom. J., 43, 985–1005. 0989.62061 10.1002/1521-4036(200112)43:8<985::AID-BIMJ985>3.0.CO;2-4

10.

[10] Finner, H. and Roters, M. (2002) Multiple hypotheses testing and expected number of type I errors., Ann. Statist., 30, 220–238. 1012.62020 10.1214/aos/1015362191 euclid.aos/1015362191[10] Finner, H. and Roters, M. (2002) Multiple hypotheses testing and expected number of type I errors., Ann. Statist., 30, 220–238. 1012.62020 10.1214/aos/1015362191 euclid.aos/1015362191

11.

[11] Gavrilov, Y., Benjamini, Y. and Sarkar, S. K. (2009) An adaptive step-down procedure with proven FDR control., Ann. Statist., 37, 619–629. 1162.62069 10.1214/07-AOS586 euclid.aos/1236693144[11] Gavrilov, Y., Benjamini, Y. and Sarkar, S. K. (2009) An adaptive step-down procedure with proven FDR control., Ann. Statist., 37, 619–629. 1162.62069 10.1214/07-AOS586 euclid.aos/1236693144

12.

[12] Gontscharuk, V. (2010) Asymptotic and exact results on FWER and FDR in multiple hypotheses testing., Dissertation, Heinrich Heine Universität Düsseldorf.[12] Gontscharuk, V. (2010) Asymptotic and exact results on FWER and FDR in multiple hypotheses testing., Dissertation, Heinrich Heine Universität Düsseldorf.

13.

[13] Heesen, P. (2014) Adaptive step up tests for the false discovery rate (FDR) under independence and dependence, Dissertation. Heinrich Heine University Duesseldorf  http://docserv.uni-duesseldorf.de/servlets/DocumentServlet?id=33047[13] Heesen, P. (2014) Adaptive step up tests for the false discovery rate (FDR) under independence and dependence, Dissertation. Heinrich Heine University Duesseldorf  http://docserv.uni-duesseldorf.de/servlets/DocumentServlet?id=33047

14.

[14] Heesen, P. and Janssen, A. (2015) Inequalities for the false discovery rate (FDR) under dependence., Electron. J. Statist., 9, 1, 679–716. 1309.62083 10.1214/15-EJS1016[14] Heesen, P. and Janssen, A. (2015) Inequalities for the false discovery rate (FDR) under dependence., Electron. J. Statist., 9, 1, 679–716. 1309.62083 10.1214/15-EJS1016

15.

[15] Heesen, P. and Janssen, A. (2016) Dynamic adaptive multiple tests with finite sample FDR control., J. Statist. Plann. Inference, 168, 38–51 1328.62267 10.1016/j.jspi.2015.06.007[15] Heesen, P. and Janssen, A. (2016) Dynamic adaptive multiple tests with finite sample FDR control., J. Statist. Plann. Inference, 168, 38–51 1328.62267 10.1016/j.jspi.2015.06.007

16.

[16] Marshall, A. W. and Olkin, I. (1967). A multivariate exponential distribution., J. Amer. Stat. Assoc. 62(317) 30–44. 0147.38106 10.1080/01621459.1967.10482885[16] Marshall, A. W. and Olkin, I. (1967). A multivariate exponential distribution., J. Amer. Stat. Assoc. 62(317) 30–44. 0147.38106 10.1080/01621459.1967.10482885

17.

[17] Pena, E. A., J. D. Habiger, and W. Wu (2011). Power-enhanced multiple decision functions controlling family-wise error and false discovery rates., Ann. Statist., 39(1), 556–583. 1274.62143 10.1214/10-AOS844 euclid.aos/1297779856[17] Pena, E. A., J. D. Habiger, and W. Wu (2011). Power-enhanced multiple decision functions controlling family-wise error and false discovery rates., Ann. Statist., 39(1), 556–583. 1274.62143 10.1214/10-AOS844 euclid.aos/1297779856

18.

[18] Sarkar, S. K. (2002) Some results on false discovery rate in stepwise multiple testing procedures., Ann. Statist., 30, 239–257. 1101.62349 10.1214/aos/1015362192 euclid.aos/1015362192[18] Sarkar, S. K. (2002) Some results on false discovery rate in stepwise multiple testing procedures., Ann. Statist., 30, 239–257. 1101.62349 10.1214/aos/1015362192 euclid.aos/1015362192

19.

[19] Sarkar, S. K. (2008) On methods controlling the false discovery rate., Sankhya: The Indian Journal of Statistics, Series A, 135–168. 1193.62121[19] Sarkar, S. K. (2008) On methods controlling the false discovery rate., Sankhya: The Indian Journal of Statistics, Series A, 135–168. 1193.62121

20.

[20] Scheer, M. (2012) Controlling the number of false rejections in multiple hypotheses testing., Dissertation, Heinrich Heine Universität Düsseldorf.  http://docserv.uni-duesseldorf.de/servlets/DocumentServlet?id=23691[20] Scheer, M. (2012) Controlling the number of false rejections in multiple hypotheses testing., Dissertation, Heinrich Heine Universität Düsseldorf.  http://docserv.uni-duesseldorf.de/servlets/DocumentServlet?id=23691

21.

[21] Shorack, G. P. and Wellner, J. A. (1986) Empirical Processes with Applications to Statistics., John Wiley and Sons. Inc., New York 1170.62365[21] Shorack, G. P. and Wellner, J. A. (1986) Empirical Processes with Applications to Statistics., John Wiley and Sons. Inc., New York 1170.62365

22.

[22] Storey, J. D. (2002) A direct approach to false discovery rates., J. R. Statist. Soc. B, 64, 479–498. 1090.62073 10.1111/1467-9868.00346[22] Storey, J. D. (2002) A direct approach to false discovery rates., J. R. Statist. Soc. B, 64, 479–498. 1090.62073 10.1111/1467-9868.00346

23.

[23] Storey J. D., Taylor, J. E. and Siegmund D. (2004) Strong control, conservative point estimation, and simultaneous conservative consistency of false discovery rates: A unified approach., J. R. Statist. Soc. B, 66, 187–205. 1061.62110 10.1111/j.1467-9868.2004.00439.x[23] Storey J. D., Taylor, J. E. and Siegmund D. (2004) Strong control, conservative point estimation, and simultaneous conservative consistency of false discovery rates: A unified approach., J. R. Statist. Soc. B, 66, 187–205. 1061.62110 10.1111/j.1467-9868.2004.00439.x

24.

[24] Shiryaev, Albert N (1999) Essentials of Stochastic Finance: Facts, Models, Theory., World Scientific, 1999[24] Shiryaev, Albert N (1999) Essentials of Stochastic Finance: Facts, Models, Theory., World Scientific, 1999
Julia Benditkis and Arnold Janssen "Finite sample bounds for expected number of false rejections under martingale dependence with applications to FDR," Electronic Journal of Statistics 11(1), 1827-1857, (2017). https://doi.org/10.1214/17-EJS1268
Received: 1 June 2016; Published: 2017
Vol.11 • No. 1 • 2017
Back to Top