Much effort has been made to improve the famous step up procedure of Benjamini and Hochberg given by linear critical values $\frac{i\alpha}{n}$. It is pointed out by Gavrilov, Benjamini and Sarkar that step down multiple testing procedures based on the critical values $\beta_{i}=\frac{i\alpha}{n+1-i(1-\alpha)}$ still control the false discovery rate (FDR) at the upper bound $\alpha$ under basic independence assumptions. Since that result is no longer true for step up procedures and for step down procedures, if the p-values are dependent, a big discussion about the corresponding FDR starts in the literature. The present paper establishes finite sample formulas and bounds for the FDR and the expected number of false rejections for multiple testing procedures using critical values $\beta_{i}$ under martingale and reverse martingale dependence models. It is pointed out that martingale methods are natural tools for the treatment of local FDR estimators which are closely connected to the present coefficients $\beta_{i}$. The martingale approach also yields new results and further inside for the special basic independence model.
Electron. J. Statist.
11(1):
1827-1857
(2017).
DOI: 10.1214/17-EJS1268
[1] Benditkis, J. (2015) Martingale Methods for Control of False Discovery Rate and Expected Number of False Rejections., Dissertation. Heinrich Heine University Duesseldorf http://docserv.uni-duesseldorf.de/servlets/DocumentServlet?id=35438[1] Benditkis, J. (2015) Martingale Methods for Control of False Discovery Rate and Expected Number of False Rejections., Dissertation. Heinrich Heine University Duesseldorf http://docserv.uni-duesseldorf.de/servlets/DocumentServlet?id=35438
[2] Benjamini, Y. and Hochberg, Y. (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing., J. R. Statist. Soc. B, 57, 289–300. 0809.62014 10.1111/j.2517-6161.1995.tb02031.x[2] Benjamini, Y. and Hochberg, Y. (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing., J. R. Statist. Soc. B, 57, 289–300. 0809.62014 10.1111/j.2517-6161.1995.tb02031.x
[3] Benjamini, Y., Krieger, A. and Yekutieli, D. (2005) Adaptive linear step-up procedures that control the false discovery rate., Biometrika, 93, 491–507. 1108.62069 10.1093/biomet/93.3.491[3] Benjamini, Y., Krieger, A. and Yekutieli, D. (2005) Adaptive linear step-up procedures that control the false discovery rate., Biometrika, 93, 491–507. 1108.62069 10.1093/biomet/93.3.491
[4] Benjamini, Y. and Liu, W. (1999) Step-down multiple hypothesis procedure that controls the false discovery rate under independence., J. Statist. Planng Inf., 82, 163–170. 1063.62558 10.1016/S0378-3758(99)00040-3[4] Benjamini, Y. and Liu, W. (1999) Step-down multiple hypothesis procedure that controls the false discovery rate under independence., J. Statist. Planng Inf., 82, 163–170. 1063.62558 10.1016/S0378-3758(99)00040-3
[5] Benjamini, Y. and Yekutieli, D. (2001) The control of the false discovery rate in multiple testing under dependency., Ann. Statist., 29, 1165–1188. 1041.62061 10.1214/aos/1013699998 euclid.aos/1013699998[5] Benjamini, Y. and Yekutieli, D. (2001) The control of the false discovery rate in multiple testing under dependency., Ann. Statist., 29, 1165–1188. 1041.62061 10.1214/aos/1013699998 euclid.aos/1013699998
[6] Blanchard, G. and Roquain, E. (2008) Two simple sufficient conditions for FDR control., Elect. J. Statis., 2, 963–992. 1320.62179 10.1214/08-EJS180[6] Blanchard, G. and Roquain, E. (2008) Two simple sufficient conditions for FDR control., Elect. J. Statis., 2, 963–992. 1320.62179 10.1214/08-EJS180
[8] Finner, H., Dickhaus, T. and Roters, M. (2009) On the false discovery rate and an asymptotically optimal rejection curve., Ann. Statist., 37, 596–618. 1162.62068 10.1214/07-AOS569 euclid.aos/1236693143[8] Finner, H., Dickhaus, T. and Roters, M. (2009) On the false discovery rate and an asymptotically optimal rejection curve., Ann. Statist., 37, 596–618. 1162.62068 10.1214/07-AOS569 euclid.aos/1236693143
[9] Finner, H. and Roters, M. (2001) On the false discovery rate and expected type I errors., Biom. J., 43, 985–1005. 0989.62061 10.1002/1521-4036(200112)43:8<985::AID-BIMJ985>3.0.CO;2-4[9] Finner, H. and Roters, M. (2001) On the false discovery rate and expected type I errors., Biom. J., 43, 985–1005. 0989.62061 10.1002/1521-4036(200112)43:8<985::AID-BIMJ985>3.0.CO;2-4
[10] Finner, H. and Roters, M. (2002) Multiple hypotheses testing and expected number of type I errors., Ann. Statist., 30, 220–238. 1012.62020 10.1214/aos/1015362191 euclid.aos/1015362191[10] Finner, H. and Roters, M. (2002) Multiple hypotheses testing and expected number of type I errors., Ann. Statist., 30, 220–238. 1012.62020 10.1214/aos/1015362191 euclid.aos/1015362191
[11] Gavrilov, Y., Benjamini, Y. and Sarkar, S. K. (2009) An adaptive step-down procedure with proven FDR control., Ann. Statist., 37, 619–629. 1162.62069 10.1214/07-AOS586 euclid.aos/1236693144[11] Gavrilov, Y., Benjamini, Y. and Sarkar, S. K. (2009) An adaptive step-down procedure with proven FDR control., Ann. Statist., 37, 619–629. 1162.62069 10.1214/07-AOS586 euclid.aos/1236693144
[12] Gontscharuk, V. (2010) Asymptotic and exact results on FWER and FDR in multiple hypotheses testing., Dissertation, Heinrich Heine Universität Düsseldorf.[12] Gontscharuk, V. (2010) Asymptotic and exact results on FWER and FDR in multiple hypotheses testing., Dissertation, Heinrich Heine Universität Düsseldorf.
[13] Heesen, P. (2014) Adaptive step up tests for the false discovery rate (FDR) under independence and dependence, Dissertation. Heinrich Heine University Duesseldorf http://docserv.uni-duesseldorf.de/servlets/DocumentServlet?id=33047[13] Heesen, P. (2014) Adaptive step up tests for the false discovery rate (FDR) under independence and dependence, Dissertation. Heinrich Heine University Duesseldorf http://docserv.uni-duesseldorf.de/servlets/DocumentServlet?id=33047
[14] Heesen, P. and Janssen, A. (2015) Inequalities for the false discovery rate (FDR) under dependence., Electron. J. Statist., 9, 1, 679–716. 1309.62083 10.1214/15-EJS1016[14] Heesen, P. and Janssen, A. (2015) Inequalities for the false discovery rate (FDR) under dependence., Electron. J. Statist., 9, 1, 679–716. 1309.62083 10.1214/15-EJS1016
[15] Heesen, P. and Janssen, A. (2016) Dynamic adaptive multiple tests with finite sample FDR control., J. Statist. Plann. Inference, 168, 38–51 1328.62267 10.1016/j.jspi.2015.06.007[15] Heesen, P. and Janssen, A. (2016) Dynamic adaptive multiple tests with finite sample FDR control., J. Statist. Plann. Inference, 168, 38–51 1328.62267 10.1016/j.jspi.2015.06.007
[16] Marshall, A. W. and Olkin, I. (1967). A multivariate exponential distribution., J. Amer. Stat. Assoc. 62(317) 30–44. 0147.38106 10.1080/01621459.1967.10482885[16] Marshall, A. W. and Olkin, I. (1967). A multivariate exponential distribution., J. Amer. Stat. Assoc. 62(317) 30–44. 0147.38106 10.1080/01621459.1967.10482885
[17] Pena, E. A., J. D. Habiger, and W. Wu (2011). Power-enhanced multiple decision functions controlling family-wise error and false discovery rates., Ann. Statist., 39(1), 556–583. 1274.62143 10.1214/10-AOS844 euclid.aos/1297779856[17] Pena, E. A., J. D. Habiger, and W. Wu (2011). Power-enhanced multiple decision functions controlling family-wise error and false discovery rates., Ann. Statist., 39(1), 556–583. 1274.62143 10.1214/10-AOS844 euclid.aos/1297779856
[18] Sarkar, S. K. (2002) Some results on false discovery rate in stepwise multiple testing procedures., Ann. Statist., 30, 239–257. 1101.62349 10.1214/aos/1015362192 euclid.aos/1015362192[18] Sarkar, S. K. (2002) Some results on false discovery rate in stepwise multiple testing procedures., Ann. Statist., 30, 239–257. 1101.62349 10.1214/aos/1015362192 euclid.aos/1015362192
[19] Sarkar, S. K. (2008) On methods controlling the false discovery rate., Sankhya: The Indian Journal of Statistics, Series A, 135–168. 1193.62121[19] Sarkar, S. K. (2008) On methods controlling the false discovery rate., Sankhya: The Indian Journal of Statistics, Series A, 135–168. 1193.62121
[20] Scheer, M. (2012) Controlling the number of false rejections in multiple hypotheses testing., Dissertation, Heinrich Heine Universität Düsseldorf. http://docserv.uni-duesseldorf.de/servlets/DocumentServlet?id=23691[20] Scheer, M. (2012) Controlling the number of false rejections in multiple hypotheses testing., Dissertation, Heinrich Heine Universität Düsseldorf. http://docserv.uni-duesseldorf.de/servlets/DocumentServlet?id=23691
[21] Shorack, G. P. and Wellner, J. A. (1986) Empirical Processes with Applications to Statistics., John Wiley and Sons. Inc., New York . 1170.62365[21] Shorack, G. P. and Wellner, J. A. (1986) Empirical Processes with Applications to Statistics., John Wiley and Sons. Inc., New York . 1170.62365
[22] Storey, J. D. (2002) A direct approach to false discovery rates., J. R. Statist. Soc. B, 64, 479–498. 1090.62073 10.1111/1467-9868.00346[22] Storey, J. D. (2002) A direct approach to false discovery rates., J. R. Statist. Soc. B, 64, 479–498. 1090.62073 10.1111/1467-9868.00346
[23] Storey J. D., Taylor, J. E. and Siegmund D. (2004) Strong control, conservative point estimation, and simultaneous conservative consistency of false discovery rates: A unified approach., J. R. Statist. Soc. B, 66, 187–205. 1061.62110 10.1111/j.1467-9868.2004.00439.x[23] Storey J. D., Taylor, J. E. and Siegmund D. (2004) Strong control, conservative point estimation, and simultaneous conservative consistency of false discovery rates: A unified approach., J. R. Statist. Soc. B, 66, 187–205. 1061.62110 10.1111/j.1467-9868.2004.00439.x