The Annals of Statistics

Linear hypothesis testing for high dimensional generalized linear models

Chengchun Shi, Rui Song, Zhao Chen, and Runze Li

Full-text: Access denied (no subscription detected)

We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber. If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription. Read more about accessing full-text

Abstract

This paper is concerned with testing linear hypotheses in high dimensional generalized linear models. To deal with linear hypotheses, we first propose the constrained partial regularization method and study its statistical properties. We further introduce an algorithm for solving regularization problems with folded-concave penalty functions and linear constraints. To test linear hypotheses, we propose a partial penalized likelihood ratio test, a partial penalized score test and a partial penalized Wald test. We show that the limiting null distributions of these three test statistics are $\chi^{2}$ distribution with the same degrees of freedom, and under local alternatives, they asymptotically follow noncentral $\chi^{2}$ distributions with the same degrees of freedom and noncentral parameter, provided the number of parameters involved in the test hypothesis grows to $\infty$ at a certain rate. Simulation studies are conducted to examine the finite sample performance of the proposed tests. Empirical analysis of a real data example is used to illustrate the proposed testing procedures.

Article information

Source
Ann. Statist., Volume 47, Number 5 (2019), 2671-2703.

Dates
Received: June 2017
Revised: July 2018
First available in Project Euclid: 3 August 2019

Permanent link to this document
https://projecteuclid.org/euclid.aos/1564797860

Digital Object Identifier
doi:10.1214/18-AOS1761

Mathematical Reviews number (MathSciNet)
MR3988769

Subjects
Primary: 62F03: Hypothesis testing
Secondary: 62J12: Generalized linear models

Keywords
High dimensional testing linear hypothesis likelihood ratio statistics score test Wald test

Citation

Shi, Chengchun; Song, Rui; Chen, Zhao; Li, Runze. Linear hypothesis testing for high dimensional generalized linear models. Ann. Statist. 47 (2019), no. 5, 2671--2703. doi:10.1214/18-AOS1761. https://projecteuclid.org/euclid.aos/1564797860


Export citation

References

  • Bentkus, V. (2004). A Lyapunov type bound in $\mathbf{R}^{d}$. Teor. Veroyatn. Primen. 49 400–410.
  • Boyd, S., Parikh, N., Chu, E., Peleato, B. and Eckstein, J. (2011). Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends Mach. Learn. 3 1–122.
    Zentralblatt MATH: 1229.90122
    Digital Object Identifier: doi:10.1561/2200000016
  • Breheny, P. and Huang, J. (2011). Coordinate descent algorithms for nonconvex penalized regression, with applications to biological feature selection. Ann. Appl. Stat. 5 232–253.
    Zentralblatt MATH: 1220.62095
    Digital Object Identifier: doi:10.1214/10-AOAS388
    Project Euclid: euclid.aoas/1300715189
  • Candes, E. and Tao, T. (2007). The Dantzig selector: Statistical estimation when $p$ is much larger than $n$. Ann. Statist. 35 2313–2351.
    Zentralblatt MATH: 1139.62019
    Digital Object Identifier: doi:10.1214/009053606000001523
    Project Euclid: euclid.aos/1201012958
  • Dezeure, R., Bühlmann, P., Meier, L. and Meinshausen, N. (2015). High-dimensional inference: Confidence intervals, $p$-values and R-software hdi. Statist. Sci. 30 533–558.
  • Fan, J., Guo, S. and Hao, N. (2012). Variance estimation using refitted cross-validation in ultrahigh dimensional regression. J. R. Stat. Soc. Ser. B. Stat. Methodol. 74 37–65.
    Zentralblatt MATH: 1411.62199
    Digital Object Identifier: doi:10.1111/j.1467-9868.2011.01005.x
  • Fan, J. and Li, R. (2001). Variable selection via nonconcave penalized likelihood and its oracle properties. J. Amer. Statist. Assoc. 96 1348–1360.
    Zentralblatt MATH: 1073.62547
    Digital Object Identifier: doi:10.1198/016214501753382273
  • Fan, J. and Lv, J. (2010). A selective overview of variable selection in high dimensional feature space. Statist. Sinica 20 101–148.
    Zentralblatt MATH: 1180.62080
  • Fan, J. and Lv, J. (2011). Nonconcave penalized likelihood with NP-dimensionality. IEEE Trans. Inform. Theory 57 5467–5484.
    Zentralblatt MATH: 1365.62277
    Digital Object Identifier: doi:10.1109/TIT.2011.2158486
  • Fan, J. and Peng, H. (2004). Nonconcave penalized likelihood with a diverging number of parameters. Ann. Statist. 32 928–961.
    Zentralblatt MATH: 1092.62031
    Digital Object Identifier: doi:10.1214/009053604000000256
    Project Euclid: euclid.aos/1085408491
  • Fan, Y. and Tang, C. Y. (2013). Tuning parameter selection in high dimensional penalized likelihood. J. R. Stat. Soc. Ser. B. Stat. Methodol. 75 531–552.
    Zentralblatt MATH: 1411.62216
    Digital Object Identifier: doi:10.1111/rssb.12001
  • Fang, E. X., Ning, Y. and Liu, H. (2017). Testing and confidence intervals for high dimensional proportional hazards models. J. R. Stat. Soc. Ser. B. Stat. Methodol. 79 1415–1437.
    Zentralblatt MATH: 1380.62240
    Digital Object Identifier: doi:10.1111/rssb.12224
  • Ghosh, B. K. (1973). Some monotonicity theorems for $\chi^{2}$, $F$ and $t$ distributions with applications. J. Roy. Statist. Soc. Ser. B 35 480–492.
  • Lee, J. D., Sun, D. L., Sun, Y. and Taylor, J. E. (2016). Exact post-selection inference, with application to the lasso. Ann. Statist. 44 907–927.
    Zentralblatt MATH: 1341.62061
    Digital Object Identifier: doi:10.1214/15-AOS1371
    Project Euclid: euclid.aos/1460381681
  • Lockhart, R., Taylor, J., Tibshirani, R. J. and Tibshirani, R. (2014). A significance test for the lasso. Ann. Statist. 42 413–468.
    Zentralblatt MATH: 1305.62254
    Digital Object Identifier: doi:10.1214/13-AOS1175
    Project Euclid: euclid.aos/1400592161
  • McCullagh, P. and Nelder, J. A. (1989). Generalized Linear Models, 2nd ed. [of MR0727836]. Chapman & Hall, London.
    Zentralblatt MATH: 0744.62098
  • Ning, Y. and Liu, H. (2017). A general theory of hypothesis tests and confidence regions for sparse high dimensional models. Ann. Statist. 45 158–195.
    Zentralblatt MATH: 1364.62128
    Digital Object Identifier: doi:10.1214/16-AOS1448
    Project Euclid: euclid.aos/1487667620
  • Schwarz, G. (1978). Estimating the dimension of a model. Ann. Statist. 6 461–464.
    Zentralblatt MATH: 0379.62005
    Digital Object Identifier: doi:10.1214/aos/1176344136
    Project Euclid: euclid.aos/1176344136
  • Shi, C., Song, R., Chen, Z. and Li, R. (2019). Supplement to “Linear hypothesis testing for high dimensional generalized linear models.” DOI:10.1214/18-AOS1761SUPP.
  • Sun, T. and Zhang, C.-H. (2013). Sparse matrix inversion with scaled lasso. J. Mach. Learn. Res. 14 3385–3418.
    Zentralblatt MATH: 1318.62184
  • Taylor, J., Lockhart, R., Tibshirani, R. J. and Tibshirani, R. (2015). Exact Post-Selection Inference for Sequential Regression Procedures. Preprint. Available at arXiv:1401.3889.
    arXiv: 1401.3889
    Zentralblatt MATH: 1305.62255
    Digital Object Identifier: doi:10.1214/14-AOS1175REJ
    Project Euclid: euclid.aos/1400592168
  • Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. J. Roy. Statist. Soc. Ser. B 58 267–288.
    Zentralblatt MATH: 0850.62538
    Digital Object Identifier: doi:10.1111/j.2517-6161.1996.tb02080.x
  • van de Geer, S., Bühlmann, P., Ritov, Y. and Dezeure, R. (2014). On asymptotically optimal confidence regions and tests for high-dimensional models. Ann. Statist. 42 1166–1202.
    Zentralblatt MATH: 1305.62259
    Digital Object Identifier: doi:10.1214/14-AOS1221
    Project Euclid: euclid.aos/1403276911
  • Wang, S. and Cui, H. (2013). Partial penalized likelihood ratio test under sparse case. Preprint. Available at arXiv:1312.3723.
    arXiv: 1312.3723
    Zentralblatt MATH: 1368.62046
    Digital Object Identifier: doi:10.1007/s10255-017-0663-4
  • Zhang, C.-H. (2010). Nearly unbiased variable selection under minimax concave penalty. Ann. Statist. 38 894–942.
    Zentralblatt MATH: 1183.62120
    Digital Object Identifier: doi:10.1214/09-AOS729
    Project Euclid: euclid.aos/1266586618
  • Zhang, X. and Cheng, G. (2017). Simultaneous inference for high-dimensional linear models. J. Amer. Statist. Assoc. 112 757–768.

Supplemental materials

  • Supplement to “Linear hypothesis testing for high dimensional generalized linear models”. This supplemental material includes power comparisons with existing test statistics, additional numerical studies on Poisson regression and a real data application, discussions of Conditions (A1)–(A4), some technical lemmas and the proof of Theorem 2.1.
    Digital Object Identifier: doi:10.1214/18-AOS1761SUPP
    Supplemental files are immediately available to subscribers. Non-subscribers gain access to supplemental files with the purchase of the article.

The Institute of Mathematical Statistics

The Annals of Statistics

New content alerts

Email RSS ToC RSS Article
  • You have access to this content.
  • You have partial access to this content.
  • You do not have access to this content.
Turn Off MathJax

What is MathJax?

More like this

+ See more