The Annals of Statistics

Test for high-dimensional correlation matrices

Shurong Zheng, Guanghui Cheng, Jianhua Guo, and Hongtu Zhu

Full-text: Access denied (no subscription detected)

We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber. If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription. Read more about accessing full-text

Abstract

Testing correlation structures has attracted extensive attention in the literature due to both its importance in real applications and several major theoretical challenges. The aim of this paper is to develop a general framework of testing correlation structures for the one , two and multiple sample testing problems under a high-dimensional setting when both the sample size and data dimension go to infinity. Our test statistics are designed to deal with both the dense and sparse alternatives. We systematically investigate the asymptotic null distribution, power function and unbiasedness of each test statistic. Theoretically, we make great efforts to deal with the nonindependency of all random matrices of the sample correlation matrices. We use simulation studies and real data analysis to illustrate the versatility and practicability of our test statistics.

Article information

Source
Ann. Statist., Volume 47, Number 5 (2019), 2887-2921.

Dates
Received: May 2017
Revised: July 2018
First available in Project Euclid: 3 August 2019

Permanent link to this document
https://projecteuclid.org/euclid.aos/1564797867

Digital Object Identifier
doi:10.1214/18-AOS1768

Mathematical Reviews number (MathSciNet)
MR3988776

Subjects
Primary: 62H15: Hypothesis testing
Secondary: 62H10: Distribution of statistics

Keywords
Dense alternatives global testing sample correlation matrices sparse alternatives

Citation

Zheng, Shurong; Cheng, Guanghui; Guo, Jianhua; Zhu, Hongtu. Test for high-dimensional correlation matrices. Ann. Statist. 47 (2019), no. 5, 2887--2921. doi:10.1214/18-AOS1768. https://projecteuclid.org/euclid.aos/1564797867


Export citation

References

  • Aitkin, M. A. (1969). Some tests for correlation matrices. Biometrika 56 443–446.
  • Anderson, T. W. (2003). An Introduction to Multivariate Statistical Analysis, 3rd ed. Wiley Series in Probability and Statistics. Wiley Interscience, Hoboken, NJ.
  • Bai, Z. D. and Silverstein, J. W. (2004). CLT for linear spectral statistics of large-dimensional sample covariance matrices. Ann. Probab. 32 553–605.
  • Bartlett, M. S. and Rajalakshman, D. V. (1953). Goodness of fit tests for simultaneous autoregressive series. J. Roy. Statist. Soc. Ser. B 15 107–124.
  • Bodwin, K., Zhang, K. and Nobel, A. (2018). A testing based approach to the discovery of differentially correlated variable sets. Ann. Appl. Stat. 12 1180–1203.
  • Browne, M. W. (1978). The likelihood ratio test for the equality of correlation matrices. Br. J. Math. Stat. Psychol. 31 209–217.
  • Cai, T. T. (2017). Global testing and large-scale multiple testing for high-dimensional covariance structures. Ann. Rev. Stat. Appl. 4 423–446.
  • Cai, T. T. and Jiang, T. (2011). Limiting laws of coherence of random matrices with applications to testing covariance structure and construction of compressed sensing matrices. Ann. Statist. 39 1496–1525.
  • Cai, T., Liu, W. and Xia, Y. (2013). Two-sample covariance matrix testing and support recovery in high-dimensional and sparse settings. J. Amer. Statist. Assoc. 108 265–277.
  • Cai, T. T. and Ma, Z. (2013). Optimal hypothesis testing for high dimensional covariance matrices. Bernoulli 19 2359–2388.
  • Cai, T. T. and Zhang, A. (2016). Inference for high-dimensional differential correlation matrices. J. Multivariate Anal. 143 107–126.
  • Chen, S. X., Zhang, L.-X. and Zhong, P.-S. (2010). Tests for high-dimensional covariance matrices. J. Amer. Statist. Assoc. 105 810–819.
  • Cole, N. (1968). The likelihood ratio test of the equality of correlation matrices. 1968-65: The L. L. Thurstone Psychometric Laboratory. Univ. North Carolina, Chapel Hill, NC.
  • Debashis, P. and Alexander, A. (2014). Random matrix theory in statistics: A review. J. Statist. Plann. Inference 150 1–29.
  • Gao, J., Han, X., Pan, G. and Yang, Y. (2017). High dimensional correlation matrices: The central limit theorem and its applications. J. R. Stat. Soc. Ser. B. Stat. Methodol. 79 677–693.
  • Gupta, A. K., Johnson, B. E. and Nagar, D. K. (2013). Testing equality of several correlation matrices. Rev. Colombiana Estadíst. 36 237–258.
  • Jennrich, R. I. (1970). An asymptotic $\chi^{2}$ test for the equality of two correlation matrices. J. Amer. Statist. Assoc. 65 904–912.
  • Kullback, S. (1967). On testing correlation matrices. J. Roy. Statist. Soc. Ser. C 16 80–85.
  • Larntz, K. and Perlman, M. D. (1985). A simple test for the equality of correlation matrices Technical Report 63.
  • Li, D. N. and Xue, L. Z. (2015). Joint limiting laws for high-dimensional independence tests. Available at arXiv:1512.08819V1.
  • Qiu, Y. and Chen, S. X. (2012). Test for bandedness of high-dimensional covariance matrices and bandwidth estimation. Ann. Statist. 40 1285–1314.
  • Schott, J. R. (1996). Testing for the equality of several correlation matrices. Statist. Probab. Lett. 27 85–89.
  • Schott, J. R. (2005). Testing for complete independence in high dimensions. Biometrika 92 951–956.
  • Shao, Q.-M. and Zhou, W.-X. (2014). Necessary and sufficient conditions for the asymptotic distributions of coherence of ultra-high dimensional random matrices. Ann. Probab. 42 623–648.
  • Zheng, S., Cheng, G., Guo, J. and Zhu, H. (2019). Supplement to “Test for high-dimensional correlation matrices.” DOI:10.1214/18-AOS1768SUPP.
  • Zheng, S., Chen, Z., Cui, H. and Li, R. (2018). Hypothesis testing on linear structures of high dimensional covariance matrix. Ann. Statist. To appear.
  • Zhou, C., Han, F., Zhang, X. S. and Liu, H. (2015). An Extreme-value approach for testing the equality of large U-statistic based correlation matrices. Available at arXiv:1502.03211.

Supplemental materials

  • Supplement to “Test for high-dimensional correlation matrices”. This supplementary material consists of the technical proofs and additional numerical results.