The Annals of Statistics

Corrections to LRT on large-dimensional covariance matrix by RMT

Zhidong Bai, Dandan Jiang, Jian-Feng Yao, and Shurong Zheng

Source: Ann. Statist. Volume 37, Number 6B (2009), 3822-3840.

Abstract

In this paper, we give an explanation to the failure of two likelihood ratio procedures for testing about covariance matrices from Gaussian populations when the dimension p is large compared to the sample size n. Next, using recent central limit theorems for linear spectral statistics of sample covariance matrices and of random F-matrices, we propose necessary corrections for these LR tests to cope with high-dimensional effects. The asymptotic distributions of these corrected tests under the null are given. Simulations demonstrate that the corrected LR tests yield a realized size close to nominal level for both moderate p (around 20) and high dimension, while the traditional LR tests with χ2 approximation fails.

Another contribution from the paper is that for testing the equality between two covariance matrices, the proposed correction applies equally for non-Gaussian populations yielding a valid pseudo-likelihood ratio test.

Primary Subjects: 62H15
Secondary Subjects: 62H10
Keywords: High-dimensional data; testing on covariance matrices; Marčenko–Pastur distributions; random F-matrices

Full-text: Access denied (no subscription detected)

We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber.
If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription. Read more about accessing full-text
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aos/1256303528
Digital Object Identifier: doi:10.1214/09-AOS694

References

[1] Bai, Z. D. and Saranadasa, H. (1996). Effect of high dimension comparison of significance tests for a high-dimensional two sample problem. Statist. Sinica 6 311–329.
Mathematical Reviews (MathSciNet): MR1399305
Zentralblatt MATH: 0848.62030
[2] Bai, Z. D., Jiang, D., Yao, J.-F. and Zheng, S. (2008). Corrections to LRT on large dimensional covariance matrix by RMT (full version). Preprint. Available at arXiv:0902.0552.
[3] Bai, Z. D. and Silverstein, J. W. (2004). CLT for linear spectral statistics of large-dimensional sample covariance matrices. Ann. Probab. 32 553–605.
Mathematical Reviews (MathSciNet): MR2040792
Zentralblatt MATH: 1063.60022
Digital Object Identifier: doi:10.1214/aop/1078415845
Project Euclid: euclid.aop/1078415845
[4] Bai, Z. D. and Silverstein, J. W. (2006). Spectral Analysis of Large-Dimensional Random Matrices, 1st ed. Science Press, Beijing.
[5] Dempster, A. P. (1958). A high-dimensional two sample significance test. Ann. Math. Statist. 29 995–1010.
Mathematical Reviews (MathSciNet): MR112207
Digital Object Identifier: doi:10.1214/aoms/1177706437
Project Euclid: euclid.aoms/1177706437
[6] Ledoit, O. and Wolf, M. (2002). Some hypothesis tests for the covariance matrix when the dimension is large compared to the sample size. Ann. Statist. 30 1081–1102.
Mathematical Reviews (MathSciNet): MR1926169
Zentralblatt MATH: 1029.62049
Digital Object Identifier: doi:10.1214/aos/1031689018
Project Euclid: euclid.aos/1031689018
[7] Pastur, L. and Lytova, A. (2008). Central limit theorem for linear eigenvalue statistics of random matrices with independent entries. Preprint. Available at arXiv:0809.4698v1.
Mathematical Reviews (MathSciNet): MR2461187
Zentralblatt MATH: 1161.82010
Digital Object Identifier: doi:10.1007/s10955-008-9644-6
[8] Schott, J. R. (2007). A test for the equality of covariance matrices when the dimension is large relative to the sample size. Comput. Statist. Data Anal. 51 6535–6542.
Mathematical Reviews (MathSciNet): MR2408613
[9] Srivastava, M. S. (2005). Some tests concerning the covariance matrix in high-dimensional data. J. Japan Statist. Soc. 35 251–272.
Mathematical Reviews (MathSciNet): MR2328427
[10] Zheng, S. (2008). Central limit theorem for linear spectral statistics of large dimensional F-matrix. Preprint. Northeast Normal Univ., Changchun, China.

2009 © Institute of Mathematical Statistics