Open Access
2017 Test of independence for high-dimensional random vectors based on freeness in block correlation matrices
Zhigang Bao, Jiang Hu, Guangming Pan, Wang Zhou
Electron. J. Statist. 11(1): 1527-1548 (2017). DOI: 10.1214/17-EJS1259

Abstract

In this paper, we are concerned with the independence test for $k$ high-dimensional sub-vectors of a normal vector, with fixed positive integer $k$. A natural high-dimensional extension of the classical sample correlation matrix, namely block correlation matrix, is proposed for this purpose. We then construct the so-called Schott type statistic as our test statistic, which turns out to be a particular linear spectral statistic of the block correlation matrix. Interestingly, the limiting behavior of the Schott type statistic can be figured out with the aid of the Free Probability Theory and the Random Matrix Theory. Specifically, we will bring the so-called real second order freeness for Haar distributed orthogonal matrices, derived in Mingo and Popa (2013)[10], into the framework of this high-dimensional testing problem. Our test does not require the sample size to be larger than the total or any partial sum of the dimensions of the $k$ sub-vectors. Simulated results show the effect of the Schott type statistic, in contrast to those statistics proposed in Jiang and Yang (2013)[8] and Jiang, Bai and Zheng (2013)[7], is satisfactory. Real data analysis is also used to illustrate our method.

Citation

Download Citation

Zhigang Bao. Jiang Hu. Guangming Pan. Wang Zhou. "Test of independence for high-dimensional random vectors based on freeness in block correlation matrices." Electron. J. Statist. 11 (1) 1527 - 1548, 2017. https://doi.org/10.1214/17-EJS1259

Information

Received: 1 September 2016; Published: 2017
First available in Project Euclid: 19 April 2017

zbMATH: 1362.62123
MathSciNet: MR3635921
Digital Object Identifier: 10.1214/17-EJS1259

Subjects:
Primary: 62H15
Secondary: 46L54

Keywords: Block correlation matrix , central limit theorem , haar distributed orthogonal matrices , high dimensional data , Independence test , random matrices , Schott type statistic , second order freeness

Vol.11 • No. 1 • 2017
Back to Top