The Annals of Statistics
- Ann. Statist.
- Volume 44, Number 6 (2016), 2594-2623.
On marginal sliced inverse regression for ultrahigh dimensional model-free feature selection
Model-free variable selection has been implemented under the sufficient dimension reduction framework since the seminal paper of Cook [Ann. Statist. 32 (2004) 1062–1092]. In this paper, we extend the marginal coordinate test for sliced inverse regression (SIR) in Cook (2004) and propose a novel marginal SIR utility for the purpose of ultrahigh dimensional feature selection. Two distinct procedures, Dantzig selector and sparse precision matrix estimation, are incorporated to get two versions of sample level marginal SIR utilities. Both procedures lead to model-free variable selection consistency with predictor dimensionality $p$ diverging at an exponential rate of the sample size $n$. As a special case of marginal SIR, we ignore the correlation among the predictors and propose marginal independence SIR. Marginal independence SIR is closely related to many existing independence screening procedures in the literature, and achieves model-free screening consistency in the ultrahigh dimensional setting. The finite sample performances of the proposed procedures are studied through synthetic examples and an application to the small round blue cell tumors data.
Ann. Statist., Volume 44, Number 6 (2016), 2594-2623.
Received: May 2015
Revised: December 2015
First available in Project Euclid: 23 November 2016
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Yu, Zhou; Dong, Yuexiao; Shao, Jun. On marginal sliced inverse regression for ultrahigh dimensional model-free feature selection. Ann. Statist. 44 (2016), no. 6, 2594--2623. doi:10.1214/15-AOS1424. https://projecteuclid.org/euclid.aos/1479891629