Open Access
2010 Detection boundary in sparse regression
Yuri I. Ingster, Alexandre B. Tsybakov, Nicolas Verzelen
Electron. J. Statist. 4: 1476-1526 (2010). DOI: 10.1214/10-EJS589


We study the problem of detection of a p-dimensional sparse vector of parameters in the linear regression model with Gaussian noise. We establish the detection boundary, i.e., the necessary and sufficient conditions for the possibility of successful detection as both the sample size n and the dimension p tend to infinity. Testing procedures that achieve this boundary are also exhibited. Our results encompass the high-dimensional setting (pn). The main message is that, under some conditions, the detection boundary phenomenon that has been previously established for the Gaussian sequence model, extends to high-dimensional linear regression. Finally, we establish the detection boundaries when the variance of the noise is unknown. Interestingly, the rate of the detection boundary in high-dimensional setting with unknown variance can be different from the rate for the case of known variance.


Download Citation

Yuri I. Ingster. Alexandre B. Tsybakov. Nicolas Verzelen. "Detection boundary in sparse regression." Electron. J. Statist. 4 1476 - 1526, 2010.


Published: 2010
First available in Project Euclid: 22 December 2010

zbMATH: 1329.62314
MathSciNet: MR2747131
Digital Object Identifier: 10.1214/10-EJS589

Primary: 62J05
Secondary: 62C20 , 62G05 , 62G08 , 62G10 , 62G20 , 62H20

Keywords: Detection boundary , high-dimensional regression , minimax hypothesis testing , sparse vectors , Sparsity

Rights: Copyright © 2010 The Institute of Mathematical Statistics and the Bernoulli Society

Back to Top