Open Access
February 2011 1-penalized quantile regression in high-dimensional sparse models
Alexandre Belloni, Victor Chernozhukov
Ann. Statist. 39(1): 82-130 (February 2011). DOI: 10.1214/10-AOS827


We consider median regression and, more generally, a possibly infinite collection of quantile regressions in high-dimensional sparse models. In these models, the number of regressors p is very large, possibly larger than the sample size n, but only at most s regressors have a nonzero impact on each conditional quantile of the response variable, where s grows more slowly than n. Since ordinary quantile regression is not consistent in this case, we consider 1-penalized quantile regression (1-QR), which penalizes the 1-norm of regression coefficients, as well as the post-penalized QR estimator (post-1-QR), which applies ordinary QR to the model selected by 1-QR. First, we show that under general conditions 1-QR is consistent at the near-oracle rate $\sqrt{s/n}\sqrt{\log(p\vee n)}$, uniformly in the compact set $\mathcal{U}\subset(0,1)$ of quantile indices. In deriving this result, we propose a partly pivotal, data-driven choice of the penalty level and show that it satisfies the requirements for achieving this rate. Second, we show that under similar conditions post-1-QR is consistent at the near-oracle rate $\sqrt{s/n}\sqrt{\log(p\vee n)}$, uniformly over $\mathcal{U}$, even if the 1-QR-selected models miss some components of the true models, and the rate could be even closer to the oracle rate otherwise. Third, we characterize conditions under which 1-QR contains the true model as a submodel, and derive bounds on the dimension of the selected model, uniformly over $\mathcal{U}$; we also provide conditions under which hard-thresholding selects the minimal true model, uniformly over $\mathcal{U}$.


Download Citation

Alexandre Belloni. Victor Chernozhukov. "1-penalized quantile regression in high-dimensional sparse models." Ann. Statist. 39 (1) 82 - 130, February 2011.


Published: February 2011
First available in Project Euclid: 3 December 2010

zbMATH: 1209.62064
MathSciNet: MR2797841
Digital Object Identifier: 10.1214/10-AOS827

Primary: 62H12 , 62J99
Secondary: 62J07

Keywords: median regression , Quantile regression , sparse models

Rights: Copyright © 2011 Institute of Mathematical Statistics

Vol.39 • No. 1 • February 2011
Back to Top