The Annals of Statistics
- Ann. Statist.
- Volume 44, Number 6 (2016), 2661-2694.
High-dimensional generalizations of asymmetric least squares regression and their applications
Asymmetric least squares regression is an important method that has wide applications in statistics, econometrics and finance. The existing work on asymmetric least squares only considers the traditional low dimension and large sample setting. In this paper, we systematically study the Sparse Asymmetric LEast Squares (SALES) regression under high dimensions where the penalty functions include the Lasso and nonconvex penalties. We develop a unified efficient algorithm for fitting SALES and establish its theoretical properties. As an important application, SALES is used to detect heteroscedasticity in high-dimensional data. Another method for detecting heteroscedasticity is the sparse quantile regression. However, both SALES and the sparse quantile regression may fail to tell which variables are important for the conditional mean and which variables are important for the conditional scale/variance, especially when there are variables that are important for both the mean and the scale. To that end, we further propose a COupled Sparse Asymmetric LEast Squares (COSALES) regression which can be efficiently solved by an algorithm similar to that for solving SALES. We establish theoretical properties of COSALES. In particular, COSALES using the SCAD penalty or MCP is shown to consistently identify the two important subsets for the mean and scale simultaneously, even when the two subsets overlap. We demonstrate the empirical performance of SALES and COSALES by simulated and real data.
Ann. Statist. Volume 44, Number 6 (2016), 2661-2694.
Received: June 2015
Revised: November 2015
First available in Project Euclid: 23 November 2016
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Primary: 62J07: Ridge regression; shrinkage estimators
Gu, Yuwen; Zou, Hui. High-dimensional generalizations of asymmetric least squares regression and their applications. Ann. Statist. 44 (2016), no. 6, 2661--2694. doi:10.1214/15-AOS1431. https://projecteuclid.org/euclid.aos/1479891631
- Supplement to “High-dimensional generalizations of asymmetric least squares regression and their applications”. The supplementary material includes the iteration complexity analysis of the SALES algorithm.