The Annals of Statistics
- Ann. Statist.
- Volume 44, Number 6 (2016), 2467-2496.
Consistent model selection criteria for quadratically supported risks
In this paper, we study asymptotic properties of model selection criteria for high-dimensional regression models where the number of covariates is much larger than the sample size. In particular, we consider a class of loss functions called the class of quadratically supported risks which is large enough to include the quadratic loss, Huber loss, quantile loss and logistic loss. We provide sufficient conditions for the model selection criteria, which are applicable to the class of quadratically supported risks. Our results extend most previous sufficient conditions for model selection consistency. In addition, sufficient conditions for pathconsistency of the Lasso and nonconvex penalized estimators are presented. Here, pathconsistency means that the probability of the solution path that includes the true model converges to 1. Pathconsistency makes it practically feasible to apply consistent model selection criteria to high-dimensional data. The data-adaptive model selection procedure is proposed which is selection consistent and performs well for finite samples. Results of simulation studies as well as real data analysis are presented to compare the finite sample performances of the proposed data-adaptive model selection criterion with other competitors.
Ann. Statist., Volume 44, Number 6 (2016), 2467-2496.
Received: April 2015
Revised: November 2015
First available in Project Euclid: 23 November 2016
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Kim, Yongdai; Jeon, Jong-June. Consistent model selection criteria for quadratically supported risks. Ann. Statist. 44 (2016), no. 6, 2467--2496. doi:10.1214/15-AOS1413. https://projecteuclid.org/euclid.aos/1479891625