The Annals of Statistics
- Ann. Statist.
- Volume 38, Number 5 (2010), 2751-2780.
On universal oracle inequalities related to high-dimensional linear models
This paper deals with recovering an unknown vector θ from the noisy data Y = Aθ + σξ, where A is a known (m × n)-matrix and ξ is a white Gaussian noise. It is assumed that n is large and A may be severely ill-posed. Therefore, in order to estimate θ, a spectral regularization method is used, and our goal is to choose its regularization parameter with the help of the data Y. For spectral regularization methods related to the so-called ordered smoothers [see Kneip Ann. Statist. 22 (1994) 835–866], we propose new penalties in the principle of empirical risk minimization. The heuristical idea behind these penalties is related to balancing excess risks. Based on this approach, we derive a sharp oracle inequality controlling the mean square risks of data-driven spectral regularization methods.
Ann. Statist., Volume 38, Number 5 (2010), 2751-2780.
First available in Project Euclid: 20 July 2010
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Golubev, Yuri. On universal oracle inequalities related to high-dimensional linear models. Ann. Statist. 38 (2010), no. 5, 2751--2780. doi:10.1214/10-AOS803. https://projecteuclid.org/euclid.aos/1279638539