## Electronic Journal of Statistics

- Electron. J. Statist.
- Volume 8, Number 1 (2014), 432-455.

### Sparse model selection under heterogeneous noise: Exact penalisation and data-driven thresholding

Laurent Cavalier and Markus Reiß

#### Abstract

We consider a Gaussian sequence space model $X_{\lambda}=f_{\lambda}+\xi_{\lambda},$ where the noise variables $(\xi_{\lambda})_{\lambda}$ are independent, but with heterogeneous variances $(\sigma_{\lambda}^{2})_{\lambda}$. Our goal is to estimate the unknown signal vector $(f_{\lambda})$ by a model selection approach. We focus on the situation where the non-zero entries $f_{\lambda}$ are sparse. Then the heterogenous case is much more involved than the homogeneous model where $\sigma_{\lambda}^{2}=\sigma^{2}$ is constant. Indeed, we can no longer profit from symmetry inside the stochastic process that one needs to control. The problem and the penalty do not only depend on the number of coefficients that one selects, but also on their position. This appears also in the minimax bounds where the worst coefficients will go to the larger variances. With a careful and explicit choice of the penalty, however, we are able to select the correct coefficients and get a sharp non-asymptotic control of the risk of our procedure. Some finite sample results from simulations are provided.

#### Article information

**Source**

Electron. J. Statist., Volume 8, Number 1 (2014), 432-455.

**Dates**

First available in Project Euclid: 18 April 2014

**Permanent link to this document**

https://projecteuclid.org/euclid.ejs/1397826707

**Digital Object Identifier**

doi:10.1214/14-EJS889

**Mathematical Reviews number (MathSciNet)**

MR3195122

**Zentralblatt MATH identifier**

1294.62058

**Subjects**

Primary: 62G05: Estimation

Secondary: 62J05: Linear regression

**Keywords**

Sparse oracle inequality optimal threshold statistical inverse problem risk hull penalized empirical risk full subset selection heteroskedastic noise

#### Citation

Cavalier, Laurent; Reiß, Markus. Sparse model selection under heterogeneous noise: Exact penalisation and data-driven thresholding. Electron. J. Statist. 8 (2014), no. 1, 432--455. doi:10.1214/14-EJS889. https://projecteuclid.org/euclid.ejs/1397826707