Translator Disclaimer
June 2021 Adaptive robust estimation in sparse vector model
L. Comminges, O. Collier, M. Ndaoud, A. B. Tsybakov
Author Affiliations +
Ann. Statist. 49(3): 1347-1377 (June 2021). DOI: 10.1214/20-AOS2002

Abstract

For the sparse vector model, we consider estimation of the target vector, of its 2-norm and of the noise variance. We construct adaptive estimators and establish the optimal rates of adaptive estimation when adaptation is considered with respect to the triplet “noise level—noise distribution—sparsity.” We consider classes of noise distributions with polynomially and exponentially decreasing tails as well as the case of Gaussian noise. The obtained rates turn out to be different from the minimax nonadaptive rates when the triplet is known. A crucial issue is the ignorance of the noise variance. Moreover, knowing or not knowing the noise distribution can also influence the rate. For example, the rates of estimation of the noise variance can differ depending on whether the noise is Gaussian or sub-Gaussian without a precise knowledge of the distribution. Estimation of noise variance in our setting can be viewed as an adaptive variant of robust estimation of scale in the contamination model, where instead of fixing the “nominal” distribution in advance we assume that it belongs to some class of distributions.

Funding Statement

The work of O. Collier has been conducted as part of the project Labex MME-DII (ANR11-LBX-0023-01). The work of M. Ndaoud and A. B. Tsybakov was supported by GENES and by the French National Research Agency (ANR) under the grants IPANEMA (ANR-13-BSH1-0004-02) and Labex Ecodec (ANR-11-LABEX-0047).

Citation

Download Citation

L. Comminges. O. Collier. M. Ndaoud. A. B. Tsybakov. "Adaptive robust estimation in sparse vector model." Ann. Statist. 49 (3) 1347 - 1377, June 2021. https://doi.org/10.1214/20-AOS2002

Information

Received: 1 April 2019; Revised: 1 March 2020; Published: June 2021
First available in Project Euclid: 9 August 2021

Digital Object Identifier: 10.1214/20-AOS2002

Subjects:
Primary: 62G05 , 62J05

Keywords: adaptive estimation , Functional estimation , Minimax rate , robust estimation , Sparse vector model , variance estimation

Rights: Copyright © 2021 Institute of Mathematical Statistics

JOURNAL ARTICLE
31 PAGES

This article is only available to subscribers.
It is not available for individual sale.
+ SAVE TO MY LIBRARY

SHARE
Vol.49 • No. 3 • June 2021
Back to Top