Annals of Statistics
- Ann. Statist.
- Volume 46, Number 5 (2018), 1904-1931.
A new perspective on robust $M$-estimation: Finite sample theory and applications to dependence-adjusted multiple testing
Wen-Xin Zhou, Koushiki Bose, Jianqing Fan, and Han Liu
Abstract
Heavy-tailed errors impair the accuracy of the least squares estimate, which can be spoiled by a single grossly outlying observation. As argued in the seminal work of Peter Huber in 1973 [Ann. Statist. 1 (1973) 799–821], robust alternatives to the method of least squares are sorely needed. To achieve robustness against heavy-tailed sampling distributions, we revisit the Huber estimator from a new perspective by letting the tuning parameter involved diverge with the sample size. In this paper, we develop nonasymptotic concentration results for such an adaptive Huber estimator, namely, the Huber estimator with the tuning parameter adapted to sample size, dimension and the variance of the noise. Specifically, we obtain a sub-Gaussian-type deviation inequality and a nonasymptotic Bahadur representation when noise variables only have finite second moments. The nonasymptotic results further yield two conventional normal approximation results that are of independent interest, the Berry–Esseen inequality and Cramér-type moderate deviation. As an important application to large-scale simultaneous inference, we apply these robust normal approximation results to analyze a dependence-adjusted multiple testing procedure for moderately heavy-tailed data. It is shown that the robust dependence-adjusted procedure asymptotically controls the overall false discovery proportion at the nominal level under mild moment conditions. Thorough numerical results on both simulated and real datasets are also provided to back up our theory.
Article information
Source
Ann. Statist., Volume 46, Number 5 (2018), 1904-1931.
Dates
Received: June 2016
Revised: April 2017
First available in Project Euclid: 17 August 2018
Permanent link to this document
https://projecteuclid.org/euclid.aos/1534492823
Digital Object Identifier
doi:10.1214/17-AOS1606
Mathematical Reviews number (MathSciNet)
MR3845005
Zentralblatt MATH identifier
06964320
Subjects
Primary: 62F03: Hypothesis testing 62F35: Robustness and adaptive procedures
Secondary: 62J05: Linear regression 62E17: Approximations to distributions (nonasymptotic)
Keywords
Approximate factor model Bahadur representation false discovery proportion heavy-tailed data Huber loss large-scale multiple testing $M$-estimator
Citation
Zhou, Wen-Xin; Bose, Koushiki; Fan, Jianqing; Liu, Han. A new perspective on robust $M$-estimation: Finite sample theory and applications to dependence-adjusted multiple testing. Ann. Statist. 46 (2018), no. 5, 1904--1931. doi:10.1214/17-AOS1606. https://projecteuclid.org/euclid.aos/1534492823
Supplemental materials
- Supplement to “A new perspective on robust $M$-estimation: Finite sample theory and applications to dependence-adjusted multiple testing”. This supplemental material contains the proofs for the theoretical results in the main text and additional simulation results.Digital Object Identifier: doi:10.1214/17-AOS1606SUPPSupplemental files are immediately available to subscribers. Non-subscribers gain access to supplemental files with the purchase of the article.