Electronic Journal of Statistics
- Electron. J. Statist.
- Volume 12, Number 1 (2018), 1126-1149.
A strong converse bound for multiple hypothesis testing, with applications to high-dimensional estimation
In statistical inference problems, we wish to obtain lower bounds on the minimax risk, that is to bound the performance of any possible estimator. A standard technique to do this involves the use of Fano’s inequality. However, recent work in an information-theoretic setting has shown that an argument based on binary hypothesis testing gives tighter converse results (error lower bounds) than Fano for channel coding problems. We adapt this technique to the statistical setting, and argue that Fano’s inequality can always be replaced by this approach to obtain tighter lower bounds that can be easily computed and are asymptotically sharp. We illustrate our technique in three applications: density estimation, active learning of a binary classifier, and compressed sensing, obtaining tighter risk lower bounds in each case.
Electron. J. Statist., Volume 12, Number 1 (2018), 1126-1149.
Received: June 2017
First available in Project Euclid: 27 March 2018
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Venkataramanan, Ramji; Johnson, Oliver. A strong converse bound for multiple hypothesis testing, with applications to high-dimensional estimation. Electron. J. Statist. 12 (2018), no. 1, 1126--1149. doi:10.1214/18-EJS1419. https://projecteuclid.org/euclid.ejs/1522116041