Open Access
Translator Disclaimer
2009 Exponential bounds for minimum contrast estimators
Yuri Golubev, Vladimir Spokoiny
Electron. J. Statist. 3: 712-746 (2009). DOI: 10.1214/09-EJS352

Abstract

The paper focuses on general properties of parametric minimum contrast estimators. The quality of estimation is measured in terms of the rate function related to the contrast, thus allowing to derive exponential risk bounds invariant with respect to the detailed probabilistic structure of the model. This approach works well for small or moderate samples and covers the case of a misspecified parametric model. Another important feature of the presented bounds is that they may be used in the case when the parametric set is not compact. These bounds do not rely on the entropy or covering numbers and can be easily computed. The most important statistical fact resulting from the exponential bonds is a concentration inequality which claims that minimum contrast estimators concentrate with a large probability on the level set of the rate function. In typical situations, every such set is a root-n neighborhood of the parameter of interest. We also show that the obtained bounds can help for bounding the estimation risk and constructing confidence sets for the underlying parameters. Our general results are illustrated for the case of an i.i.d. sample. We also consider several popular examples including least absolute deviation estimation and the problem of estimating the location of a change point. What we obtain in these examples slightly differs from the usual asymptotic results presented in statistical literature. This difference is due to the unboundness of the parameter set and a possible model misspecification.

Citation

Download Citation

Yuri Golubev. Vladimir Spokoiny. "Exponential bounds for minimum contrast estimators." Electron. J. Statist. 3 712 - 746, 2009. https://doi.org/10.1214/09-EJS352

Information

Published: 2009
First available in Project Euclid: 11 August 2009

zbMATH: 1326.62050
MathSciNet: MR2534199
Digital Object Identifier: 10.1214/09-EJS352

Subjects:
Primary: 62F10
Secondary: 62F25 , 62J12

Keywords: Exponential risk bounds , quasi maximum likelihood , Rate function , smooth contrast

Rights: Copyright © 2009 The Institute of Mathematical Statistics and the Bernoulli Society

JOURNAL ARTICLE
35 PAGES


SHARE
Back to Top