Point estimation with exponentially tilted empirical likelihood
Susanne M. Schennach
Source: Ann. Statist. Volume 35, Number 2 (2007), 634-672.
Abstract
Parameters defined via general estimating equations (GEE) can be estimated by maximizing the empirical likelihood (EL). Newey and Smith [Econometrica 72 (2004) 219–255] have recently shown that this EL estimator exhibits desirable higher-order asymptotic properties, namely, that its O(n−1) bias is small and that bias-corrected EL is higher-order efficient. Although EL possesses these properties when the model is correctly specified, this paper shows that, in the presence of model misspecification, EL may cease to be root n convergent when the functions defining the moment conditions are unbounded (even when their expectations are bounded). In contrast, the related exponential tilting (ET) estimator avoids this problem. This paper shows that the ET and EL estimators can be naturally combined to yield an estimator called exponentially tilted empirical likelihood (ETEL) exhibiting the same O(n−1) bias and the same O(n−2) variance as EL, while maintaining root n convergence under model misspecification.
Primary Subjects: 62F10
Secondary Subjects: 62F12
Keywords: Entropy; higher-order asymptotics; misspecified models
Full-text: Access denied (no subscription detected)
We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber.
If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription. Read more about accessing full-text
Links and Identifiers
Permanent link to this document: http://projecteuclid.org/euclid.aos/1183667287
Digital Object Identifier: doi:10.1214/009053606000001208
Mathematical Reviews number (MathSciNet):
MR2336862
References
Akaike, H. (1973). Information theory and an extension of the likelihood principle. In Proc. Second International Symposium on Information Theory (B. N. Petrov and F. Csáki, eds.) 267--281. Akadémiai Kiadó, Budapest.
Mathematical Reviews (MathSciNet):
MR0483125
Zentralblatt MATH:
0283.62006
Angrist, J., Chernozhukov, V. and Fernández-Val, I. (2006). Quantile regression under misspecification, with an application to the U.S. wage structure. Econometrica 74 539--563.
Mathematical Reviews (MathSciNet):
MR2207400
Digital Object Identifier: doi:10.1111/j.1468-0262.2006.00671.x
Back, K. and Brown, D. P. (1993). Implied probabilities in GMM estimators. Econometrica 61 971--975.
Mathematical Reviews (MathSciNet):
MR1231685
Digital Object Identifier: doi:10.2307/2951771
JSTOR: links.jstor.org
Baggerly, K. A. (1998). Empirical likelihood as goodness-of-fit measure. Biometrika 85 535--547.
Mathematical Reviews (MathSciNet):
MR1665869
Zentralblatt MATH:
0918.62043
Digital Object Identifier: doi:10.1093/biomet/85.3.535
JSTOR: links.jstor.org
Bickel, P. J. and Ghosh, J. K. (1990). A decomposition for the likelihood ratio statistic and the Bartlett correction---a Bayesian argument. Ann. Statist. 18 1070--1090.
Mathematical Reviews (MathSciNet):
MR1062699
Digital Object Identifier: doi:10.1214/aos/1176347740
Project Euclid: euclid.aos/1176347740
Bonnal, H. and Renault, E. (2004). On the efficient use of the informational content of estimating equations: Implied probabilities and Euclidean empirical likelihood. Working paper, Univ. de Montréal.
Brown, B. W. and Newey, W. K. (2002). Generalized method of moments, efficient bootstrapping, and improved inference. J. Bus. Econom. Statist. 20 507--517.
Mathematical Reviews (MathSciNet):
MR1945606
JSTOR: links.jstor.org
Chen, X., Hong, H. and Shum, M. (2002). Nonparametric likelihood selection tests for parametric versus moment condition models. Working paper, Johns Hopkins Univ.
Cochrane, J. H. (1996). A cross-sectional test of an investment-based asset pricing model. J. Political Economy 104 572--621.
Corcoran, S. A. (1998). Bartlett adjustment of empirical discrepancy statistics. Biometrika 85 967--972.
Cressie, N. and Read, T. R. C. (1984). Multinomial goodness-of-fit tests. J. Roy. Statist. Soc. Ser. B 46 440--464.
Mathematical Reviews (MathSciNet):
MR0790631
JSTOR: links.jstor.org
Csiszár, I. (1991). Why least squares and maximum entropy? An axiomatic approach to inference for linear inverse problems. Ann. Statist. 19 2032--2066.
Mathematical Reviews (MathSciNet):
MR1135163
Digital Object Identifier: doi:10.1214/aos/1176348385
Project Euclid: euclid.aos/1176348385
Dahlhaus, R. and Wefelmeyer, W. (1996). Asymptotically optimal estimation in misspecified time series models. Ann. Statist. 24 952--974.
Mathematical Reviews (MathSciNet):
MR1401832
Digital Object Identifier: doi:10.1214/aos/1032526951
Project Euclid: euclid.aos/1032526951
DiCiccio, T. J., Hall, P. and Romano, J. P. (1991). Empirical likelihood is Bartlett-correctable. Ann. Statist. 19 1053--1061.
Mathematical Reviews (MathSciNet):
MR1105861
Digital Object Identifier: doi:10.1214/aos/1176348137
Project Euclid: euclid.aos/1176348137
DiCiccio, T. J. and Romano, J. P. (1990). Nonparametric confidence limits by resampling methods and least favorable families. Internat. Statist. Rev. 58 59--76.
Fan, J., Zhang, C. and Zhang, J. (2001). Generalized likelihood ratio statistics and Wilks phenomenon. Ann. Statist. 29 153--193.
Mathematical Reviews (MathSciNet):
MR1833962
Digital Object Identifier: doi:10.1214/aos/996986505
Project Euclid: euclid.aos/996986505
Golan, A., Judge, G. and Miller, D. (1996). Maximum Entropy Econometrics: Robust Estimation with Limited Data. Wiley, New York.
Hall, A. R. and Inoue, A. (2003). The large sample behavior of the generalized method of moments estimator in misspecified models. J. Econometrics 114 361--394.
Mathematical Reviews (MathSciNet):
MR1977725
Digital Object Identifier: doi:10.1016/S0304-4076(03)00089-7
Hall, P. and Horowitz, J. (1996). Bootstrap critical values for tests based on generalized-method-of-moment estimators. Econometrica 64 891--916.
Mathematical Reviews (MathSciNet):
MR1399222
Digital Object Identifier: doi:10.2307/2171849
JSTOR: links.jstor.org
Hampel, F. R. (1974). The influence curve and its role in robust estimation. J. Amer. Statist. Assoc. 69 383--393.
Mathematical Reviews (MathSciNet):
MR0362657
Digital Object Identifier: doi:10.2307/2285666
JSTOR: links.jstor.org
Hansen, L. P. (1982). Large sample properties of generalized method of moments estimators. Econometrica 50 1029--1054.
Mathematical Reviews (MathSciNet):
MR0666123
Digital Object Identifier: doi:10.2307/1912775
JSTOR: links.jstor.org
Hansen, L. P., Heaton, J. and Yaron, A. (1996). Finite-sample properties of some alternative GMM estimators. J. Bus. Econom. Statist. 14 262--280.
Hong, H., Preston, B. and Shum, M. (2003). Generalized empirical likelihood-based model selection criteria for moment condition models. Econometric Theory 19 923--943.
Mathematical Reviews (MathSciNet):
MR2015971
Huber, P. J. (1964). Robust estimation of a location parameter. Ann. Math. Statist. 35 73--101.
Mathematical Reviews (MathSciNet):
MR0161415
Digital Object Identifier: doi:10.1214/aoms/1177703732
Project Euclid: euclid.aoms/1177703732
Huber, P. J. (1967). The behavior of maximum likelihood estimates under nonstandard conditions. Proc. Fifth Berkeley Symposium Math. Statist. Probab. 1 221--233. Univ. California Press, Berkeley.
Mathematical Reviews (MathSciNet):
MR0216620
Zentralblatt MATH:
0212.21504
Imbens, G. W. (1997). One-step estimators for over-identified generalized method of moments models. Rev. Econom. Stud. 64 359--383.
Mathematical Reviews (MathSciNet):
MR1456135
Digital Object Identifier: doi:10.2307/2971718
JSTOR: links.jstor.org
Imbens, G. W. (2002). Generalized method of moments and empirical likelihood. J. Bus. Econom. Statist. 20 493--506.
Mathematical Reviews (MathSciNet):
MR1973800
JSTOR: links.jstor.org
Imbens, G. W. and Spady, R. H. (2001). The performance of empirical likelihood and its generalizations. In Identification and Inference for Econometric Models (D. W. K. Andrews, ed.) 216--244. Cambridge Univ. Press.
Mathematical Reviews (MathSciNet):
MR2234232
Imbens, G. W. and Spady, R. H. (2002). Confidence intervals in generalized method of moments models. J. Econometrics 107 87--98.
Mathematical Reviews (MathSciNet):
MR1889953
Digital Object Identifier: doi:10.1016/S0304-4076(01)00114-2
Imbens, G. W., Spady, R. H. and Johnson, P. (1998). Information-theoretic approaches to inference in moment condition models. Econometrica 66 333--357.
Mathematical Reviews (MathSciNet):
MR1612246
Digital Object Identifier: doi:10.2307/2998561
JSTOR: links.jstor.org
Jing, B.-Y. and Wood, A. T. A. (1996). Exponential empirical likelihood is not Bartlett correctable. Ann. Statist. 24 365--369.
Mathematical Reviews (MathSciNet):
MR1389895
Digital Object Identifier: doi:10.1214/aos/1033066214
Project Euclid: euclid.aos/1033066214
Kitamura, Y. (2000). Comparing misspecified dynamic econometric models using nonparametric likelihood. Working paper, Dept. Economics, Univ. Wisconsin.
Kitamura, Y. (2001). Asymptotic optimality of empirical likelihood for testing moment restrictions. Econometrica 69 1661--1672.
Mathematical Reviews (MathSciNet):
MR1865225
Digital Object Identifier: doi:10.1111/1468-0262.00261
JSTOR: links.jstor.org
Kitamura, Y. (2003). A likelihood-based approach to the analysis of a class of nested and non-nested models. Working paper, Univ. Pennsylvania.
Kitamura, Y. and Stutzer, M. (1997). An information-theoretic alternative to generalized method of moments estimation. Econometrica 65 861--874.
Mathematical Reviews (MathSciNet):
MR1458431
Digital Object Identifier: doi:10.2307/2171942
JSTOR: links.jstor.org
Kitamura, Y. and Stutzer, M. (2002). Connections between entropic and linear projections in asset pricing estimation. J. Econometrics 107 159--174.
Mathematical Reviews (MathSciNet):
MR1889957
Digital Object Identifier: doi:10.1016/S0304-4076(01)00118-X
Kolaczyk, E. D. (1994). Empirical likelihood for generalized linear models. Statist. Sinica 4 199--218.
Mathematical Reviews (MathSciNet):
MR1282871
Kullback, S. (1959). Information Theory and Statistics. Wiley, New York.
Mathematical Reviews (MathSciNet):
MR0103557
Zentralblatt MATH:
0088.10406
Lazar, N. A. and Mykland, P. (1999). Empirical likelihood in the presence of nuisance parameters. Biometrika 86 203--211.
Mathematical Reviews (MathSciNet):
MR1688083
Zentralblatt MATH:
0917.62029
Digital Object Identifier: doi:10.1093/biomet/86.1.203
JSTOR: links.jstor.org
Lee, S. M. S. and Young, G. A. (1999). Nonparametric likelihood ratio confidence intervals. Biometrika 86 107--118.
Mathematical Reviews (MathSciNet):
MR1688075
Digital Object Identifier: doi:10.1093/biomet/86.1.107
JSTOR: links.jstor.org
Maasoumi, E. and Phillips, P. C. B. (1982). On the behavior of inconsistent instrumental variable estimators. J. Econometrics 19 183--201.
Mathematical Reviews (MathSciNet):
MR0672053
Digital Object Identifier: doi:10.1016/0304-4076(82)90001-X
Meghir, C. and Weber, G. (1996). Intertemporal nonseparability or borrowing restrictions? A disaggregate analysis using a U.S. consumption panel. Econometrica 64 1151--1181.
Mittelhammer, R. C., Judge, G. G. and Schoenberg, R. (2005). Empirical evidence concerning the finite sample performance of EL-type structural equation estimation and inference methods. In Identification and Inference for Econometric Models (D. W. K. Andrews and J. H. Stock, eds.) 285--305. Cambridge Univ. Press.
Mathematical Reviews (MathSciNet):
MR2232146
Monfort, A. (1996). A reappraisal of misspecified econometric models. Econometric Theory 12 597--619.
Mathematical Reviews (MathSciNet):
MR1422545
JSTOR: links.jstor.org
Mykland, P. A. (1995). Dual likelihood. Ann. Statist. 23 396--421.
Mathematical Reviews (MathSciNet):
MR1332573
Digital Object Identifier: doi:10.1214/aos/1176324527
Project Euclid: euclid.aos/1176324527
Newey, W. and McFadden, D. (1994). Large sample estimation and hypothesis testing. In Handbook of Econometrics 4 (R. F. Engle and D. L. McFadden, eds.) 2111--2245. North-Holland, Amsterdam.
Mathematical Reviews (MathSciNet):
MR1315971
Newey, W. and Smith, R. J. (2004). Higher-order properties of GMM and generalized empirical likelihood estimators. Econometrica 72 219--255.
Mathematical Reviews (MathSciNet):
MR2031017
Digital Object Identifier: doi:10.1111/j.1468-0262.2004.00482.x
JSTOR: links.jstor.org
Owen, A. B. (1988). Empirical likelihood ratio confidence intervals for a single functional. Biometrika 75 237--249.
Mathematical Reviews (MathSciNet):
MR0946049
Zentralblatt MATH:
0641.62032
Digital Object Identifier: doi:10.1093/biomet/75.2.237
JSTOR: links.jstor.org
Owen, A. B. (1990). Empirical likelihood ratio confidence regions. Ann. Statist. 18 90--120.
Mathematical Reviews (MathSciNet):
MR1041387
Digital Object Identifier: doi:10.1214/aos/1176347494
Project Euclid: euclid.aos/1176347494
Owen, A. B. (2001). Empirical Likelihood. Chapman and Hall/CRC, New York.
Zentralblatt MATH:
0989.62019
Patilea, V. (2001). Convex models, MLE and misspecification. Ann. Statist. 29 94--123.
Mathematical Reviews (MathSciNet):
MR1833960
Digital Object Identifier: doi:10.1214/aos/996986503
Project Euclid: euclid.aos/996986503
Pfanzagl, J. and Wefelmeyer, W. (1978). A third-order optimum property of the maximum likelihood estimator. J. Multivariate Anal. 8 1--29.
Mathematical Reviews (MathSciNet):
MR0489252
Digital Object Identifier: doi:10.1016/0047-259X(78)90016-7
Qin, J. and Lawless, J. (1994). Empirical likelihood and general estimating equations. Ann. Statist. 22 300--325.
Mathematical Reviews (MathSciNet):
MR1272085
Digital Object Identifier: doi:10.1214/aos/1176325370
Project Euclid: euclid.aos/1176325370
Ramalho, J. J. S. and Smith, R. J. (2002). Generalized empirical likelihood non-nested tests. J. Econometrics 107 99--125.
Mathematical Reviews (MathSciNet):
MR1889954
Digital Object Identifier: doi:10.1016/S0304-4076(01)00115-4
Rothenberg, T. J. (1984). Approximating the distribution of econometric estimators and test statistics. In Handbook of Econometrics 2 (Z. Griliches and M. D. Intriligator, eds.) 881--933. North-Holland, Amsterdam.
Sawa, T. (1978). Information criteria for discriminating among alternative regression models. Econometrica 46 1273--1291.
Mathematical Reviews (MathSciNet):
MR0513693
Digital Object Identifier: doi:10.2307/1913828
JSTOR: links.jstor.org
Schennach, S. M. (2005). Accompanying document to ``Point estimation using exponentially tilted empirical likelihood.'' Technical report, Univ. Chicago. Available at arxiv.org/abs/math/0512181.
Mathematical Reviews (MathSciNet):
MR2158608
Zentralblatt MATH:
1068.62035
Digital Object Identifier: doi:10.1093/biomet/92.1.31
Schennach, S. M. (2005). Bayesian exponentially tilted empirical likelihood. Biometrika 92 31--46.
Mathematical Reviews (MathSciNet):
MR2158608
Zentralblatt MATH:
1068.62035
Digital Object Identifier: doi:10.1093/biomet/92.1.31
Schennach, S. M. and Spady, R. H. (2003). Higher-order properties of GEL/EL estimators. Working paper, Univ. Chicago. Available at home.uchicago.edu/~smschenn/gelel01.pdf.
Shore, J. and Johnson, R. (1980). Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy. IEEE Trans. Inform. Theory 26 26--37.
Mathematical Reviews (MathSciNet):
MR0560389
Digital Object Identifier: doi:10.1109/TIT.1980.1056144
Smith, R. J. (1997). Alternative semi-parametric likelihood approaches to generalized method of moments estimation. Economic J. 107 503--519.
Spady, R. H. (1996). Nonparametric inference by quasi-likelihood methods. Working paper, Nuffield College.
Vuong, Q. H. (1989). Likelihood ratio tests for model selection and non-nested hypotheses. Econometrica 57 307--333.
Mathematical Reviews (MathSciNet):
MR0996939
Digital Object Identifier: doi:10.2307/1912557
JSTOR: links.jstor.org
White, H. (1982). Maximum likelihood estimation of misspecified models. Econometrica 50 1--25.
Mathematical Reviews (MathSciNet):
MR0640163
Digital Object Identifier: doi:10.2307/1912526
JSTOR: links.jstor.org
The Annals of Statistics
