Electronic Journal of Statistics

Empty set problem of maximum empirical likelihood methods

Marian Grendár and George Judge

Full-text: Open access


In an influential work, Qin and Lawless (1994) proposed a general estimating equations (GEE) formulation for maximum empirical likelihood (MEL) estimation and inference. The formulation replaces a model specified by GEE with a set of data-supported probability mass functions that satisfy empirical estimating equations (E3). In this paper we use several examples from the literature to demonstrate that the set may be empty for some E3 models and finite data samples. As a result, MEL does not exist for such models and data sets. If MEL and other E3-based methods are to be used, then models will have to be checked on case-by-case basis for the absence or presence of the empty set problem.

Article information

Electron. J. Statist. Volume 3 (2009), 1542-1555.

First available in Project Euclid: 4 January 2010

Permanent link to this document

Digital Object Identifier

Mathematical Reviews number (MathSciNet)

Zentralblatt MATH identifier

Primary: 62F10: Point estimation

empirical estimating equations generalized minimum contrast empirical likelihood euclidean empirical likelihood generalized empirical likelihood affine empty set problem empirical likelihood bootstrap model selection


Grendár, Marian; Judge, George. Empty set problem of maximum empirical likelihood methods. Electron. J. Statist. 3 (2009), 1542--1555. doi:10.1214/09-EJS528. http://projecteuclid.org/euclid.ejs/1262617418.

Export citation


  • Back, K., and Brown, D. (1990). Estimating distributions from moment restrictions. Working paper, Graduate School of Business, Indiana, University.
  • Bickel, P.J., Klaassen, C.A.J., Ritov, Y., and Wellner, J.A. (1993)., Efficient and Adaptive Estimation for Semiparametric Models. Baltimore: Johns Hopkins University Press.
  • Brown, B.M., and Chen, S.X. (1998). Combined and Least Squares Empirical Likelihood., Ann. Inst. Statist. Math. 90:443-450.
  • Chen, J., Variyath, A.M., and Abraham, B. (2008). Adjusted Empirical Likelihood and its properties., J. Comput. Graph. Statist. 17/2:426-443.
  • Chen, S.X. and Van Keilegom, I. (2009). A review on empirical likelihood methods for regression (with discussion and rejoinder by the authors)., Test. 18/3. November, 2009. DOI: 10.1007/s11749-009-0159-5
  • Cheng, J., Small, D.S., Tan, Z., Ten Have T.R. (2009). Efficient nonparametric estimation of causal effects in randomized trials with noncompliance., Biometrika. 96/1:19-36.
  • Corcoran, S.A. (1998). Bartlett adjustment of empirical discrepancy statistics., Biometrika. 85:967-972.
  • Corcoran, S.A. (2000). Empirical exponential family likelihood using several moment conditions., Stat. Sinica. 10:545-557.
  • Crépet, A., Harari-Kermadec, H., and Tressou, J. (2009). Using Empirical Likelihood to combine data: application to food risk assessment., Biometrics. 65:257-266.
  • Cressie, N., and Read, T. (1984). Multinomial goodness of fit tests., J. Roy. Statist. Soc. Ser. B. 46:440-464.
  • Devereux, P.J. and Tripathi, G. (2009). Optimally combined censored and uncensored datasets., J. Econometrics. 151:17-32.
  • Emerson, S.C. and Owen, A.B. (2009). Calibration of the empirical likelihood method for a vector mean., Electron. J. Statist. 3:1161-1192.
  • Godambe, V.P., and Kale, B.K. (1991). Estimating functions: an overview. In, Estimating Functions, V.P. Godambe (ed.), Oxford University Press, Oxford, UK, pp. 3-20.
  • Grendár, M., and Judge, G. (2009). Asymptotic equivalence of Empirical Likelihood and Bayesian MAP., Ann. Statist. 37/5A:2445-2457.
  • Grendár, M., and Judge, G. (2009). Maximum Empirical Likelihood: Empty Set Problem. UC Berkeley: CUDARE Working Paper No. 1090. Retrieved from:, http://escholarship.org/uc/item/71v338mh
  • Gzyl, H., and Ter Horst, E. (2009). Recovering decay rates from noisy measurements with Maximum Entropy in the Mean., J. Prob. Stat. Article ID 563281, 13 pages, doi:10.1155/2009/563281.
  • Haberman, S. (1984). Adjustment by Minimum Discriminant Information., Ann. Statist. 12/3:971-988.
  • Hjort, N.L., Mckeague, I.W., and van Keilegom, I. (2009). Extending the scope of Empirical Likelihood., Ann. Statist. 37/3:1079-1111.
  • Hong, H., Preston, B., and Shum, M. (2003). Generalized Empirical Likelihood-based model selection criteria for moment conditions models., Econometric Theory. 19:923-943.
  • Imbens, G.W., Spady, R.H., and Johnson, P. (1998). Information theoretic approaches to inference in moment condition models., Econometrica. 66/2:333-357.
  • Kitamura, Y., and Stutzer, M. (1997). An information-theoretic alternative to Generalized Method of Moments estimation., Econometrica. 65:861-874.
  • Kitamura, Y. (2007). Nonparametric Likelihood: efficiency and robustness., Jap. Econ. Rev. 58/1:26-45.
  • Liu, Y. and Chen, J. (2009). Adjusted empirical likelihood with high-order precision., Ann. Statist. (to appear).
  • Mittelhammer, R., Judge, G. and Miller, D. (2000)., Econometric Foundations. Cambridge:Cambridge University Press.
  • Owen, A.B. (2001)., Empirical Likelihood. New York:Chapman-Hall/CRC.
  • Qin, J., and Lawless, J. (1994). Empirical Likelihood and General Estimating Equations., Ann. Statist. 22:300-325.
  • Rockafellar. R.T. (1970)., Convex Analysis. New Jersey: Princeton University Press.
  • Schennach, S.M. (2005). Bayesian exponentially tilted empirical likelihood., Biometrika. 92/1:31-46.
  • Smith, R.J. (1997). Alternative semi-parametric likelihood approaches to Generalized Method of Moments estimation., Economic J. 107:503-519.
  • Zhou, H., Zhou, H., Chen, J., Li, Y., Lieberman, J., Styner, M. (2009). Adjusted Exponentially Tilted Likelihood with applications to brain morphology., Biometrics. 65:919-927.
  • Wang, D. and Chen, S.X. (2009). Combining quantitative trait loci analyses and microarray data: an empirical likelihood approach., Comp. Stat. Data Anal. 53:1661-1673.
  • Wong, H., Liu, F., Chen, M., Ip, W.Ch. (2009). Empirical Likelihood based diagnostics for heteroscedasticity in partial linear models., Comp. Stat. Data Anal. 53:3466-3477.