Electronic Journal of Statistics
- Electron. J. Statist.
- Volume 11, Number 1 (2017), 2547-2612.
Multinomial and empirical likelihood under convex constraints: Directions of recession, Fenchel duality, the PP algorithm
The primal problem of multinomial likelihood maximization restricted to a convex closed subset of the probability simplex is studied. A solution of this problem may assign a positive mass to an outcome with zero count. Such a solution cannot be obtained by the widely used, simplified Lagrange and Fenchel duals. Related flaws in the simplified dual problems, which arise because the recession directions are ignored, are identified and the correct Lagrange and Fenchel duals are developed.
The results permit us to specify linear sets and data such that the empirical likelihood-maximizing distribution exists and is the same as the multinomial likelihood-maximizing distribution. The multinomial likelihood ratio reaches, in general, a different conclusion than the empirical likelihood ratio.
Implications for minimum discrimination information, Lindsay geometry, compositional data analysis, bootstrap with auxiliary information, and Lagrange multiplier test, which explicitly or implicitly ignore information about the support, are discussed.
A solution of the primal problem can be obtained by the PP (perturbed primal) algorithm, that is, as the limit of a sequence of solutions of perturbed primal problems. The PP algorithm may be implemented by the simplified Lagrange or Fenchel dual.
Electron. J. Statist. Volume 11, Number 1 (2017), 2547-2612.
Received: July 2016
First available in Project Euclid: 20 June 2017
Permanent link to this document
Digital Object Identifier
Primary: 62H12: Estimation 62H17: Contingency tables
Secondary: 90C46: Optimality conditions, duality [See also 49N15]
Closed multinomial distribution estimating equation contingency table zero cell frequency El Barmi Dykstra dual Smith dual PP algorithm epi-convergence Fisher likelihood minimum discrimination information
Grendár, Marian; Špitalský, Vladimír. Multinomial and empirical likelihood under convex constraints: Directions of recession, Fenchel duality, the PP algorithm. Electron. J. Statist. 11 (2017), no. 1, 2547--2612. doi:10.1214/17-EJS1294. https://projecteuclid.org/euclid.ejs/1497924056.
- R code and data to reproduce the numerical examples.