The Annals of Statistics

Approximating faces of marginal polytopes in discrete hierarchical models

Abstract

The existence of the maximum likelihood estimate in a hierarchical log-linear model is crucial to the reliability of inference for this model. Determining whether the estimate exists is equivalent to finding whether the sufficient statistics vector $t$ belongs to the boundary of the marginal polytope of the model. The dimension of the smallest face $\mathbf{F}_{t}$ containing $t$ determines the dimension of the reduced model which should be considered for correct inference. For higher-dimensional problems, it is not possible to compute $\mathbf{F}_{t}$ exactly. Massam and Wang (2015) found an outer approximation to $\mathbf{F}_{t}$ using a collection of submodels of the original model. This paper refines the methodology to find an outer approximation and devises a new methodology to find an inner approximation. The inner approximation is given not in terms of a face of the marginal polytope, but in terms of a subset of the vertices of $\mathbf{F}_{t}$.

Knowing $\mathbf{F}_{t}$ exactly indicates which cell probabilities have maximum likelihood estimates equal to $0$. When $\mathbf{F}_{t}$ cannot be obtained exactly, we can use, first, the outer approximation $\mathbf{F}_{2}$ to reduce the dimension of the problem and then the inner approximation $\mathbf{F}_{1}$ to obtain correct estimates of cell probabilities corresponding to elements of $\mathbf{F}_{1}$ and improve the estimates of the remaining probabilities corresponding to elements in $\mathbf{F}_{2}\setminus\mathbf{F}_{1}$. Using both real-world and simulated data, we illustrate our results, and show that our methodology scales to high dimensions.

Article information

Source
Ann. Statist., Volume 47, Number 3 (2019), 1203-1233.

Dates
Revised: April 2018
First available in Project Euclid: 13 February 2019

Permanent link to this document
https://projecteuclid.org/euclid.aos/1550026834

Digital Object Identifier
doi:10.1214/18-AOS1710

Mathematical Reviews number (MathSciNet)
MR3911110

Zentralblatt MATH identifier
07053506

Citation

Wang, Nanwei; Rauh, Johannes; Massam, Hélène. Approximating faces of marginal polytopes in discrete hierarchical models. Ann. Statist. 47 (2019), no. 3, 1203--1233. doi:10.1214/18-AOS1710. https://projecteuclid.org/euclid.aos/1550026834

Supplemental materials

• Supplement to “Approximating faces of marginal polytopes in discrete hierarchical models.”. Appendix A describes the concrete parametrization that we use in the examples. Appendix B discusses the case of two binary variables to illustrate what happens to the usual parameters when the MLE does not exist. Appendix C discusses how to further improve the parametrization $\mu_{L}$ introduced in Section 2. Appendices D and E give further results for the examples from Section 5. Appendix F gives the technical details for the example in Section 6.2.