The Annals of Statistics

Maximum likelihood methods for a generalized class of log-linear models

Joseph B. Lang
Source: Ann. Statist. Volume 24, Number 2 (1996), 726-752.

Abstract

We discuss maximum likelihood methods for fitting a broad class of multivariate categorical response data models. In particular, we derive the large-sample distributions for maximum likelihood estimators of parameters of product-multinomial generalized log-linear models. The large-sample behavior of other relevant likelihood-based statistics such as goodness-of-fit statistics and adjusted residuals is also described. The asymptotic results are derived within the framework of the constraint specification, rather than the more common freedom specification, of the model. We also outline an improved fitting algorithm for computing parameter maximum likelihood estimates and other relevant statistics. The broad class of multivariate categorical response data models, which are referred to as generalized log-linear models, can imply structure on several response configuration distributions (e.g., joint and marginal distributions). These models, which include as special cases log-linear, logit and cumulative-logit models, enjoy a wide breadth of application including longitudinal, rater-agreement and crossover data analyses.

First Page: Show Hide
Primary Subjects: 62H17, 62E20
Full-text: Open access
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aos/1032894462
Mathematical Reviews number (MathSciNet): MR1394985
Digital Object Identifier: doi:10.1214/aos/1032894462
Zentralblatt MATH identifier: 0859.62061

References

AGRESTI, A. 1990. Categorical Data Analy sis. Wiley, New York. Z.
Mathematical Reviews (MathSciNet): MR91k:62055
AITCHISON, J. 1962. Large-sample restricted parametric tests. J. Roy. Statist. Soc. Ser. B 24 234 250. Z.
Mathematical Reviews (MathSciNet): MR25:3586
AITCHISON, J. and SILVEY, S. D. 1958. Maximum-likelihood estimation of parameters subject to restraints. Ann. Math. Statist. 29 813 828. Z.
Mathematical Reviews (MathSciNet): MR20:1382
Zentralblatt MATH: 0092.36704
Digital Object Identifier: doi:10.1214/aoms/1177706538
Project Euclid: euclid.aoms/1177706538
AITCHISON, J. and SILVEY, S. D. 1960. Maximum-likelihood estimation procedures and associated tests of significance. J. Roy. Statist. Soc. Ser. B 22 154 171. Z.
Mathematical Reviews (MathSciNet): MR22:3053
BECKER, M. P. and BALAGTAS, C. C. 1993. A log-nonlinear model for binary cross-over data. Biometrics 49 997 1009. Z.
BISHOP, Y., FIENBERG, S. E. and HOLLAND, P. 1975. Discrete Multivariate Analy sis. MIT Press. Z.
Mathematical Reviews (MathSciNet): MR381130
DALE, J. R. 1986. Global cross-ratio models for bivariate, discrete, ordered responses. Biometrics 42 909 917. Z.
GILULA, Z. and HABERMAN, S. J. 1986. Canonical analysis of contingency tables by maximum likelihood. J. Amer. Statist. Assoc. 81 780 798. Z.
Mathematical Reviews (MathSciNet): MR88c:62097
Zentralblatt MATH: 0623.62047
Digital Object Identifier: doi:10.2307/2289010
GLONEK, G. F. V. and MCCULLAGH, P. 1995. Multivariate logistic models. J. Roy. Statist. Soc. Ser. B 57 533 546 Z.
Zentralblatt MATH: 0827.62059
HABER, M. 1985a. Maximum likelihood methods for linear and log-linear models in categorical data. Comput. Statist. Data Anal. 3 1 10. Z.
Mathematical Reviews (MathSciNet): MR812132
HABER, M. 1985b. Log-linear models for correlated marginal totals of a contingency table. Comm. Statist. Theory Methods 14 2845 2856. Z.
Mathematical Reviews (MathSciNet): MR821090
Digital Object Identifier: doi:10.1080/03610928508829080
HABER, M. and BROWN, M. 1986. Maximum likelihood methods for log-linear models when expected frequencies are subject to linear constraints. J. Amer. Statist. Assoc. 81 477 482. Z.
Mathematical Reviews (MathSciNet): MR87k:62040
Zentralblatt MATH: 0604.62058
Digital Object Identifier: doi:10.2307/2289238
HABERMAN, S. J. 1973. The analysis of residuals in cross-classification tables. Biometrics 29 205 220. Z.
HABERMAN, S. J. 1974. The Analy sis of Frequency Data. Univ. Chicago Press. Z.
Mathematical Reviews (MathSciNet): MR53:11865
Zentralblatt MATH: 0325.62017
LAIRD, N. M. 1991. Topics of likelihood-based methods for longitudinal data analysis. Statist. Sinica 1 33 50. Z.
LANG, J. B. 1996. On the comparison of multinomial and Poisson loglinear models. J. Roy. Statist. Soc. Ser. B 58 253 266. Z.
Mathematical Reviews (MathSciNet): MR1379241
LANG, J. B. and AGRESTI, A. 1994. Simultaneously modeling joint and marginal distributions of multivariate categorical responses. J. Amer. Statist. Assoc. 89 625 632. Z.
Zentralblatt MATH: 0799.62063
MACRAE, E. C. 1974. Matrix derivatives with an application to an adaptive linear decision problem. Ann. Statist. 2 337 346. Z.
Mathematical Reviews (MathSciNet): MR52:5906
Zentralblatt MATH: 0285.26013
Digital Object Identifier: doi:10.1214/aos/1176342667
Project Euclid: euclid.aos/1176342667
MCCULLAGH, P. and NELDER, J. A. 1989. Generalized Linear Models. Chapman and Hall, London. Z.
Mathematical Reviews (MathSciNet): MR727836
MOLENBERGHS, G. and LESAFFRE, E. 1994. Marginal modelling of multivariate categorical data. Unpublished manuscript. Z.
PALMGREN, J. 1981. The Fisher information matrix for log linear models arguing conditionally on observed explanatory variables. Biometrika 68 563 566. Z.
Mathematical Reviews (MathSciNet): MR82h:62089
Zentralblatt MATH: 0477.62039
PIERCE, D. A. and SCHAFER, D. W. 1986. Residuals in generalized linear models. J. Amer. Statist. Assoc. 81 977 986. Z.
Mathematical Reviews (MathSciNet): MR867620
Zentralblatt MATH: 0644.62076
Digital Object Identifier: doi:10.2307/2289071
PRATT, J. W. 1981. Concavity of the log likelihood. J. Amer. Statist. Assoc. 76 103 106. Z.
Mathematical Reviews (MathSciNet): MR83h:62098
Zentralblatt MATH: 0465.62058
Digital Object Identifier: doi:10.2307/2287052
SERFLING, R. J. 1980. Approximation Theorems of Mathematical Statistics. Wiley, New York. Z.
Mathematical Reviews (MathSciNet): MR82a:62003
SILVEY, S. D. 1959. The Lagrange-multiplier test. Ann. Math. Statist. 30 389 407.
Mathematical Reviews (MathSciNet): MR104307
Zentralblatt MATH: 0090.36302
Digital Object Identifier: doi:10.1214/aoms/1177706259
Project Euclid: euclid.aoms/1177706259
IOWA CITY, IOWA 52242

2012 © Institute of Mathematical Statistics

The Annals of Statistics

The Annals of Statistics