The Annals of Statistics

Efficient maximum likelihood estimation in semiparametric mixture models

Aad Van der Vaart
Source: Ann. Statist. Volume 24, Number 2 (1996), 862-878.

Abstract

We consider maximum likelihood estimation in several examples of semiparametric mixture models, including the exponential frailty model and the errors-in-variables model. The observations consist of a sample of size n from the mixture density $\int p_{\theta}(x|z) d \eta(z)$. The mixing distribution is completely unknown. We show that the first component $\hat{\theta}_n$ of the joint maximum likelihood estimator , $(\hat{\theta}_n \hat{\eta}_n)$ is asymptotically normal and asymptotically efficient in the semiparametric sense.

First Page: Show Hide
Primary Subjects: 62G20, 62F12
Full-text: Open access
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aos/1032894470
Mathematical Reviews number (MathSciNet): MR1394993
Digital Object Identifier: doi:10.1214/aos/1032894470
Zentralblatt MATH identifier: 0860.62029

References

ANDERSON, T. W. 1984. Estimating linear statistical relationships. Ann. Statist. 12 1 45. Z.
Zentralblatt MATH: 0542.62039
Mathematical Reviews (MathSciNet): MR733497
Digital Object Identifier: doi:10.1214/aos/1176346390
Project Euclid: euclid.aos/1176346390
BICKEL, P. J. 1982. On adaptive estimation. Ann Statist. 10 647 671.
Mathematical Reviews (MathSciNet): MR84a:62045
Zentralblatt MATH: 0489.62033
Digital Object Identifier: doi:10.1214/aos/1176345863
Project Euclid: euclid.aos/1176345863
BICKEL, P. J. and RITOV, Y. 1987. Efficient estimation in the errors in variables model. Ann. Statist. 15 513 540. Z.
Mathematical Reviews (MathSciNet): MR88g:62132
Zentralblatt MATH: 0643.62029
Digital Object Identifier: doi:10.1214/aos/1176350358
Project Euclid: euclid.aos/1176350358
BICKEL, P. J., KLAASSEN, C. A. J., RITOV, Y. and WELLNER, J. A. 1993. Efficient and Adaptive Estimation for Semi-Parametric Models. Johns Hopkins Univ. Press. Z.
Mathematical Reviews (MathSciNet): MR94m:62007
DUDLEY, R. M. 1985. An extended Wichura Theorem, definitions of Donsker classes, and weighted empirical processes. Probability in Banach Spaces V. Lecture Notes in Math. 1153 1306 1326. Springer, New York. Z.
Mathematical Reviews (MathSciNet): MR821972
Zentralblatt MATH: 0563.00014
GINE, E. and ZINN, J. 1986. Empirical processes indexed by Lipschitz functions. Ann. Probab. ´ 14 1329 1338. Z.
GROENEBOOM, P. 1991. Nonparametric maximum likelihood estimators for interval censoring and deconvolution. Technical Report 91-53, Technische Univ. Delft. Z.
HECKMAN, J. and SINGER, B. 1984. A method for minimizing the impact of distributional assumptions in economic studies for duration data. Econometrica 52 271 320. Z.
Mathematical Reviews (MathSciNet): MR735309
Digital Object Identifier: doi:10.2307/1911491
KIEFER, J. and WOLFOWITZ, J. 1956. Consistency of the maximum likelihood estimator in the presence of infinitely many nuisance parameters. Ann. Math. Statist. 27 887 906. Z.
Mathematical Reviews (MathSciNet): MR86464
Zentralblatt MATH: 0073.14701
Digital Object Identifier: doi:10.1214/aoms/1177728066
Project Euclid: euclid.aoms/1177728066
KOLMOGOROV, A. N. and TIKHOMIROV, V. M. 1961. Epsilon-entropy and epsilon-capacity of sets in functions spaces. Amer. Math. Soc. Transl. Ser. 2 17 277 364. Z.
Mathematical Reviews (MathSciNet): MR124720
KUMON, M. and AMARI, S. 1984. Estimation of a structural parameter in the presence of a large number of nuisance parameters. Biometrika 71 445 459. Z.
Mathematical Reviews (MathSciNet): MR86k:62042
Zentralblatt MATH: 0571.62025
Digital Object Identifier: doi:10.1093/biomet/71.3.445
LINDSAY, B. G. 1983a. Efficiency of the conditional score in a mixture setting. Ann. Statist. 11 486 497. Z.
Mathematical Reviews (MathSciNet): MR696061
Zentralblatt MATH: 0583.62024
Digital Object Identifier: doi:10.1214/aos/1176346155
Project Euclid: euclid.aos/1176346155
LINDSAY, B. G. 1983b. The geometry of mixture likelihoods, I and II. Ann. Statist. 11 86 94 and 783 792. Z.
LINDSAY, B. G. 1985. Using empirical Bay es inference for increased efficiency. Ann. Statist. 13 914 931. Z.
Mathematical Reviews (MathSciNet): MR803748
Zentralblatt MATH: 0601.62044
Digital Object Identifier: doi:10.1214/aos/1176349646
Project Euclid: euclid.aos/1176349646
MURPHY, S. A. 1995. Asy mptotic theory for the frailty model. Ann. Statist. 23 182 198. Z.
Mathematical Reviews (MathSciNet): MR96g:62167
Zentralblatt MATH: 0822.62069
Digital Object Identifier: doi:10.1214/aos/1176324462
Project Euclid: euclid.aos/1176324462
OSSIANDER, M. 1987. A central limit theorem under metric entropy with L -bracketing. Ann. 2 Probab. 15 897 919. Z.
Mathematical Reviews (MathSciNet): MR88k:60067
Zentralblatt MATH: 0665.60036
Digital Object Identifier: doi:10.1214/aop/1176992072
Project Euclid: euclid.aop/1176992072
PFANZAGL, J. 1988. Consistency of maximum likelihood estimators for certain nonparametric families, in particular: mixtures. J. Statist. Plann. Inference 19 137 158. Z.
Mathematical Reviews (MathSciNet): MR89g:62063
Zentralblatt MATH: 0656.62044
Digital Object Identifier: doi:10.1016/0378-3758(88)90069-9
PFANZAGL, J. 1990. Estimation in Semiparametric Models. Springer, New York. Z.
Mathematical Reviews (MathSciNet): MR91f:62074
Zentralblatt MATH: 0704.62034
SEVERINI, T. A. and WONG, W. H. 1992. Profile likelihood and conditionally parametric models. Ann. Statist. 20 1768 1862. Z.
Mathematical Reviews (MathSciNet): MR1193312
Zentralblatt MATH: 0768.62015
Digital Object Identifier: doi:10.1214/aos/1176348889
Project Euclid: euclid.aos/1176348889
STONE, C. J. 1975. Adaptive maximum likelihood estimation of a location parameter. Ann. Statist. 3 267 284. Z.
Mathematical Reviews (MathSciNet): MR362669
Zentralblatt MATH: 0303.62026
Digital Object Identifier: doi:10.1214/aos/1176343056
Project Euclid: euclid.aos/1176343056
VAN DER VAART, A. W. 1988a. Statistical Estimation in Large Parameter Spaces. CWI Tract 44. Math. Centrum, Amsterdam. Z.
Mathematical Reviews (MathSciNet): MR927725
Zentralblatt MATH: 0629.62035
VAN DER VAART, A. W. 1988b. Estimating a parameter in incidental and structural models by approximate maximum likelihood. Technical Report 139, Dept. Statistics, Univ. Washington. Z.
VAN DER VAART, A. W. 1988c. Estimating a real parameter in a class of semiparametric models. Ann. Statist. 16 1450 1474. Z.
Mathematical Reviews (MathSciNet): MR964933
Zentralblatt MATH: 0665.62034
Digital Object Identifier: doi:10.1214/aos/1176351048
Project Euclid: euclid.aos/1176351048
VAN DER VAART, A. W. 1993. New Donsker classes. Ann. Probab. To appear. Z.
Mathematical Reviews (MathSciNet): MR1415244
Zentralblatt MATH: 0872.60023
Digital Object Identifier: doi:10.1214/aop/1041903221
Project Euclid: euclid.aop/1041903221
VAN DER VAART, A. W. 1994. Bracketing smooth functions. Stochastic Process. Appl. 52 93 105. Z.
Mathematical Reviews (MathSciNet): MR95h:60053
Zentralblatt MATH: 0811.60025
Digital Object Identifier: doi:10.1016/0304-4149(94)90102-3
WALD, A. 1949. Note on the consistency of the maximum likelihood estimate. Ann. Math. Statist. 20 595 601.
Mathematical Reviews (MathSciNet): MR11,261d
Zentralblatt MATH: 0034.22902
Digital Object Identifier: doi:10.1214/aoms/1177729952
Project Euclid: euclid.aoms/1177729952

2012 © Institute of Mathematical Statistics

The Annals of Statistics

The Annals of Statistics