The Annals of Statistics

Efficient estimation of Banach parameters in semiparametric models

Chris A. J. Klaassen and Hein Putter
Source: Ann. Statist. Volume 33, Number 1 (2005), 307-346.

Abstract

Consider a semiparametric model with a Euclidean parameter and an infinite-dimensional parameter, to be called a Banach parameter. Assume:

(a) There exists an efficient estimator of the Euclidean parameter.

(b) When the value of the Euclidean parameter is known, there exists an estimator of the Banach parameter, which depends on this value and is efficient within this restricted model.

Substituting the efficient estimator of the Euclidean parameter for the value of this parameter in the estimator of the Banach parameter, one obtains an efficient estimator of the Banach parameter for the full semiparametric model with the Euclidean parameter unknown. This hereditary property of efficiency completes estimation in semiparametric models in which the Euclidean parameter has been estimated efficiently. Typically, estimation of both the Euclidean and the Banach parameter is necessary in order to describe the random phenomenon under study to a sufficient extent. Since efficient estimators are asymptotically linear, the above substitution method is a particular case of substituting asymptotically linear estimators of a Euclidean parameter into estimators that are asymptotically linear themselves and that depend on this Euclidean parameter. This more general substitution case is studied for its own sake as well, and a hereditary property for asymptotic linearity is proved.

First Page: Show Hide
Primary Subjects: 62G20
Secondary Subjects: 62G05, 62J05, 62M10
Full-text: Open access
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aos/1112967708
Digital Object Identifier: doi:10.1214/009053604000000913
Zentralblatt MATH identifier: 02182565
Mathematical Reviews number (MathSciNet): MR2157805

References

Begun, J. M., Hall, W. J., Huang, W.-M. and Wellner, J. A. (1983). Information and asymptotic efficiency in parametric-nonparametric models. Ann. Statist. 11 432--452.
Mathematical Reviews (MathSciNet): MR696057
Beran, R. (1974). Asymptotically efficient adaptive rank estimates in location models. Ann. Statist. 2 63--74.
Mathematical Reviews (MathSciNet): MR345295
Bickel, P. J. (1982). On adaptive estimation. Ann. Statist. 10 647--671.
Mathematical Reviews (MathSciNet): MR663424
Bickel, P. J., Klaassen, C. A. J., Ritov, Y. and Wellner, J. A. (1993). Efficient and Adaptive Estimation for Semiparametric Models. Johns Hopkins Univ. Press, Baltimore.
Mathematical Reviews (MathSciNet): MR1245941
Zentralblatt MATH: 0786.62001
Bolthausen, E., Perkins, E. and van der Vaart, A. W. (2002). Lectures on Probability Theory and Statistics. Lecture Notes in Math. 1781. Springer, New York.
Mathematical Reviews (MathSciNet): MR1915443
Zentralblatt MATH: 0996.00039
Breslow, N. E. (1974). Covariance analysis of censored survival data. Biometrics 30 89--99.
Butler, S. and Louis, T. (1992). Random effects models with non-parametric priors. Statistics in Medicine 11 1981--2000.
Cosslett, S. (1981). Maximum likelihood estimator for choice-based samples. Econometrica 49 1289--1316.
Mathematical Reviews (MathSciNet): MR625785
Cox, D. R. (1972). Regression models and life tables (with discussion). J. Roy. Statist. Soc. Ser. B 34 187--220.
Mathematical Reviews (MathSciNet): MR341758
Dionne, L. (1981). Efficient nonparametric estimators of parameters in the general linear hypothesis. Ann. Statist. 9 457--460.
Mathematical Reviews (MathSciNet): MR606633
Gilbert, P. B., Lele, S. R. and Vardi, Y. (1999). Maximum likelihood estimation in semiparametric selection bias models with application to AIDS vaccine trials. Biometrika 86 27--43.
Mathematical Reviews (MathSciNet): MR1688069
Digital Object Identifier: doi:10.1093/biomet/86.1.27
Zentralblatt MATH: 0917.62061
Gong, G. and Samaniego, F. J. (1981). Pseudo maximum likelihood estimation: Theory and applications. Ann. Statist. 9 861--869.
Mathematical Reviews (MathSciNet): MR619289
Huang, J. (1996). Efficient estimation for the proportional hazards model with interval censoring. Ann. Statist. 24 540--568.
Mathematical Reviews (MathSciNet): MR1394975
Digital Object Identifier: doi:10.1214/aos/1032894452
Project Euclid: euclid.aos/1032894452
Zentralblatt MATH: 0859.62032
Johansen, S. (1983). An extension of Cox's regression model. Internat. Statist. Rev. 51 165--174.
Mathematical Reviews (MathSciNet): MR715533
Digital Object Identifier: doi:10.2307/1402746
Klaassen, C. A. J. (1987). Consistent estimation of the influence function of locally asymptotically linear estimates. Ann. Statist. 15 1548--1562.
Mathematical Reviews (MathSciNet): MR913573
Klaassen, C. A. J. (1989). Efficient estimation in the Cox model for survival data. In Proc. Fourth Prague Symposium on Asymptotic Statistics (P. Mandl and M. Hušková, eds.) 313--319. Charles Univ., Prague.
Mathematical Reviews (MathSciNet): MR1051449
Zentralblatt MATH: 0698.62030
Klaassen, C. A. J. and Putter, H. (1997). Efficient estimation of the error distribution in a semiparametric linear model. In International Symposium on Contemporary Multivariate Analysis and its Applications (K. Fang and F. J. Hickernell, eds.) B.1--B.8. Hong Kong.
Klaassen, C. A. J. and Putter, H. (2000). Efficient estimation of Banach parameters in semiparametric models. Technical report, Korteweg-de Vries Institute for Mathematics.
Koul, H. L. (1992). Weighted Empiricals and Linear Models. IMS, Hayward, CA.
Mathematical Reviews (MathSciNet): MR1218395
Zentralblatt MATH: 0998.62501
Koul, H. L. (2002). Weighted Empirical Processes in Dynamic Linear Models, 2nd ed. Springer, New York.
Mathematical Reviews (MathSciNet): MR1911855
Zentralblatt MATH: 1007.62047
Koul, H. L. and Susarla, V. (1983). Adaptive estimation in linear regression. Statist. Decisions 1 379--400.
Mathematical Reviews (MathSciNet): MR736109
Le Cam, L. (1956). On the asymptotic theory of estimation and testing hypotheses. Proc. Third Berkeley Symp. Math. Statist. Probab. 1 129--156. Univ. California Press, Berkeley.
Mathematical Reviews (MathSciNet): MR84918
Lehmann, E. L. (1999). Elements of Large-Sample Theory. Springer, New York.
Mathematical Reviews (MathSciNet): MR1663158
Zentralblatt MATH: 0914.62001
Loynes, R. M. (1980). The empirical distribution function of residuals from generalised regression. Ann. Statist. 8 285--298.
Mathematical Reviews (MathSciNet): MR560730
Müller, U. U., Schick, A. and Wefelmeyer, W. (2001). Plug-in estimators in semiparametric stochastic process models. In Selected Proc. Symposium on Inference for Stochastic Processes (I. V. Basawa, C. C. Heyde and R. L. Taylor, eds.) 213--234. IMS, Beachwood, OH.
Mathematical Reviews (MathSciNet): MR2002512
Murphy, S. A., Rossini, A. J. and van der Vaart, A. W. (1997). Maximum likelihood estimation in the proportional odds model. J. Amer. Statist. Assoc. 92 968--976.
Mathematical Reviews (MathSciNet): MR1482127
Murphy, S. A. and van der Vaart, A. (2000). On profile likelihood (with discussion). J. Amer. Statist. Assoc. 95 449--485.
Mathematical Reviews (MathSciNet): MR1803168
Nielsen, G. G., Gill, R. D., Andersen, P. K. and Sørensen, T. I. A. (1992). A counting process approach to maximum likelihood estimation in frailty models. Scand. J. Statist. 19 25--43.
Mathematical Reviews (MathSciNet): MR1172965
Owen, A. (1991). Empirical likelihood for linear models. Ann. Statist. 19 1725--1747.
Mathematical Reviews (MathSciNet): MR1135146
Pfanzagl, J. and Wefelmeyer, W. (1982). Contributions to a General Asymptotic Statistical Theory. Springer, New York.
Mathematical Reviews (MathSciNet): MR675954
Zentralblatt MATH: 0512.62001
Pierce, D. (1982). The asymptotic effect of substituting estimators for parameters in certain types of statistics. Ann. Statist. 10 475--478.
Mathematical Reviews (MathSciNet): MR653522
Qin, J. and Lawless, J. (1994). Empirical likelihood and general estimating equations. Ann. Statist. 22 300--325.
Mathematical Reviews (MathSciNet): MR1272085
Randles, R. (1982). On the asymptotic normality of statistics with estimated parameters. Ann. Statist. 10 462--474.
Mathematical Reviews (MathSciNet): MR653521
Schick, A. (2001). On asymptotic differentiability of averages. Statist. Probab. Lett. 51 15--23.
Mathematical Reviews (MathSciNet): MR1820140
Scholz, F. W. (1971). Comparison of optimal location estimators. Ph.D. dissertation, Univ. California, Berkeley.
Stone, C. (1975). Adaptive maximum likelihood estimators of a location parameter. Ann. Statist. 3 267--284.
Mathematical Reviews (MathSciNet): MR362669
Tsiatis, A. A. (1981). A large sample study of Cox's regression model. Ann. Statist. 9 93--108.
Mathematical Reviews (MathSciNet): MR600535
van der Vaart, A. W. (1991). On differentiable functionals. Ann. Statist. 19 178--204.
Mathematical Reviews (MathSciNet): MR1091845
van Eeden, C. (1970). Efficiency-robust estimation of location. Ann. Math. Statist. 41 172--181.
Mathematical Reviews (MathSciNet): MR263194
Digital Object Identifier: doi:10.1214/aoms/1177697197

2012 © Institute of Mathematical Statistics

The Annals of Statistics

The Annals of Statistics