Bootstrap consistency for general semiparametric M-estimation

Bootstrap consistency for general semiparametric M-estimation

Guang Cheng and Jianhua Z. Huang

Source: Ann. Statist. Volume 38, Number 5 (2010), 2884-2915.

Abstract

Consider M-estimation in a semiparametric model that is characterized by a Euclidean parameter of interest and an infinite-dimensional nuisance parameter. As a general purpose approach to statistical inferences, the bootstrap has found wide applications in semiparametric M-estimation and, because of its simplicity, provides an attractive alternative to the inference approach based on the asymptotic distribution theory. The purpose of this paper is to provide theoretical justifications for the use of bootstrap as a semiparametric inferential tool. We show that, under general conditions, the bootstrap is asymptotically consistent in estimating the distribution of the M-estimate of Euclidean parameter; that is, the bootstrap distribution asymptotically imitates the distribution of the M-estimate. We also show that the bootstrap confidence set has the asymptotically correct coverage probability. These general conclusions hold, in particular, when the nuisance parameter is not estimable at root-n rate, and apply to a broad class of bootstrap methods with exchangeable bootstrap weights. This paper provides a first general theoretical study of the bootstrap in semiparametric models.

First Page: Show

Primary Subjects: 62F40

Secondary Subjects: 62G20

Keywords: Bootstrap consistency; bootstrap confidence set; semiparametric model; M-estimation

Full-text: Access denied (no subscription detected)

We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber.

If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription. Read more about accessing full-text

Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aos/1279638543
Digital Object Identifier: doi:10.1214/10-AOS809
Zentralblatt MATH identifier: 1200.62042
Mathematical Reviews number (MathSciNet): MR2722459

back to Table of Contents

References

[1] Barbe, P. and Bertail, P. (1995). The Weighted Bootstrap. Lecture Notes in Statistics 98. Springer, New York.

Mathematical Reviews (MathSciNet): MR2195545

Zentralblatt MATH: 0826.62030

[2] Banerjee, M., Mukherjee, D. and Mishra, S. (2009). Semiparametric binary regression models under shape constraints with an application to Indian schooling data. J. Econometrics 149 101–117.

Mathematical Reviews (MathSciNet): MR2518501

Digital Object Identifier: doi:10.1016/j.jeconom.2008.11.002

[3] Bickel, P. J. and Freedman, D. A. (1981). Some asymptotic theory for the bootstrap. Ann. Statist. 9 1196–1217.

Mathematical Reviews (MathSciNet): MR630103

Zentralblatt MATH: 0449.62034

Digital Object Identifier: doi:10.1214/aos/1176345637

Project Euclid: euclid.aos/1176345637

[4] Bickel, P. J., Klaassen, C. A. J., Ritov, Y. and Wellner, J. A. (1998). Efficient and Adaptive Estimation for Semiparametric Models. Springer, New York.

Mathematical Reviews (MathSciNet): MR1623559

[5] Chatterjee, S. and Bose, A. (2005). Generalized bootstrap for estimating equations. Ann. Statist. 33 414–436.

Mathematical Reviews (MathSciNet): MR2157808

Zentralblatt MATH: 1065.62073

Digital Object Identifier: doi:10.1214/009053604000000904

Project Euclid: euclid.aos/1112967711

[6] Chen, X. and Pouzo, D. (2009). Efficient estimation of semiparametric conditional moment models with possibly nonsmooth residuals. J. Econometrics 152 46–60.

Mathematical Reviews (MathSciNet): MR2562763

Digital Object Identifier: doi:10.1016/j.jeconom.2009.02.002

[7] Cheng, G. (2008). Semiparametric additive isotonic regression. J. Statist. Plann. Inference 100 345–362.

Mathematical Reviews (MathSciNet): MR2497554

Zentralblatt MATH: 1159.62025

Digital Object Identifier: doi:10.1016/j.jspi.2008.09.009

[8] Cheng, G. and Kosorok, M. (2008). Higher order semiparametric frequentist inference with the profile sampler. Ann. Statist. 36 1786–1818.

Mathematical Reviews (MathSciNet): MR2435456

Zentralblatt MATH: 1142.62030

Digital Object Identifier: doi:10.1214/07-AOS523

Project Euclid: euclid.aos/1216237300

[9] Cheng, G. and Kosorok, M. (2008). General frequentist properties of the posterior profile distribution. Ann. Statist. 36 1819–1853.

Mathematical Reviews (MathSciNet): MR2435457

Zentralblatt MATH: 1142.62031

Digital Object Identifier: doi:10.1214/07-AOS536

Project Euclid: euclid.aos/1216237301

[10] Delecroix, M., Hristache, M. and Patilea, V. (2006). On semiparametric M-estimation in single-index regression. J. Statist. Plann. Inference 136 730–769.

Mathematical Reviews (MathSciNet): MR2181975

Zentralblatt MATH: 1077.62027

Digital Object Identifier: doi:10.1016/j.jspi.2004.09.006

[11] Dixon, J., Kosorok, M. and Lee, B. L. (2005). Functional inference in semiparametric models using the piggyback bootstrap. Ann. Inst. Statist. Math. 57 255–277.

Mathematical Reviews (MathSciNet): MR2160650

Zentralblatt MATH: 1082.62038

Digital Object Identifier: doi:10.1007/BF02507025

[12] Dudley, R. M. (1984). A Course on Empirical Processes. Lecture Notes in Math. 1097 2–142. Springer, Berlin.

Mathematical Reviews (MathSciNet): MR876079

Zentralblatt MATH: 0554.60029

[13] Efron, B. (1982). The Jackknife, the Bootstrap and Other Resampling Plans. SIAM, Philadelphia.

Mathematical Reviews (MathSciNet): MR659849

Zentralblatt MATH: 0496.62036

[14] Efron, B. and Tibshirani, R. (1986). Bootstrap methods for standard errors, confidence intervals, and other measures of statistical accuracy. Statist. Sci. 1 54–75.

Mathematical Reviews (MathSciNet): MR833275

Digital Object Identifier: doi:10.1214/ss/1177013815

Project Euclid: euclid.ss/1177013815

[15] Grenander, U. (1981). Abstract Inference. Wiley, New York.

Mathematical Reviews (MathSciNet): MR599175

[16] Gelman, A., Carlin, J., Stern, H. and Rubin, D. (2003). Bayesian Data Analysis, 2nd ed. Chapman and Hall, London.

Mathematical Reviews (MathSciNet): MR2027492

[17] Gine, E. and Zinn, J. (1990). Bootstrapping general empirical functions. Ann. Probab. 18 851–869.

Mathematical Reviews (MathSciNet): MR1055437

Zentralblatt MATH: 0706.62017

Digital Object Identifier: doi:10.1214/aop/1176990862

Project Euclid: euclid.aop/1176990862

[18] Hall, P. (1992). The Bootstrap and Edgeworth Expansion. Springer, New York.

Mathematical Reviews (MathSciNet): MR1145237

[19] Hardle, W., Huet, S., Mammen, E. and Sperlich, S. (2004). Bootstrap inference in semiparametric generalized additive models. Econometric Theory 20 265–300.

Mathematical Reviews (MathSciNet): MR2044272

Zentralblatt MATH: 1072.62034

JSTOR: links.jstor.org

[20] Huang, J. (1999). Efficient estimation of the partly linear Cox model. Ann. Statist. 27 1536–1563.

Mathematical Reviews (MathSciNet): MR1742499

Zentralblatt MATH: 0977.62035

Digital Object Identifier: doi:10.1214/aos/1017939141

Project Euclid: euclid.aos/1017939141

[21] Kosorok, M., Lee, B. L. and Fine, J. P. (2004). Robust inference for univariate proportional hazards frailty regression models. Ann. Statist. 32 1448–1491.

Mathematical Reviews (MathSciNet): MR2089130

Zentralblatt MATH: 1047.62090

Digital Object Identifier: doi:10.1214/009053604000000535

Project Euclid: euclid.aos/1091626175

[22] Kosorok, M. (2008). Introduction to Empirical Processes and Semiparametric Inference. Springer, New York.

[23] Kosorok, M. (2008). Boostrapping the Grenander estimator. In Beyond Parametrics in Interdisciplinary Research: Festschrift in Honor of Professor Pranab K. Sen. IMS Collections 1 282–292. IMS, Beachwood, OH.

[24] Lee, B. L., Kosorok, M. R. and Fine, J. P. (2005). The profile sampler. J. Amer. Statist. Assoc. 100 960–969.

Mathematical Reviews (MathSciNet): MR2201022

Zentralblatt MATH: 1117.62380

Digital Object Identifier: doi:10.1198/016214504000001772

[25] Lee, S. M. S. and Pun, M. C. (2006). On m out of n bootstrapping for nonstandard M-estimation with nuisance parameters. J. Amer. Statist. Assoc. 101 1185–1197.

Mathematical Reviews (MathSciNet): MR2328306

Zentralblatt MATH: 1120.62310

Digital Object Identifier: doi:10.1198/016214506000000014

[26] Liang, H., Härdle, W. and Sommerfeld, V. (2000). Bootstrap approximations in a partially linear regression model. J. Statist. Plann. Inference 91 413–426.

Mathematical Reviews (MathSciNet): MR1814793

Zentralblatt MATH: 0965.62034

Digital Object Identifier: doi:10.1016/S0378-3758(00)00191-9

[27] Lo, A. Y. (1993). A Bayesian bootstrap for censored data. Ann. Statist. 21 100–123.

Mathematical Reviews (MathSciNet): MR1212168

Zentralblatt MATH: 0787.62048

Digital Object Identifier: doi:10.1214/aos/1176349017

Project Euclid: euclid.aos/1176349017

[28] Ma, S. and Kosorok, M. (2005). Robust semiparametric M-estimation and the weighted bootstrap. J. Multivariate Anal. 96 190–217.

Mathematical Reviews (MathSciNet): MR2202406

Zentralblatt MATH: 1073.62030

Digital Object Identifier: doi:10.1016/j.jmva.2004.09.008

[29] Ma, S. and Kosorok, M. (2005). Penalized log-likelihood estimation for partly linear transformation models with current status data. Ann. Statist. 33 2256–2290.

Mathematical Reviews (MathSciNet): MR2211086

Zentralblatt MATH: 1086.62056

Digital Object Identifier: doi:10.1214/009053605000000444

Project Euclid: euclid.aos/1132936563

[30] Mason, D. and Newton, M. (1992). A rank statistic approach to the consistency of a general bootstrap. Ann. Statist. 20 1611–1624.

Mathematical Reviews (MathSciNet): MR1186268

Zentralblatt MATH: 0777.62045

Digital Object Identifier: doi:10.1214/aos/1176348787

Project Euclid: euclid.aos/1176348787

[31] Murphy, S. A. and van der Vaart, A. W. (1999). Observed information in semiparametric models. Bernoulli 5 381–412.

[32] Murphy, S. A. and van der Vaart, A. W. (2000). On profile likelihood. J. Amer. Statist. Assoc. 95 1461–1474.

Mathematical Reviews (MathSciNet): MR1803168

Zentralblatt MATH: 0995.62033

Digital Object Identifier: doi:10.2307/2669386

JSTOR: links.jstor.org

[33] Praestgaard, J. and Wellner, J. (1993). Exchangeably weighted bootstraps of the general empirical process. Ann. Probab. 21 2053–2086.

Mathematical Reviews (MathSciNet): MR1207214

Zentralblatt MATH: 0773.60042

Digital Object Identifier: doi:10.1214/aop/1176989392

Project Euclid: euclid.aop/1176989392

[34] Rubin, D. (1981). The Bayesian bootstrap. Ann. Statist. 9 130–134.

Mathematical Reviews (MathSciNet): MR600538

Digital Object Identifier: doi:10.1214/aos/1176345338

Project Euclid: euclid.aos/1176345338

[35] Sen, B., Banerjee, M. and Woodroofe, M. B. (2010). Inconsistency of bootstrap: The Grenander estimator. Ann. Statist. 38 1953–1977.

Mathematical Reviews (MathSciNet): MR2676880

Zentralblatt MATH: 05774395

Digital Object Identifier: doi:10.1214/09-AOS777

Project Euclid: euclid.aos/1278861239

[36] Singh, K. (1981). On the asymptotic accuracy of Efron’s bootstrap. Ann. Statist. 9 1187–1195.

Mathematical Reviews (MathSciNet): MR630102

Zentralblatt MATH: 0494.62048

Digital Object Identifier: doi:10.1214/aos/1176345636

Project Euclid: euclid.aos/1176345636

[37] Strawderman, R. (2006). A regression model for dependent gap times. Int. J. Biostat. 2 Article 1, 34 pp. (electronic).

Mathematical Reviews (MathSciNet): MR2275896

Zentralblatt MATH: 1117.62490

Digital Object Identifier: doi:10.2202/1557-4679.1005

[38] van der Vaart, A. W. and Wellner, J. A. (1996). Weak Convergence and Empirical Processes: With Applications to Statistics. Springer, New York.

Mathematical Reviews (MathSciNet): MR1385671

Zentralblatt MATH: 0862.60002

[39] van der Vaart, A. W. (1998). Asymptotic Statistics. Cambridge Univ. Press, Cambridge.

Mathematical Reviews (MathSciNet): MR1652247

Zentralblatt MATH: 0910.62001

[40] van de Geer, S. (2000). Empirical Processes in M-Estimation. Cambridge Univ. Press, Cambridge.

[41] Wellner, J. A. and Zhan, Y. (1996). Bootstrapping Z-estimators. Technical Report 308, Univ. Washington.

[42] Wellner, J. A. and Zhang, Y. (2007). Two likelihood-based semiparametric estimation methods for panel count data with covariates. Ann. Statist. 35 2106–2142.

Mathematical Reviews (MathSciNet): MR2363965

Zentralblatt MATH: 1126.62084

Digital Object Identifier: doi:10.1214/009053607000000181

Project Euclid: euclid.aos/1194461724

[43] Young, J. G., Jewell, N. P. and Samuels, S. J. (2008). Regression analysis of a disease onset distribution using diagnosis data. Biometrics 64 20–28.

Mathematical Reviews (MathSciNet): MR2422815

Digital Object Identifier: doi:10.1111/j.1541-0420.2007.00871.x

[44] Zeng, D. L. and Lin, D. Y. (2007). Maximum likelihood estimation in semiparametric models with censored data (with discussion). J. R. Stat. Soc. Ser. B Stat. Methodol. 69 507–564.

Mathematical Reviews (MathSciNet): MR2370068

Digital Object Identifier: doi:10.1111/j.1369-7412.2007.00606.x

[45] Zhang, C. M. and Yu, T. (2008). Semiparametric detection of significant activation for brain FMRI. Ann. Statist. 36 1693–1725.

Mathematical Reviews (MathSciNet): MR2435453

Zentralblatt MATH: 1142.62026

Digital Object Identifier: doi:10.1214/07-AOS519

Project Euclid: euclid.aos/1216237297

previous :: next