The Annals of Statistics

Efficient estimation of a semiparametric partially linear varying coefficient model

Ibrahim Ahmad, Sittisak Leelahanon, and Qi Li
Source: Ann. Statist. Volume 33, Number 1 (2005), 258-283.

Abstract

In this paper we propose a general series method to estimate a semiparametric partially linear varying coefficient model. We establish the consistency and $\sqrt{n}$-normality property of the estimator of the finite-dimensional parameters of the model. We further show that, when the error is conditionally homoskedastic, this estimator is semiparametrically efficient in the sense that the inverse of the asymptotic variance of the estimator of the finite-dimensional parameter reaches the semiparametric efficiency bound of this model. A small-scale simulation is reported to examine the finite sample performance of the proposed estimator, and an empirical application is presented to illustrate the usefulness of the proposed method in practice. We also discuss how to obtain an efficient estimation result when the error is conditional heteroskedastic.

First Page: Show Hide
Primary Subjects: 62G08
Full-text: Open access
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aos/1112967706
Digital Object Identifier: doi:10.1214/009053604000000931
Zentralblatt MATH identifier: 02182563
Mathematical Reviews number (MathSciNet): MR2157803

References

Ai, C. and Chen, X. (2003). Efficient estimation of models with conditional moment restrictions containing unknown functions. Econometrica 71 1795--1843.
Mathematical Reviews (MathSciNet): MR2015420
Digital Object Identifier: doi:10.1111/1468-0262.00470
Zentralblatt MATH: 1154.62323
Andrews, D. W. K. (1991). Asymptotic normality of series estimators for nonparametric and semiparametric regression models. Econometrica 59 307--345.
Mathematical Reviews (MathSciNet): MR1097531
Bickel, P. J., Klaassen, C. A. J., Ritov, Y. and Wellner, J. A. (1993). Efficient and Adaptive Inference for Semiparametric Models. Johns Hopkins Univ. Press.
Bickel, P. J. and Kwon, J. (2002). Inference for semiparametric models: Some current frontiers and an answer (with discussion). Statist. Sinica 11 863--960.
Cai, Z., Fan, J. and Li, R. (2000). Efficient estimation and inferences for varying-coefficient models. J. Amer. Statist. Assoc. 95 888--902.
Mathematical Reviews (MathSciNet): MR1804446
Cai, Z., Fan, J. and Yao, Q. (2000). Functional-coefficient regression models for nonlinear time series. J. Amer. Statist. Assoc. 95 941--956.
Mathematical Reviews (MathSciNet): MR1804449
Carroll, R. J., Fan, J., Gijbels, I. and Wand, M. P. (1997). Generalized partially linear single-index models. J. Amer. Statist. Assoc. 92 477--489.
Mathematical Reviews (MathSciNet): MR1467842
Chamberlain, G. (1992). Efficiency bounds for semiparametric regression. Econometrica 60 567--596.
Mathematical Reviews (MathSciNet): MR1162999
Chen, R. and Tsay, R. S. (1993). Functional-coefficient autoregressive models. J. Amer. Statist. Assoc. 88 298--308.
Mathematical Reviews (MathSciNet): MR1212492
Craven, P. and Wahba, G. (1979). Smoothing noisy data with spline functions: Estimating the correct degree of smoothing by generalized cross-validation. Numer. Math. 31 377--403.
Mathematical Reviews (MathSciNet): MR516581
Digital Object Identifier: doi:10.1007/BF01404567
Zentralblatt MATH: 0377.65007
Fan, J. and Huang, L.-S. (2001). Goodness-of-fit tests for parametric regression models. J. Amer. Statist. Assoc. 96 640--652.
Mathematical Reviews (MathSciNet): MR1946431
Digital Object Identifier: doi:10.1198/016214501753168316
Zentralblatt MATH: 1017.62014
Fan, J. and Huang, T. (2002). Profile likelihood inferences on semiparametric varying-coefficient partially linear models. Unpublished manuscript.
Fan, J., Yao, Q. and Cai, Z. (2003). Adaptive varying-coefficient linear models. J. R. Stat. Soc. Ser. B Stat. Methodol. 65 57--80.
Mathematical Reviews (MathSciNet): MR1959093
Digital Object Identifier: doi:10.1111/1467-9868.00372
Zentralblatt MATH: 1063.62054
Fan, J. and Zhang, W. (1999). Statistical estimation in varying coefficient models. Ann. Statist. 27 1491--1518.
Mathematical Reviews (MathSciNet): MR1742497
Digital Object Identifier: doi:10.1214/aos/1017939139
Project Euclid: euclid.aos/1017939139
Zentralblatt MATH: 0977.62039
Green, P. J. and Silverman, B. W. (1994). Nonparametric Regression and Generalized Linear Models: A Roughness Penalty Approach. Chapman and Hall, London.
Mathematical Reviews (MathSciNet): MR1270012
Zentralblatt MATH: 0832.62032
Härdle, W., Liang, H. and Gao, J. (2000). Partially Linear Models. Physica-Verlag, Heidelberg.
Mathematical Reviews (MathSciNet): MR1787637
Hart, J. (1997). Nonparametric Smoothing and Lack-of-fit Tests. Springer, New York.
Mathematical Reviews (MathSciNet): MR1461272
Zentralblatt MATH: 0886.62043
Hastie, T. and Tibshirani, R. (1993). Varying coefficient models (with discussion). J. Roy. Statist. Soc. Ser. B 55 757--796.
Mathematical Reviews (MathSciNet): MR1229881
Hoover, D. R., Rice, J. A., Wu, C. O. and Yang, L.-P. (1998). Nonparametric smoothing estimates of time-varying coefficient models with longitudinal data. Biometrika 85 809--822.
Mathematical Reviews (MathSciNet): MR1666699
Zentralblatt MATH: 0921.62045
Digital Object Identifier: doi:10.1093/biomet/85.4.809
Huang, J. Z. (1998). Projection estimation in multiple regression with application to functional ANOVA models. Ann. Statist. 26 242--272.
Mathematical Reviews (MathSciNet): MR1611780
Digital Object Identifier: doi:10.1214/aos/1030563984
Project Euclid: euclid.aos/1030563984
Zentralblatt MATH: 0930.62042
Huang, J. Z. (2003). Local asymptotics for polynomial spline regression. Ann. Statist. 31 1600--1635.
Mathematical Reviews (MathSciNet): MR2012827
Digital Object Identifier: doi:10.1214/aos/1065705120
Project Euclid: euclid.aos/1065705120
Zentralblatt MATH: 1042.62035
Huang, J. Z., Wu, C. O. and Zhou, L. (2002). Varying coefficient models and basis function approximations for the analysis of repeated measurements. Biometrika 89 111--128.
Mathematical Reviews (MathSciNet): MR1888349
Zentralblatt MATH: 0998.62024
Digital Object Identifier: doi:10.1093/biomet/89.1.111
Huang, J. Z., Wu, C. O. and Zhou, L. (2004). Polynomial spline estimation and inference for varying coefficient models with longitudinal data. Statist. Sinica 14 763--788.
Mathematical Reviews (MathSciNet): MR2087972
Zentralblatt MATH: 1073.62036
Li, K. C. (1987). Asymptotic optimality for $C_p$, $C_L$, cross-validation and generalized cross-validation: Discrete index set. Ann. Statist. 15 958--975.
Mathematical Reviews (MathSciNet): MR902239
Li, Q., Huang, C. J., Li, D. and Fu, T.-T. (2002). Semiparametric smooth coefficient models. J. Bus. Econom. Statist. 20 412--422.
Mathematical Reviews (MathSciNet): MR1939909
Lorentz, G. G. (1966). Approximation of Functions. Holt, Rinehart and Winston, New York.
Mathematical Reviews (MathSciNet): MR213785
Zentralblatt MATH: 0153.38901
Mallows, C. L. (1973). Some comments on $C_p$. Technometrics 15 661--675.
Newey, W. K. (1997). Convergence rates and asymptotic normality for series estimators. J. Econometrics 79 147--168.
Mathematical Reviews (MathSciNet): MR1457700
Digital Object Identifier: doi:10.1016/S0304-4076(97)00011-0
Zentralblatt MATH: 0873.62049
Robinson, P. M. (1988). Root-N-consistent semiparametric regression. Econometrica 56 931--954.
Mathematical Reviews (MathSciNet): MR951762
Shen, X. (1997). On methods of sieves and penalization. Ann. Statist. 25 2555--2591.
Mathematical Reviews (MathSciNet): MR1604416
Digital Object Identifier: doi:10.1214/aos/1030741085
Project Euclid: euclid.aos/1030741085
Zentralblatt MATH: 0895.62041
Speckman, P. (1988). Kernel smoothing in partially linear models. J. Roy. Statist. Soc. Ser. B 50 413--436.
Mathematical Reviews (MathSciNet): MR970977
Stock, C. J. (1989). Nonparametric policy analysis. J. Amer. Statist. Assoc. 89 567--575.
Mathematical Reviews (MathSciNet): MR1010347
Xia, Y. C. and Li, W. K. (1999). On the estimation and testing of functional-coefficient linear models. Statist. Sinica 9 735--758.
Mathematical Reviews (MathSciNet): MR1711643
Zentralblatt MATH: 0958.62040
Xia, Y. C. and Li, W. K. (2002). Asymptotic behavior of bandwidth selected by the cross-validation method for local polynomial fitting. J. Multivariate Anal. 83 265--287.
Mathematical Reviews (MathSciNet): MR1945954
Digital Object Identifier: doi:10.1006/jmva.2001.2048
Zentralblatt MATH: 1025.62016
Zhang, W., Lee, S.-Y. and Song, X. (2002). Local polynomial fitting in semivarying coefficient models. J. Multivariate Anal. 82 166--188.
Mathematical Reviews (MathSciNet): MR1918619
Digital Object Identifier: doi:10.1006/jmva.2001.2012
Zentralblatt MATH: 0995.62038
Zhou, S., Shen, X. and Wolfe, D. A. (1998). Local asymptotics for regression splines and confidence regions. Ann. Statist. 26 1760--1782.
Mathematical Reviews (MathSciNet): MR1673277
Digital Object Identifier: doi:10.1214/aos/1024691356
Project Euclid: euclid.aos/1024691356
Zentralblatt MATH: 0929.62052

2012 © Institute of Mathematical Statistics

The Annals of Statistics

The Annals of Statistics