Electronic Journal of Statistics
- Electron. J. Statist.
- Volume 9, Number 1 (2015), 1540-1561.
Oracally efficient estimation for single-index link function with simultaneous confidence band
Lijie Gu and Lijian Yang
Full-text: Open access
Abstract
Over the last twenty-five years, various $\sqrt{n}$-consistent estimators have been devised for the coefficient vector in the popular semiparametric single-index model. In this paper, we prove under general assumptions that the kernel estimator of the link function by a univariate regression on the index variable is oracally efficient, namely, the estimator with the true single-index coefficient vector is asymptotically indistinguishable from that with any $\sqrt{n}$-consistent coefficient vector estimator. As a mathematical byproduct of the oracle efficiency, a simultaneous confidence band is constructed for the link function based on the oracally efficient kernel estimator. Simulation experiments corroborate the theoretical results. The proposed simultaneous confidence band is applied to analyze and test hypothesis about the Boston housing data.
Article information
Source
Electron. J. Statist. Volume 9, Number 1 (2015), 1540-1561.
Dates
Received: January 2015
First available in Project Euclid: 23 July 2015
Permanent link to this document
https://projecteuclid.org/euclid.ejs/1437658702
Digital Object Identifier
doi:10.1214/15-EJS1051
Mathematical Reviews number (MathSciNet)
MR3376116
Zentralblatt MATH identifier
1327.62254
Subjects
Primary: 62G08: Nonparametric regression
Secondary: 62G15: Tolerance and confidence regions
Keywords
Confidence band kernel link function oracle efficiency single-index
Citation
Gu, Lijie; Yang, Lijian. Oracally efficient estimation for single-index link function with simultaneous confidence band. Electron. J. Statist. 9 (2015), no. 1, 1540--1561. doi:10.1214/15-EJS1051. https://projecteuclid.org/euclid.ejs/1437658702.
References
- [1] Bosq, D. (1998)., Nonparametric Statistics for Stochastic Processes. Springer-Verlag, New York.Mathematical Reviews (MathSciNet): MR1640691
- [2] Breiman, L. and Friedman, J. H. (1985). Estimating optimal transformations of multiple regression and correlation., J. Amer. Statist. Assoc. 80 580–619.Mathematical Reviews (MathSciNet): MR803258
Zentralblatt MATH: 0594.62044
Digital Object Identifier: doi:10.1080/01621459.1985.10478157 - [3] Carroll, R., Fan, J., Gijbels, I. and Wand, M. P. (1997). Generalized partially linear single-index models., J. Amer. Statist. Assoc. 92 477–489.Mathematical Reviews (MathSciNet): MR1467842
Zentralblatt MATH: 0890.62053
Digital Object Identifier: doi:10.1080/01621459.1997.10474001 - [4] Chen, H. (1991). Estimation of a projection-pursuit type regression model., Ann. Statist. 19 142–157.Mathematical Reviews (MathSciNet): MR1091843
Zentralblatt MATH: 0736.62055
Digital Object Identifier: doi:10.1214/aos/1176347974
Project Euclid: euclid.aos/1176347974 - [5] Fan, J. and Gijbels, I. (1996)., Local Polynomial Modelling and Its Applications. Chapman and Hall, London.
- [6] Friedman, J. H. and Stuetzle, W. (1981). Projection pursuit regression., J. Amer. Statist. Assoc. 76 817–823.Mathematical Reviews (MathSciNet): MR650892
Digital Object Identifier: doi:10.1080/01621459.1981.10477729 - [7] Gordon, J. J. (1982). Probabilities of maximal deviations for nonparametric regression function estimates., J. Multivariate Anal. 12 402–414.Mathematical Reviews (MathSciNet): MR666014
Zentralblatt MATH: 0497.62038
Digital Object Identifier: doi:10.1016/0047-259X(82)90074-4 - [8] Harrison, D. and Rubinfeld, D. L. (1978). Hedonic housing prices and the demand for cleaning air., J. Environ. Econ. Manag. 5 81–102.
- [9] Härdle, W. (1989). Asymptotic maximal deviation of M-smoothers., J. Multivariate Anal. 29 163–179.Mathematical Reviews (MathSciNet): MR1004333
Digital Object Identifier: doi:10.1016/0047-259X(89)90022-5 - [10] Härdle, W., Liang, H. and Gao, J. (2000)., Partially Linear Models. Physica-Verlag, Heidelberg.Mathematical Reviews (MathSciNet): MR1787637
- [11] Härdle, W., Hall, P. and Ichimura, H. (1993). Optimal smoothing in single-index models., Ann. Statist. 21 157–178.Mathematical Reviews (MathSciNet): MR1212171
Zentralblatt MATH: 0770.62049
Digital Object Identifier: doi:10.1214/aos/1176349020
Project Euclid: euclid.aos/1176349020 - [12] Härdle, W. and Stoker, T. M. (1989). Investigating smooth multiple regression by the method of average derivatives., J. Amer. Statist. Assoc. 84 986–995.
- [13] Härdle, W., Müller, M., Sperlich, S. and Werwatz, A. (2004)., Nonparametric and Semiparametric Models. Springer-Verlag, New York.Mathematical Reviews (MathSciNet): MR2061786
- [14] Hall, P. (1989). On projection pursuit regression., Ann. Statist. 17 573–588.Mathematical Reviews (MathSciNet): MR994251
Zentralblatt MATH: 0698.62041
Digital Object Identifier: doi:10.1214/aos/1176347126
Project Euclid: euclid.aos/1176347126 - [15] Hall, P. and Van Keilegom, I. (2003). Using difference-based methods for inference in nonparametric regression with time series errors., J. R. Stat. Soc. Ser. B Stat. Methodol. 65 443–456.Mathematical Reviews (MathSciNet): MR1983757
Zentralblatt MATH: 1065.62067
Digital Object Identifier: doi:10.1111/1467-9868.00395 - [16] Hastie, T. J. and Tibshirani, R. J. (1990)., Generalized Additive Models. Chapman and Hall, London.Mathematical Reviews (MathSciNet): MR1082147
- [17] Horowitz, J. L. and Härdle, W. (1996). Direct semiparametric estimation of single-index models with discrete covariates., J. Amer. Statist. Assoc. 91 1632–1640.Mathematical Reviews (MathSciNet): MR1439104
Zentralblatt MATH: 0881.62037
Digital Object Identifier: doi:10.1080/01621459.1996.10476732 - [18] Huang, J. and Yang, L. (2004). Identification of nonlinear additive autoregressive models., J. R. Stat. Soc. Ser. B Stat. Methodol. 66 463–477.Mathematical Reviews (MathSciNet): MR2062388
Digital Object Identifier: doi:10.1111/j.1369-7412.2004.05500.x - [19] Huber, P. J. (1985). Projection pursuit (with discussion)., Ann. Statist. 13 435–525.Mathematical Reviews (MathSciNet): MR790553
Zentralblatt MATH: 0595.62059
Digital Object Identifier: doi:10.1214/aos/1176349519
Project Euclid: euclid.aos/1176349519 - [20] Ichimura, H. (1993). Semiparametric least squares (SLS) and weighted SLS estimation of single-index models., J. Econometrics 58 71–120.Mathematical Reviews (MathSciNet): MR1230981
Zentralblatt MATH: 0816.62079
Digital Object Identifier: doi:10.1016/0304-4076(93)90114-K - [21] Jiang, R., Zhou, Z. G., Qian, W. M. and Chen, Y. (2013). Two step composite quantile regression for single-index models., Comput. Statist. Data Anal. 64 180–191.Mathematical Reviews (MathSciNet): MR3061897
- [22] Klein, R. W. and Spady. R. H. (1993). An efficient semiparametric estimator for binary response models., Econometrica 61 387–421.
- [23] Krivobokova, T., Kneib, T. and Claeskens, G. (2010). Simultaneous confidence bands for penalized spline estimators., J. Amer. Statist. Assoc. 105 852–863.Mathematical Reviews (MathSciNet): MR2724866
Zentralblatt MATH: 0667.62028
Digital Object Identifier: doi:10.1198/jasa.2010.tm09165 - [24] Linton, O. B. (1997). Efficient estimation of additive nonparametric regression models., Biometrika 84 469–473.Mathematical Reviews (MathSciNet): MR1467061
Zentralblatt MATH: 0882.62038
Digital Object Identifier: doi:10.1093/biomet/84.2.469 - [25] Liu, R. and Yang, L. (2010). Spline-backfitted kernel smoothing of additive coefficient model., Econometric Theory 26 29–59.Mathematical Reviews (MathSciNet): MR2587102
Zentralblatt MATH: 1186.62134
Digital Object Identifier: doi:10.1017/S0266466609090604 - [26] Liu, R., Yang, L. and Härdle, W. (2013). Oracally efficient two-step estimation of generalized additive model., J. Amer. Statist. Assoc. 108 619–631.Mathematical Reviews (MathSciNet): MR3174646
Zentralblatt MATH: 06195965
Digital Object Identifier: doi:10.1080/01621459.2013.763726 - [27] Mammen, E., Linton, O. and Nielsen, J. (1999). The existence and asymptotic properties of a backfitting projection algorithm under weak conditions., Ann. Statist. 27 1443–1490.Mathematical Reviews (MathSciNet): MR1742496
Zentralblatt MATH: 0986.62028
Project Euclid: euclid.aos/1017939138 - [28] Ma, S. and Yang, L. (2011). Spline-backfitted kernel smoothing of partially linear additive model., J. Statist. Plann. Inference 141 204–219.Mathematical Reviews (MathSciNet): MR2719488
Zentralblatt MATH: 1197.62130
Digital Object Identifier: doi:10.1016/j.jspi.2010.05.028 - [29] Ma, S., Yang, L. and Carroll, R. (2012). A simultaneous confidence band for sparse longitudinal regression., Statist. Sinica. 22 95–122.
- [30] Ma, S., Liang, H. and Tsai, C.L. (2014a). Partially linear single index models for repeated measurements., J. Multivariate Anal. 130 354–375.Mathematical Reviews (MathSciNet): MR3229543
Zentralblatt MATH: 1292.62060
Digital Object Identifier: doi:10.1016/j.jmva.2014.06.011 - [31] Ma, S., Zhang, J., Sun, Z. and Liang, H. (2014b). Integrated conditional moment test for partially linear single index models incorporating dimension-reduction., Elect. J. Statist. 8 523–542.Mathematical Reviews (MathSciNet): MR3205732
Zentralblatt MATH: 06299071
Digital Object Identifier: doi:10.1214/14-EJS893
Project Euclid: euclid.ejs/1399901043 - [32] Opsomer, J. D. and Ruppert, D. (1998). A fully automated bandwidth selection method for fitting additive models., J. Amer. Statist. Assoc. 93 605–619.Mathematical Reviews (MathSciNet): MR1631333
Zentralblatt MATH: 0953.62034
Digital Object Identifier: doi:10.1080/01621459.1998.10473714 - [33] Powell, J. L., Stock, J. H. and Stoker, T. M. (1989). Semiparametric estimation of index coefficients., Econometrica. 57 1403–1430.
- [34] Silverman, B. W. (1986)., Density Estimation. Chapman and Hall, London.Mathematical Reviews (MathSciNet): MR848134
- [35] Sperlich, S., Härdle, W. and Spokoiny, V. (1997). Semiparametric single index versus fixed link function modelling., Ann. Statist. 25 212–243.Mathematical Reviews (MathSciNet): MR1429923
Zentralblatt MATH: 0869.62033
Digital Object Identifier: doi:10.1214/aos/1034276627
Project Euclid: euclid.aos/1034276627 - [36] Wang, J., Liu, R., Cheng, F. and Yang, L. (2014). Oracally efficient estimation of autoregressive error distribution with simultaneous confidence band., Ann. Statist. 42 654–668.Mathematical Reviews (MathSciNet): MR3210982
Zentralblatt MATH: 06312905
Digital Object Identifier: doi:10.1214/13-AOS1197
Project Euclid: euclid.aos/1400592173 - [37] Wang, J. and Yang, L. (2009a). Efficient and fast spline-backfitted kernel smoothing of additive models., Ann. Inst. Stat. Math. 61 663–690.Mathematical Reviews (MathSciNet): MR2529970
Zentralblatt MATH: 05603804
Digital Object Identifier: doi:10.1007/s10463-007-0157-x - [38] Wang, L. and Yang, L. (2007). Spline-backfitted kernel smoothing of nonlinear additive autoregression model., Ann. Statist. 35 2474–2503.Mathematical Reviews (MathSciNet): MR2382655
Zentralblatt MATH: 1129.62038
Digital Object Identifier: doi:10.1214/009053607000000488
Project Euclid: euclid.aos/1201012969 - [39] Wang, L. and Yang, L. (2009b). Spline estimation of single index model., Statist. Sinica. 19 765–783.
- [40] Wu, T. Z., Yu, K. and Yu, Y. (2010). Single-index quantile regression., J. Multivariate Anal. 101 1607–1621.Mathematical Reviews (MathSciNet): MR2610735
Zentralblatt MATH: 1189.62075
Digital Object Identifier: doi:10.1016/j.jmva.2010.02.003 - [41] Xia, Y. (1998). Bias-corrected confidence bands in nonparametric regression., J. R. Stat. Soc. Ser. B Stat. Methodol. 60 797–811.Mathematical Reviews (MathSciNet): MR1649488
Zentralblatt MATH: 0909.62043
Digital Object Identifier: doi:10.1111/1467-9868.00155 - [42] Xia, Y. and Li, W. K. (1999). On single-index coefficient regression models., J. Amer. Statist. Assoc. 94 1275–1285.Mathematical Reviews (MathSciNet): MR1731489
Zentralblatt MATH: 1069.62548
Digital Object Identifier: doi:10.1080/01621459.1999.10473880 - [43] Xia, Y., Li, W. K., Tong, H. and Zhang, D. (2004). A goodness-of-fit test for single-index models., Statist. Sinica. 14 1–39.
- [44] Xue, L. and Yang, L. (2006a). Estimation of semiparametric additive coefficient model., J. Statist. Plann. Inference 136 2506–2534.
- [45] Xue, L. and Yang, L. (2006b). Additive coefficient modeling via polynomial spline., Statist. Sinica. 16 1423–1446.
- [46] Yu, K. and Lu, Z. (2004). Local linear additive quantile regression., Scand. J. Statist. 31 333–346.Mathematical Reviews (MathSciNet): MR2087829
Digital Object Identifier: doi:10.1111/j.1467-9469.2004.03_035.x - [47] Zheng, S., Yang, L. and Härdle, W. (2014). A smooth simultaneous confidence corridor for the mean of sparse functional data., J. Amer. Statist. Assoc. 109 661–673.Mathematical Reviews (MathSciNet): MR3223741
Zentralblatt MATH: 0617.62042
Digital Object Identifier: doi:10.1080/01621459.2013.866899 - [48] Zhu, H., Li, R. and Kong, L. (2012). Multivariate varying coefficient model for functional responses., Ann. Statist. 40 2634–2666.Mathematical Reviews (MathSciNet): MR3097615
Zentralblatt MATH: 06344388
Digital Object Identifier: doi:10.1214/12-AOS1045
Project Euclid: euclid.aos/1359987533
The Institute of Mathematical Statistics and the Bernoulli Society
- You have access to this content.
- You have partial access to this content.
- You do not have access to this content.
More like this
- Oracally efficient estimation of autoregressive error distribution with simultaneous confidence band
Wang, Jiangyan, Liu, Rong, Cheng, Fuxia, and Yang, Lijian, The Annals of Statistics, 2014 - Estimation and testing for partially linear single-index models
Liang, Hua, Liu, Xiang, Li, Runze, and Tsai, Chih-Ling, The Annals of Statistics, 2010 - Adaptive estimation under single-index constraint in a regression model
Lepski, Oleg and Serdyukova, Nora, The Annals of Statistics, 2014
- Oracally efficient estimation of autoregressive error distribution with simultaneous confidence band
Wang, Jiangyan, Liu, Rong, Cheng, Fuxia, and Yang, Lijian, The Annals of Statistics, 2014 - Estimation and testing for partially linear single-index models
Liang, Hua, Liu, Xiang, Li, Runze, and Tsai, Chih-Ling, The Annals of Statistics, 2010 - Adaptive estimation under single-index constraint in a regression model
Lepski, Oleg and Serdyukova, Nora, The Annals of Statistics, 2014 - Direct estimation of the index coefficient in a single-index
model
Hristache, Marian, Juditsky, Anatoli, and Spokoiny, Vladimir, The Annals of Statistics, 2001 - Simultaneous confidence bands for derivatives of dependent functional data
Cao, Guanqun, Electronic Journal of Statistics, 2014 - Optimal Smoothing in Single-Index Models
Hardle, Wolfgang, Hall, Peter, and Ichimura, Hidehiko, The Annals of Statistics, 1993 - Efficient estimation in the semiparametric normal regression-copula model with a focus on QTL mapping
Basrak, Bojan and Klaassen, Chris A. J., From Probability to Statistics and Back: High-Dimensional Models and Processes -- A Festschrift in Honor of Jon A. Wellner, 2013 - On average derivative quantile regression
Chaudhuri, Probal, Doksum, Kjell, and Samarov, Alexander, The Annals of Statistics, 1997 - Estimation for a partial-linear single-index model
Wang, Jane-Ling, Xue, Liugen, Zhu, Lixing, and Chong, Yun Sam, The Annals of Statistics, 2010 - Estimation and inference of error-prone covariate effect in the presence of confounding variables
Liu, Jianxuan, Ma, Yanyuan, Zhu, Liping, and Carroll, Raymond J., Electronic Journal of Statistics, 2017