The Annals of Statistics

Local quasi-likelihood with a parametric guide

Jianqing Fan, Yichao Wu, and Yang Feng

Source: Ann. Statist. Volume 37, Number 6B (2009), 4153-4183.

Abstract

Generalized linear models and the quasi-likelihood method extend the ordinary regression models to accommodate more general conditional distributions of the response. Nonparametric methods need no explicit parametric specification, and the resulting model is completely determined by the data themselves. However, nonparametric estimation schemes generally have a slower convergence rate such as the local polynomial smoothing estimation of nonparametric generalized linear models studied in Fan, Heckman and Wand [J. Amer. Statist. Assoc. 90 (1995) 141–150]. In this work, we propose a unified family of parametrically-guided nonparametric estimation schemes. This combines the merits of both parametric and nonparametric approaches and enables us to incorporate prior knowledge. Asymptotic results and numerical simulations demonstrate the improvement of our new estimation schemes over the original nonparametric counterpart.

Primary Subjects: 62G08
Secondary Subjects: 62G20
Keywords: Generalized linear model; local polynomial smoothing; parametric guide; quasi-likelihood method

Full-text: Access denied (no subscription detected)

We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber.
If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription. Read more about accessing full-text
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aos/1256303540
Digital Object Identifier: doi:10.1214/09-AOS713
Zentralblatt MATH identifier: 05644269

References

Cheng, M.-Y. and Hall, P. (2003). Reducing variance in nonparametric surface estimation. J. Multivariate Anal. 86 375–397.
Mathematical Reviews (MathSciNet): MR1997770
Zentralblatt MATH: 1018.62026
Digital Object Identifier: doi:10.1016/S0047-259X(02)00032-5
Cheng, M.-Y., Peng, L. and Wu, J.-S. (2007). Reducing variance in univariate smoothing. Ann. Statist. 35 522–542.
Mathematical Reviews (MathSciNet): MR2336858
Zentralblatt MATH: 1117.62038
Digital Object Identifier: doi:10.1214/009053606000001398
Project Euclid: euclid.aos/1183667283
Cox, D. D. and O’Sullivan, F. (1990). Asymptotic analysis of penalized likelihood and related estimators. Ann. Statist. 18 1676–1695.
Mathematical Reviews (MathSciNet): MR1074429
Zentralblatt MATH: 0719.62051
Digital Object Identifier: doi:10.1214/aos/1176347872
Project Euclid: euclid.aos/1176347872
Fan, J. (1993). Local linear regression smoothers and their minimax efficiency. Ann. Statist. 21 196–216.
Mathematical Reviews (MathSciNet): MR1212173
Zentralblatt MATH: 0773.62029
Digital Object Identifier: doi:10.1214/aos/1176349022
Project Euclid: euclid.aos/1176349022
Fan, J., Farmen, M. and Gijbels, I. (1998). Local maximum likelihood estimation and inference. J. R. Stat. Soc. Ser. B Stat. Methodol. 60 591–608.
Mathematical Reviews (MathSciNet): MR1626013
Zentralblatt MATH: 0909.62036
Digital Object Identifier: doi:10.1111/1467-9868.00142
Fan, J. and Gijbels, I. (1995). Data-driven bandwidth selection in local polynomial fitting: Variable bandwidth and spatial adaptation. J. R. Stat. Soc. Ser. B Stat. Methodol. 57 371–394.
Mathematical Reviews (MathSciNet): MR1323345
Fan, J., Heckman, N. E. and Wand, M. P. (1995). Local polynomial kernel regression for generalized linear models and quasi-likelihood functions. J. Amer. Statist. Assoc. 90 141–150.
Mathematical Reviews (MathSciNet): MR1325121
Zentralblatt MATH: 0818.62036
Digital Object Identifier: doi:10.2307/2291137
Gasser, T., Müller, H.-G. and Mammitzsch, V. (1985). Kernels for nonparametric curve estimation. J. Roy. Statist. Soc. Ser. B 47 238–252.
Glad, I. K. (1998). Parametrically guided non-parametric regression. Scand. J. Statist. 25 649–668.
Mathematical Reviews (MathSciNet): MR1666776
Digital Object Identifier: doi:10.1111/1467-9469.00127
Green, P. J. and Yandell, B. S. (1985). Semiparametric generalized linear models. In Lecture Notes in Statistics 32 44–55. Springer, Berlin.
Mathematical Reviews (MathSciNet): MR824535
Zentralblatt MATH: 0832.62032
Hjort, N. L. and Glad, I. K. (1995). Nonparametric density estimation with a parametric start. Ann. Statist. 23 882–904.
Mathematical Reviews (MathSciNet): MR1345205
Zentralblatt MATH: 0838.62027
Digital Object Identifier: doi:10.1214/aos/1176324627
Project Euclid: euclid.aos/1176324627
Huang, L.-S. and Fan, J. (1999). Nonparametric estimation of quadratic regression functionals. Bernoulli 5 927–949.
Mathematical Reviews (MathSciNet): MR1715445
Digital Object Identifier: doi:10.2307/3318450
Project Euclid: euclid.bj/1171290405
Hurvich, C. M. and Tsai, C.-L. (1995). Model selection for extended quasi-likelihood models in small samples. Biometrics 51 1077–1084.
Martins-Filho, C., Mishra, S. and Ullah, A. (2008). A class of improved parametrically guided nonparametric regression estimators. Econometric Rev. 27 542–573.
Mathematical Reviews (MathSciNet): MR2439867
Zentralblatt MATH: 1140.62034
Digital Object Identifier: doi:10.1080/07474930801960444
McCullagh, P. and Nelder, J. A. (1989). Generalized Linear Models, 2nd ed. Chapman & Hall, London.
Mathematical Reviews (MathSciNet): MR727836
Naito, K. (2004). Semiparametric density estimation by local L2-fitting. Ann. Statist. 32 1162–1191.
Mathematical Reviews (MathSciNet): MR2065201
Zentralblatt MATH: 1091.62023
Digital Object Identifier: doi:10.1214/009053604000000319
Project Euclid: euclid.aos/1085408498
Nelder, J. A. and Wedderburn, R. W. M. (1972). Generalized linear models. J. Roy. Statist. Soc. Ser. A 135 370–384.
O’Sullivan, F., Yandell, B. and Raynor, W. (1986). Automatic smoothing of regression functions in generalized linear models. J. Amer. Statist. Assoc. 81 96–103.
Mathematical Reviews (MathSciNet): MR830570
Digital Object Identifier: doi:10.2307/2287973
Staniswalis, J. G. (1989). The kernel estimate of a regression function in likelihood-based models. J. Amer. Statist. Assoc. 84 276–283.
Mathematical Reviews (MathSciNet): MR999689
Zentralblatt MATH: 0721.62039
Digital Object Identifier: doi:10.2307/2289874
Stone, C. J. (1975). Nearest neighbor estimators of a nonlinear regression function. In Proc. Computer Science and Statistics, 8th Annual Symposium on the Interface 413–418. Health Sciences Computer Facility, UCLA.
Stone, C. J. (1977). Consistent nonparametric regression, with discussion. Ann. Statist. 5 549–645.
Mathematical Reviews (MathSciNet): MR443204
Zentralblatt MATH: 0366.62051
Digital Object Identifier: doi:10.1214/aos/1176343886
Project Euclid: euclid.aos/1176343886
Tibshirani, R. and Hastie, T. (1987). Local likelihood estimation. J. Amer. Statist. Assoc. 82 559–568.
Mathematical Reviews (MathSciNet): MR898359
Zentralblatt MATH: 0626.62041
Digital Object Identifier: doi:10.2307/2289465
Wedderburn, R. W. M. (1974). Quasi-likelihood functions, generalized linear models, and the gauss-Newton method. Biometrika 61 439–447.
Mathematical Reviews (MathSciNet): MR375592
Zentralblatt MATH: 0292.62050
White, H. (1982). Maximum likelihood estimation of misspecified models. Econometrica 50 1–25.
Mathematical Reviews (MathSciNet): MR640163
Digital Object Identifier: doi:10.2307/1912526

2010 © Institute of Mathematical Statistics