The Annals of Statistics

Covariate-adjusted nonlinear regression

Xia Cui, Wensheng Guo, Lu Lin, and Lixing Zhu

Full-text: Open access


In this paper, we propose a covariate-adjusted nonlinear regression model. In this model, both the response and predictors can only be observed after being distorted by some multiplicative factors. Because of nonlinearity, existing methods for the linear setting cannot be directly employed. To attack this problem, we propose estimating the distorting functions by nonparametrically regressing the predictors and response on the distorting covariate; then, nonlinear least squares estimators for the parameters are obtained using the estimated response and predictors. Root n-consistency and asymptotic normality are established. However, the limiting variance has a very complex structure with several unknown components, and confidence regions based on normal approximation are not efficient. Empirical likelihood-based confidence regions are proposed, and their accuracy is also verified due to its self-scale invariance. Furthermore, unlike the common results derived from the profile methods, even when plug-in estimates are used for the infinite-dimensional nuisance parameters (distorting functions), the limit of empirical likelihood ratio is still chi-squared distributed. This property eases the construction of the empirical likelihood-based confidence regions. A simulation study is carried out to assess the finite sample performance of the proposed estimators and confidence regions. We apply our method to study the relationship between glomerular filtration rate and serum creatinine.

Article information

Ann. Statist., Volume 37, Number 4 (2009), 1839-1870.

First available in Project Euclid: 18 June 2009

Permanent link to this document

Digital Object Identifier

Mathematical Reviews number (MathSciNet)

Zentralblatt MATH identifier

Primary: 62J05: Linear regression 62G08: Nonparametric regression 62G20: Asymptotic properties

Asymptotic behavior confidence region covariate-adjusted regression empirical likelihood kernel estimation nonlinear least squares


Cui, Xia; Guo, Wensheng; Lin, Lu; Zhu, Lixing. Covariate-adjusted nonlinear regression. Ann. Statist. 37 (2009), no. 4, 1839--1870. doi:10.1214/08-AOS627.

Export citation


  • Andrew, D. R., Timothy, S. L., Erik, J. B., Jeff, M. S., Steven, J. J. and Fernando, G. C. (2004). Using serum creatinine to estimate glomerular filtration rate: Accuracy in good health and in chronic kidney disease. Ann. Intern. Med. 141 929–937.
  • Eagleson, G. K. and Müller, H. G. (1997). Transformations for smooth regression models with multiplicative errors. J. Roy. Statist. Soc. Ser. B 59 173–189.
  • Fan, J. Q., Lin, H. Z. and Zhou, Y. (2006). Local partial-likelihood for lifetime data. Ann. Statist. 34 290–325.
  • Fan, J. and Zhang, J. (2000). Two-step estimation of functional linear models with applications to longitudinal data. J. R. Stat. Soc. Ser. B Stat. Methodol. 62 303–322.
  • Hall, P. and La Scala, B. (1990). Methodology and algorithms of empirical likelihood. Int. Statist. Rev. 58 109–127.
  • Härdle, W. and Stoker, T. M. (1989). Investigating smooth multiple regression by the method of average derivatives. J. Amer. Statist. Assoc. 84 986–995.
  • Levey, A. S., Adler, S., Beck, G. J. et al. (1994). The effects of dietary protein restriction and blood pressure control on the progression of renal disease. N. Engl. J. Med. 330 877–884.
  • Levey, A. S. et al. for the MDRD group (1999). A more accurate method to estimate glomerular filtration rate from serum creatinine: A new prediction equation. Ann. Intern. Med. 130 461–470.
  • Ma, Y. C., Zuo, L., Chen, J. H. et al. (2006). Modified glomerular filtration rate estimating equation for chinese patients with chronic kidney disease. J. Am. Soc. Nephrol. 17 2937–2944.
  • Owen, A. B. (1990). Empirical likelihood ratio confidence regions. Ann. Statist. 18 90–120.
  • Owen, A. (1991). Empirical likelihood for linear models. Ann. Statist. 19 1725–1747.
  • Owen, A. B. (2001). Empirical Likelihood. Chapman & Hall, New York.
  • Prakasa Rao, B. L. S. (1983). Nonparametric Functional Estimation. Academic Press, New York.
  • Rosman, J. B., ter Wee, P. M., Meijer, S., Piers-Becht, T. P. M., Sluiter, W. J. and Donker, A. J. M. (1984). Prospective randomized trial of early protein restriction in chronic renal failure. Lancet 2 1291–1296.
  • Sentürk, D. and Müller, H. G. (2005). Covariate-adjusted regression. Biometrika 92 75–89.
  • Sentürk, D. and Müller, H. G. (2006). Inference for covariate-adjusted regression via varying coefficient models. Ann. Statist. 34 654–679.
  • Staniswalis, J. G. (2006). On fitting generalized nonlinear models with varying coefficients. Comput. Statist. Data Anal. 50 1818–1839.
  • Serfling, R. J. (1980). Approximation Theorems of Mathematical Statistics. Wiley, New York.
  • Wu, J. F. (1981). Asymptotic theory of nonlinear least squares estimation. Ann. Statist. 9 501–513.
  • Xue, L. G. and Zhu, L. X. (2007). Empirical likelihood for a varying coefficient model with longitudinal data. J. Amer. Statist. Assoc. 102 642–654.
  • Zhu, L. X. and Fang, K. T. (1996). Asymptotics for kernel estimate of sliced inverse regression. Ann. Statist. 24 1053–1068.
  • Zhu, L. X. and Xue, L. G. (2006). Empirical likelihood confidence regions in a partially linear single-index model. J. R. Stat. Soc. Ser. B Stat. Methodol. 68 549–570.