• Bernoulli
  • Volume 16, Number 3 (2010), 705-729.

Functional linear regression via canonical analysis

Guozhong He, Hans-Georg Müller, Jane-Ling Wang, and Wenjing Yang

Full-text: Open access


We study regression models for the situation where both dependent and independent variables are square-integrable stochastic processes. Questions concerning the definition and existence of the corresponding functional linear regression models and some basic properties are explored for this situation. We derive a representation of the regression parameter function in terms of the canonical components of the processes involved. This representation establishes a connection between functional regression and functional canonical analysis and suggests alternative approaches for the implementation of functional linear regression analysis. A specific procedure for the estimation of the regression parameter function using canonical expansions is proposed and compared with an established functional principal component regression approach. As an example of an application, we present an analysis of mortality data for cohorts of medflies, obtained in experimental studies of aging and longevity.

Article information

Bernoulli, Volume 16, Number 3 (2010), 705-729.

First available in Project Euclid: 6 August 2010

Permanent link to this document

Digital Object Identifier

Mathematical Reviews number (MathSciNet)

Zentralblatt MATH identifier

canonical components covariance operator functional data analysis functional linear model longitudinal data parameter function stochastic process


He, Guozhong; Müller, Hans-Georg; Wang, Jane-Ling; Yang, Wenjing. Functional linear regression via canonical analysis. Bernoulli 16 (2010), no. 3, 705--729. doi:10.3150/09-BEJ228.

Export citation


  • Ash, R.B. and Gardner, M.F. (1975)., Topics in Stochastic Processes. New York: Academic Press.
  • Brillinger, D.R. (1985)., Time Series: Data Analysis and Theory, 2nd ed. Holden Day: San Francisco.
  • Cardot, H. and Sarda, P. (2005). Estimation in generalized linear models for functional data via penalized likelihood., J. Multivariate Anal. 92 24–41.
  • Carey, J.R., Liedo, P., Orozco, D. and Vaupel, J.W. (2002). Slowing of mortality rates at older ages in large medfly cohorts., Science 258 457–461.
  • Chiou, J.M., Müller, H.G. and Wang, J.L. (2003). Functional quasi-likelihood regression models with smooth random effects., J. Roy. Statist. Soc. Ser. B 65 405–423.
  • Conway, J.B. (1985)., A Course in Functional Analysis. New York: Springer.
  • Cupidon, J., Gilliam, D.S., Eubank, R. and Ruymgaart, F. (2007). The delta method for analytic functions of random operators with application to functional data., Bernoulli 13 1179–1194.
  • Eubank, R. and Hsing, T. (2008). Canonical correlation for stochastic processes., Stochastic Process. Appl. 118 1634–1661.
  • Fan, J. and Gijbels, I. (1996)., Local Polynomial Modelling and Its Applications. London: Chapman and Hall.
  • Fan, J. and Zhang, J.T. (2000). Two-step estimation of functional linear models with applications to longitudinal data., J. Roy. Statist. Soc. Ser. B 62 303–322.
  • Faraway, J.J. (1997). Regression analysis for a functional response., Technometrics 39 254–262.
  • Hall, P. and Horowitz, J. (2007). Methodology and convergence rates for functional linear regression., Ann. Statist. 35 70–91.
  • Hannan, E.J. (1961). The general theory of canonical correlation and its relation to functional analysis., J. Aust. Math. Soc. 2 229–242.
  • He, G., Müller, H.G. and Wang, J.L. (2003). Functional canonical analysis for square integrable stochastic processes., J. Multivariate Anal. 85 54–77.
  • He, G., Müller, H.G. and Wang, J.L. (2004). Methods of canonical analysis for functional data., J. Statist. Plann. Inference 122 141–159.
  • Hoover, D.R., Rice, J., Wu, C.O. and Yang, L. (1998). Nonparametric smoothing estimates of time varying coefficient models with longitudinal data., Biometrika 85 809–740.
  • Hotelling, H. (1936). Relations between two sets of variates., Biometrika 28 321–377.
  • Leurgans, S.E., Moyeed, R.A. and Silverman, B.W. (1993). Canonical correlation analysis when the data are curves., J. Roy. Statist. Soc. Ser. B 55 725–740.
  • Müller, H.G. and Stadtmüller, U. (2005). Generalized functional linear models., Ann. Statist. 33 774–805.
  • Müller, H.G., Wang, J.L. and Capra, W.B. (1997a). From lifetables to hazard rates: The transformation approach., Biometrika 84 881–892.
  • Müller, H.G., Wang, J.L., Capra, W.B., Liedo, P. and Carey, J.R. (1997b). Early mortality surge in protein-deprived females causes reversal of sex differential of life expectancy in Mediterranean fruit flies., Proc. Natl. Acad. Sci. USA 94 2762–2765.
  • Ramsay, J. and Dalzell, C.J. (1991). Some tools for functional data analysis., J. Roy. Statist. Soc. Ser. B 53 539–572.
  • Ramsay, J. and Silverman, B. (2005)., Functional Data Analysis. New York: Springer.
  • Rice, J. and Silverman, B. (1991). Estimating the mean and covariance structure nonparametrically when the data are curves., J. Roy. Statist. Soc. Ser. B 53 233–243.
  • Rice, J. and Wu, C.O. (2000). Nonparametric mixed effects models for unequally sampled noisy curves., Biometrics 57 253–259.
  • Ritz, C. and Streibig, J.C. (2009). Functional regression analysis of fluorescence curves., Biometrics 65 609–617.
  • Shi, M., Weiss, R.E. and Taylor, J.M.G. (1996). An analysis of paediatric CD4 counts for Acquired Immune Deficiency Syndrome using flexible random curves., Appl. Statist. 45 151–163.
  • Yao, F., Müller, H.G., Wang, J.L. (2005a). Functional data analysis for sparse longitudinal data., J. Amer. Statist. Assoc. 100 577–590.
  • Yao, F., Müller, H.G. and Wang, J.L. (2005b). Functional linear regression analysis for longitudinal data., Ann. Statist. 33 2873–2903.