Limit Processes for Sequences of Partial Sums of Regression Residuals

Abstract

Linear regression of a random variable against several functions of time is considered. Limit processes are obtained for the sequences of partial sums of residuals. The limit processes, which are functions of Brownian motion, have covariance kernels of the form: $$K(s, t) = \min (s,t) - \int^t_0 \int^s_0 g(x, y) dx dy.$$ The limit process and its covariance kernel are explicitly stated for each of polynomial and harmonic regression.