A Law of the Iterated Logarithm for Nonparametric Regression Function Estimators

Abstract

We study the estimation of a regression function by two classes of estimators, the Nadaraya-Watson Kernel type estimators and the orthogonal polynomial estimators. We obtain sharp pointwise rates of strong consistency by establishing laws of the iterated logarithm for the two classes of estimators. These results parallel those of Hall (1981) on density estimation and extend those of Noda (1976) on strong consistency of kernel regression estimators.