Uniform in bandwidth consistency of kernel regression estimators at a fixed point

Abstract

We consider pointwise consistency properties of kernel regression function type estimators where the bandwidth sequence is not necessarily deterministic. In some recent papers uniform convergence rates over compact sets have been derived for such estimators via empirical process theory. We now show that it is possible to get optimal results in the pointwise case as well. The main new tool for the present work is a general moment bound for empirical processes which may be of independent interest.