A `skewing' method is shown to effectively reduce the order of bias of locally parametric estimators, and at the same time retain positivity properties. The technique involves first calculating the usual locally parametric approximation in the neighbourhood of a point x' that is a short distance from the place x where the we wish to estimate the density, and then evaluating this approximation at x. By way of comparison, the usual locally parametric approach takes x'=x. In our construction, x'-x depends in a very simple way on the bandwidth and the kernel, and not at all on the unknown density. Using skewing in this simple form reduces the order of bias from the square to the cube of bandwidth; and taking the average of two estimators computed in this way further reduces bias, to the fourth power of bandwidth. On the other hand, variance increases only by at most a moderate constant factor.
"Skewing methods for two-parameter locally parametric density estimation." Bernoulli 6 (1) 169 - 182, Feb 2000.