A class of diffusions on the line is considered whose drifts are generalized functions (Schwartzian distributions). A probability measure is put on this space of drifts, giving a diffusion in a random environment. An invariance principle is then proven for the rescaled diffusion, generalizing a result of De Masi, Ferrari, Goldstein and the author.