Model selection using a penalized data-splitting device is studied in the context of nonparametric regression. Finite sample bounds under mild conditions are obtained. The resulting estimates are adaptive for large classes of functions.
"Model selection in nonparametric regression." Ann. Statist. 31 (1) 252 - 273, Februrary 2003. https://doi.org/10.1214/aos/1046294464