Abstract
Many statisticians have adopted compact differentiability since Reeds showed in 1976 that it holds (while Frechet differentiability fails) in the supremum (sup) norm on the real line for the inverse operator and for the composition operator $(F,G) \mapsto F \circ G$ with respect to $F$. However, these operators are Frechet differentiable with respect to $p$-variation norms, which for $p > 2$ share the good probabilistic properties of the sup norm, uniformly over all distributions on the line. The remainders in these differentiations are of order $\| \cdot \|^\gamma$ for $\gamma > 1$. In a range of cases $p$-variation norms give the largest possible values of $\gamma$ on spaces containing empirical distribution functions, for both the inverse and composition operators. Compact differentiability in the sup norm cannot provide such remainder bounds since, over some compact sets, differentiability holds arbitrarily slowly.
Citation
R. M. Dudley. "The Order of the Remainder in Derivatives of Composition and Inverse Operators for $p$-Variation Norms." Ann. Statist. 22 (1) 1 - 20, March, 1994. https://doi.org/10.1214/aos/1176325354
Information