The Annals of Statistics

Estimation of a k-monotone density: Limit distribution theory and the spline connection

Fadoua Balabdaoui and Jon A. Wellner
Source: Ann. Statist. Volume 35, Number 6 (2007), 2536-2564.

Abstract

We study the asymptotic behavior of the Maximum Likelihood and Least Squares Estimators of a k-monotone density g0 at a fixed point x0 when k>2. We find that the jth derivative of the estimators at x0 converges at the rate n−(kj)/(2k+1) for j=0, …, k−1. The limiting distribution depends on an almost surely uniquely defined stochastic process Hk that stays above (below) the k-fold integral of Brownian motion plus a deterministic drift when k is even (odd). Both the MLE and LSE are known to be splines of degree k−1 with simple knots. Establishing the order of the random gap τn+τn, where τn± denote two successive knots, is a key ingredient of the proof of the main results. We show that this “gap problem” can be solved if a conjecture about the upper bound on the error in a particular Hermite interpolation via odd-degree splines holds.

First Page: Show Hide
Primary Subjects: 62G05, 60G99
Secondary Subjects: 60G15, 62E20
Full-text: Open access
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aos/1201012971
Digital Object Identifier: doi:10.1214/009053607000000262
Mathematical Reviews number (MathSciNet): MR2382657
Zentralblatt MATH identifier: 1129.62019

References

Anevski, D. (2003). Estimating the derivative of a convex density. Statist. Neerlandica 57 245--257.
Mathematical Reviews (MathSciNet): MR2028914
Digital Object Identifier: doi:10.1111/1467-9574.00229
Zentralblatt MATH: 1090.62524
Balabdaoui, F. and Wellner, J. A. (2004). Estimation of a $k$-monotone density, Parts 1--3. Technical Reports 459--461, Dept. Statistics, Univ. Washington. Available at www.stat.washington.edu/www/research/reports/2004/.
Balabdaoui, F. and Wellner, J. A. (2005). Conjecture of error boundedness in a new Hermite interpolation problem via splines of odd-degree. Technical Report 480, Dept. Statistics, Univ. Washington. Available at www.stat.washington.edu/www/research/reports/2005/.
Balabdaoui, F. and Wellner, J. A. (2006). Estimation of a $k$-monotone density: Limit distribution theory and the spline connection, with complete proofs. Technical Report 503, Dept. Statistics, Univ. Washington. Available at www.stat.washington.edu/www/research/reports/2006/ and www.stochastik.math.uni-goettingen.de/research/.
Mathematical Reviews (MathSciNet): MR2382657
Digital Object Identifier: doi:10.1214/009053607000000262
Project Euclid: euclid.aos/1201012971
Zentralblatt MATH: 1129.62019
Bojanov, B. D., Hakopian, H. A. and Sahakian, A. A. (1993). Spline Functions and Multivariate Interpolations. Kluwer, Dordrecht.
Mathematical Reviews (MathSciNet): MR1244800
Zentralblatt MATH: 0772.41011
Davidian, M. and Gallant, A. R. (1992). Smooth nonparametric maximum likelihood estimation for population pharmacokinetics, with application to quinidine. J. Pharmacokinetics and Pharmacodynamics 20 529--556.
de Boor, C. (1973). The quasi-interpolant as a tool in elementary polynomial spline theory. In Approximation Theory (Austin, TX, 1973) 269--276. Academic Press, New York.
Mathematical Reviews (MathSciNet): MR0336159
Zentralblatt MATH: 0317.41007
de Boor, C. (1974). Bounding the error in spline interpolation. SIAM Rev. 16 531--544.
Mathematical Reviews (MathSciNet): MR0361531
Digital Object Identifier: doi:10.1137/1016085
Zentralblatt MATH: 0272.65006
DeVore, R. A. and Lorentz, G. G. (1993). Constructive Approximation. Springer, Berlin.
Mathematical Reviews (MathSciNet): MR1261635
Zentralblatt MATH: 0797.41016
Dudley, R. M. (1999). Uniform Central Limit Theorems. Cambridge Univ. Press.
Mathematical Reviews (MathSciNet): MR1720712
Zentralblatt MATH: 0951.60033
Feller, W. (1971). An Introduction to Probability Theory and Its Applications 2, 2nd ed. Wiley, New York.
Mathematical Reviews (MathSciNet): MR0270403
Gneiting, T. (1998). On the Bernstein--Hausdorff--Widder conditions for completely monotone functions. Exposition. Math. 16 181--183.
Mathematical Reviews (MathSciNet): MR1630703
Gneiting, T. (1999). Radial positive definite functions generated by Euclid's hat. J. Multivariate Anal. 69 88--119.
Mathematical Reviews (MathSciNet): MR1701408
Digital Object Identifier: doi:10.1006/jmva.1998.1800
Zentralblatt MATH: 0937.60007
Grenander, U. (1956). On the theory of mortality measurement. I, II. Skand. Aktuarietidskr. 39 70--96, 125--153.,
Mathematical Reviews (MathSciNet): MR0086459
Mathematical Reviews (MathSciNet): MR0093415
Groeneboom, P. (1985). Estimating a monotone density. In Proc. Berkeley Conference in Honor of Jerzy Neyman and Jack Kiefer (L. M. Le Cam and R. A. Olshen, eds.) 2 539--555. Wadsworth, Belmont, CA.
Mathematical Reviews (MathSciNet): MR0822052
Groeneboom, P. and Jongbloed, G. (1995). Isotonic estimation and rates of convergence in Wicksell's problem. Ann. Statist. 23 1518--1542.
Mathematical Reviews (MathSciNet): MR1370294
Digital Object Identifier: doi:10.1214/aos/1176324310
Project Euclid: euclid.aos/1176324310
Zentralblatt MATH: 0843.62034
Groeneboom, P., Jongbloed, G. and Wellner, J. A. (2001). A canonical process for estimation of convex functions: The ``invelope'' of integrated Brownian motion $+t^4$. Ann. Statist. 29 1620--1652.
Mathematical Reviews (MathSciNet): MR1891741
Digital Object Identifier: doi:10.1214/aos/1015345957
Project Euclid: euclid.aos/1015345957
Zentralblatt MATH: 1043.62026
Groeneboom, P., Jongbloed, G. and Wellner, J. A. (2001). Estimation of a convex function: Characterizations and asymptotic theory. Ann. Statist. 29 1653--1698.
Mathematical Reviews (MathSciNet): MR1891742
Digital Object Identifier: doi:10.1214/aos/1015345958
Project Euclid: euclid.aos/1015345958
Zentralblatt MATH: 1043.62027
Hampel, F. R. (1987). Design, modelling and analysis of some biological datasets. In Design, Data and Analysis, by Some Friends of Cuthbert Daniel (C. L. Mallows, ed.) 93--128. Wiley, New York.
Zentralblatt MATH: 0719.62503
Harris, C. M. and Singpurwalla, N. (1968). Life distributions derived from stochastic hazard functions. IEEE Trans. Reliability 17 70--79.
Hill, D. L., Saunders, R. and Laud, P. W. (1980). Maximum likelihood estimation for mixtures. Canad. J. Statist. 8 87--93.
Mathematical Reviews (MathSciNet): MR0595718
Digital Object Identifier: doi:10.2307/3314673
Jewell, N. P. (1982). Mixtures of exponential distributions. Ann. Statist. 10 479--484.
Mathematical Reviews (MathSciNet): MR0653523
Digital Object Identifier: doi:10.1214/aos/1176345789
Project Euclid: euclid.aos/1176345789
Zentralblatt MATH: 0495.62042
Karlin, S. and Ziegler, Z. (1966). Chebyshevian spline functions. SIAM J. Numer. Anal. 3 514--543.
Mathematical Reviews (MathSciNet): MR0216206
Digital Object Identifier: doi:10.1137/0703044
Zentralblatt MATH: 0171.31002
Kim, J. and Pollard, D. (1990). Cube root asymptotics. Ann. Statist. 18 191--219.
Mathematical Reviews (MathSciNet): MR1041391
Digital Object Identifier: doi:10.1214/aos/1176347498
Project Euclid: euclid.aos/1176347498
Zentralblatt MATH: 0703.62063
Komlós, J., Major, P. and Tusnády, G. (1975). An approximation of partial sums of independent rv's and the sample df. I. Z. Wahrsch. Verw. Gebiete 32 111--131.
Mathematical Reviews (MathSciNet): MR0375412
Digital Object Identifier: doi:10.1007/BF00533093
Lévy, P. (1962). Extensions d'un théorème de D. Dugué et M. Girault. Z. Wahrsch. Verw. Gebiete 1 159--173.
Mathematical Reviews (MathSciNet): MR0145565
Mallet, A. (1986). A maximum likelihood estimation method for random coefficient regression models. Biometrika 73 645--656.
Mathematical Reviews (MathSciNet): MR0897856
Zentralblatt MATH: 0615.62083
Digital Object Identifier: doi:10.1093/biomet/73.3.645
Mallet, A., Mentré, F., Steimer, J.-L. and Lokiec, F. (1988). Nonparametric maximum likelihood estimation for population pharmacokinetics, with application to cyclosporine. J. Pharmacokinetics and Pharmacodynamics 16 311--327.
Mammen, E. (1991). Nonparametric regression under qualitative smoothness assumptions Ann. Statist. 19 741--759.
Mathematical Reviews (MathSciNet): MR1105842
Digital Object Identifier: doi:10.1214/aos/1176348118
Project Euclid: euclid.aos/1176348118
Zentralblatt MATH: 0737.62039
Mammen, E. and van de Geer, S. (1997). Locally adaptive regression splines. Ann. Statist. 25 387--413.
Mathematical Reviews (MathSciNet): MR1429931
Digital Object Identifier: doi:10.1214/aos/1034276635
Project Euclid: euclid.aos/1034276635
Zentralblatt MATH: 0871.62040
McNolty, F., Doyle, J. and Hansen, E. (1980). Properties of the mixed exponential failure process. Technometrics 22 555--565.
Mathematical Reviews (MathSciNet): MR0596798
Digital Object Identifier: doi:10.2307/1268193
Zentralblatt MATH: 0448.62076
Micchelli, C. (1972). The fundamental theorem of algebra for monosplines with multiplicities. In Linear Operators and Approximation (P. L. Butzer, J.-P. Kahane and B. Szökefalvi-Nagy, eds.) 419--430. Birkhäuser, Basel.
Mathematical Reviews (MathSciNet): MR0393951
Zentralblatt MATH: 0253.41006
Miller, D. R. and Sofer, A. (1986). Least-squares regression under convexity and higher-order difference constraints with application to software reliability. Advances in Order Restricted Statistical Inference. Lecture Notes in Statist. 37 91--124. Springer, Berlin.
Mathematical Reviews (MathSciNet): MR0875650
Zentralblatt MATH: 0616.90051
Nürnberger, G. (1989). Approximation by Spline Functions. Springer, New York.
Mathematical Reviews (MathSciNet): MR1022194
Prakasa Rao, B. L. S. (1969). Estimation of a unimodal density. Sankhyā Ser. A 31 23--36.
Mathematical Reviews (MathSciNet): MR0267677
Schoenberg, I. J. (1964). On interpolation by spline functions and its minimal properties. In On Approximation Theory (P. L. Butzer and J. Korevaar, eds.) 109--129. Birkhäuser, Basel.
Mathematical Reviews (MathSciNet): MR0180785
Zentralblatt MATH: 0147.32101
Schoenberg, I. J. and Whitney, A. (1953). On Pólya frequency functions. III. The positivity of translation determinants with an application to the interpolation problem by spline curves. Trans. Amer. Math. Soc. 74 246--259.
Mathematical Reviews (MathSciNet): MR0053177
Digital Object Identifier: doi:10.2307/1990881
Shadrin, A. Yu. (2001). The $L_\infty$-norm of the $L_2$-spline projector is bounded independently of the knot sequence: A proof of de Boor's conjecture. Acta Math. 187 59--137.
Mathematical Reviews (MathSciNet): MR1864631
Digital Object Identifier: doi:10.1007/BF02392832
Zentralblatt MATH: 0996.41006
Shorack, G. and Wellner, J. A. (1986). Empirical Processes with Applications to Statistics. Wiley, New York.
Mathematical Reviews (MathSciNet): MR0838963
van der Vaart, A. W. and Wellner, J. A. (1996). Weak Convergence and Empirical Processes. With Applications to Statistics. Springer, New York.
Mathematical Reviews (MathSciNet): MR1385671
Zentralblatt MATH: 0862.60002
Vaupel, J. W., Manton, K. G. and Stallard, E. (1979). The impact of heterogeneity in individual frailty on the dynamics of mortality. Demography 16 439--454.
Widder, D. V. (1941). The Laplace Transform. Princeton Univ. Press.
Mathematical Reviews (MathSciNet): MR0005923
Williamson, R. E. (1956). Multiply monotone functions and their Laplace transforms. Duke Math. J. 23 189--207.
Mathematical Reviews (MathSciNet): MR0077581
Digital Object Identifier: doi:10.1215/S0012-7094-56-02317-1
Project Euclid: euclid.dmj/1077466811
Zentralblatt MATH: 0070.28501

2012 © Institute of Mathematical Statistics

The Annals of Statistics

The Annals of Statistics