We consider the problem of isotonic regression, where the underlying signal $x$ is assumed to satisfy a monotonicity constraint, that is, $x$ lies in the cone $\{x\in \mathbb{R}^{n}:x_{1}\leq \dots\leq x_{n}\}$. We study the isotonic projection operator (projection to this cone), and find a necessary and sufficient condition characterizing all norms with respect to which this projection is contractive. This enables a simple and non-asymptotic analysis of the convergence properties of isotonic regression, yielding uniform confidence bands that adapt to the local Lipschitz properties of the signal.
References
[1] Fadoua Balabdaoui, Hanna Jankowski, Marios Pavlides, Arseni Seregin, and Jon Wellner. On the grenander estimator at zero., Statistica Sinica, 21(2):873, 2011. 1214.62037 10.5705/ss.2011.038a[1] Fadoua Balabdaoui, Hanna Jankowski, Marios Pavlides, Arseni Seregin, and Jon Wellner. On the grenander estimator at zero., Statistica Sinica, 21(2):873, 2011. 1214.62037 10.5705/ss.2011.038a
[2] Richard E Barlow, David J Bartholomew, JM Bremner, and H Daniel Brunk., Statistical inference under order restrictions: The theory and application of isotonic regression. Wiley New York, 1972.[2] Richard E Barlow, David J Bartholomew, JM Bremner, and H Daniel Brunk., Statistical inference under order restrictions: The theory and application of isotonic regression. Wiley New York, 1972.
[3] Lucien Birgé. Estimating a density under order restrictions: Nonasymptotic minimax risk., The Annals of Statistics, pages 995 –1012, 1987. MR902241 0631.62037 10.1214/aos/1176350488 euclid.aos/1176350488[3] Lucien Birgé. Estimating a density under order restrictions: Nonasymptotic minimax risk., The Annals of Statistics, pages 995 –1012, 1987. MR902241 0631.62037 10.1214/aos/1176350488 euclid.aos/1176350488
[4] Lucien Birgé and Pascal Massart. Rates of convergence for minimum contrast estimators., Probability Theory and Related Fields, 97(1):113–150, 1993. 0805.62037 10.1007/BF01199316[4] Lucien Birgé and Pascal Massart. Rates of convergence for minimum contrast estimators., Probability Theory and Related Fields, 97(1):113–150, 1993. 0805.62037 10.1007/BF01199316
[5] Lev M Bregman. The method of successive projection for finding a common point of convex sets(theorems for determining common point of convex sets by method of successive projection)., Soviet Mathematics, 6:688–692, 1965. 0142.16804[5] Lev M Bregman. The method of successive projection for finding a common point of convex sets(theorems for determining common point of convex sets by method of successive projection)., Soviet Mathematics, 6:688–692, 1965. 0142.16804
[7] Chris Carolan and Richard Dykstra. Asymptotic behavior of the grenander estimator at density flat regions., Canadian Journal of Statistics, 27(3):557–566, 1999. 0949.62035 10.2307/3316111[7] Chris Carolan and Richard Dykstra. Asymptotic behavior of the grenander estimator at density flat regions., Canadian Journal of Statistics, 27(3):557–566, 1999. 0949.62035 10.2307/3316111
[8] Eric Cator. Adaptivity and optimality of the monotone least-squares estimator., Bernoulli, 17(2):714–735, 2011. 1345.62066 10.3150/10-BEJ289 euclid.bj/1302009244[8] Eric Cator. Adaptivity and optimality of the monotone least-squares estimator., Bernoulli, 17(2):714–735, 2011. 1345.62066 10.3150/10-BEJ289 euclid.bj/1302009244
[9] Sabyasachi Chatterjee, Adityanand Guntuboyina, Bodhisattva Sen, et al. On risk bounds in isotonic and other shape restricted regression problems., The Annals of Statistics, 43(4) :1774–1800, 2015. 1317.62032 10.1214/15-AOS1324 euclid.aos/1434546222[9] Sabyasachi Chatterjee, Adityanand Guntuboyina, Bodhisattva Sen, et al. On risk bounds in isotonic and other shape restricted regression problems., The Annals of Statistics, 43(4) :1774–1800, 2015. 1317.62032 10.1214/15-AOS1324 euclid.aos/1434546222
[10] Mathias Drton and Caroline Klivans. A geometric interpretation of the characteristic polynomial of reflection arrangements., Proceedings of the American Mathematical Society, 138(8) :2873–2887, 2010. MR2644900 1208.51008 10.1090/S0002-9939-10-10369-4[10] Mathias Drton and Caroline Klivans. A geometric interpretation of the characteristic polynomial of reflection arrangements., Proceedings of the American Mathematical Society, 138(8) :2873–2887, 2010. MR2644900 1208.51008 10.1090/S0002-9939-10-10369-4
[12] Cécile Durot, Vladimir N Kulikov, and Hendrik P Lopuhaä. The limit distribution of the $l_\infty $-error of grenander-type estimators., The Annals of Statistics, pages 1578–1608, 2012. 1257.62017 10.1214/12-AOS1015 euclid.aos/1346850066[12] Cécile Durot, Vladimir N Kulikov, and Hendrik P Lopuhaä. The limit distribution of the $l_\infty $-error of grenander-type estimators., The Annals of Statistics, pages 1578–1608, 2012. 1257.62017 10.1214/12-AOS1015 euclid.aos/1346850066
[13] Theo Gasser, Lothar Sroka, and Christine Jennen-Steinmetz. Residual variance and residual pattern in nonlinear regression., Biometrika, pages 625–633, 1986. 0649.62035 10.1093/biomet/73.3.625[13] Theo Gasser, Lothar Sroka, and Christine Jennen-Steinmetz. Residual variance and residual pattern in nonlinear regression., Biometrika, pages 625–633, 1986. 0649.62035 10.1093/biomet/73.3.625
[17] Hanna Jankowski. Convergence of linear functionals of the grenander estimator under misspecification., The Annals of Statistics, 42(2):625–653, 2014. 1302.62045 10.1214/13-AOS1196 euclid.aos/1400592172[17] Hanna Jankowski. Convergence of linear functionals of the grenander estimator under misspecification., The Annals of Statistics, 42(2):625–653, 2014. 1302.62045 10.1214/13-AOS1196 euclid.aos/1400592172
[18] Mary Meyer and Michael Woodroofe. On the degrees of freedom in shape-restricted regression., Annals of Statistics, pages 1083–1104, 2000. 1105.62340 10.1214/aos/1015956708 euclid.aos/1015956708[18] Mary Meyer and Michael Woodroofe. On the degrees of freedom in shape-restricted regression., Annals of Statistics, pages 1083–1104, 2000. 1105.62340 10.1214/aos/1015956708 euclid.aos/1015956708
[19] BLS Prakasa Rao. Estimation of a unimodal density., Sankhyā: The Indian Journal of Statistics, Series A, pages 23–36, 1969. 0181.45901[19] BLS Prakasa Rao. Estimation of a unimodal density., Sankhyā: The Indian Journal of Statistics, Series A, pages 23–36, 1969. 0181.45901
[20] John Rice. Bandwidth choice for nonparametric regression., The Annals of Statistics, pages 1215–1230, 1984. 0554.62035 10.1214/aos/1176346788 euclid.aos/1176346788[20] John Rice. Bandwidth choice for nonparametric regression., The Annals of Statistics, pages 1215–1230, 1984. 0554.62035 10.1214/aos/1176346788 euclid.aos/1176346788
[22] Sara Van de Geer. Estimating a regression function., The Annals of Statistics, pages 907–924, 1990. 0709.62040 10.1214/aos/1176347632 euclid.aos/1176347632[22] Sara Van de Geer. Estimating a regression function., The Annals of Statistics, pages 907–924, 1990. 0709.62040 10.1214/aos/1176347632 euclid.aos/1176347632
[23] Sara Van de Geer. Hellinger-consistency of certain nonparametric maximum likelihood estimators., The Annals of Statistics, pages 14–44, 1993. 0779.62033 10.1214/aos/1176349013 euclid.aos/1176349013[23] Sara Van de Geer. Hellinger-consistency of certain nonparametric maximum likelihood estimators., The Annals of Statistics, pages 14–44, 1993. 0779.62033 10.1214/aos/1176349013 euclid.aos/1176349013
[24] Yazhen Wang and KS Chen. The l2risk of an isotonic estimate., Communications in Statistics-Theory and Methods, 25(2):281–294, 1996. 0875.62143 10.1080/03610929608831695[24] Yazhen Wang and KS Chen. The l2risk of an isotonic estimate., Communications in Statistics-Theory and Methods, 25(2):281–294, 1996. 0875.62143 10.1080/03610929608831695
[25] Farrol T Wright. The asymptotic behavior of monotone regression estimates., The Annals of Statistics, 9(2):443–448, 1981. 0471.62062 10.1214/aos/1176345411 euclid.aos/1176345411[25] Farrol T Wright. The asymptotic behavior of monotone regression estimates., The Annals of Statistics, 9(2):443–448, 1981. 0471.62062 10.1214/aos/1176345411 euclid.aos/1176345411
[26] Cun-Hui Zhang. Risk bounds in isotonic regression., The Annals of Statistics, 30(2):528–555, 2002. 1012.62045 10.1214/aos/1021379864 euclid.aos/1021379864[26] Cun-Hui Zhang. Risk bounds in isotonic regression., The Annals of Statistics, 30(2):528–555, 2002. 1012.62045 10.1214/aos/1021379864 euclid.aos/1021379864
