Bernoulli

Nonparametric “regression” when errors are positioned at end-points

Peter Hall and Ingrid Van Keilegom
Source: Bernoulli Volume 15, Number 3 (2009), 614-633.

Abstract

Increasing practical interest has been shown in regression problems where the errors, or disturbances, are centred in a way that reflects particular characteristics of the mechanism that generated the data. In economics this occurs in problems involving data on markets, productivity and auctions, where it can be natural to centre at an end-point of the error distribution rather than at the distribution’s mean. Often these cases have an extreme-value character, and in that broader context, examples involving meteorological, record-value and production-frontier data have been discussed in the literature. We shall discuss nonparametric methods for estimating regression curves in these settings, showing that they have features that contrast so starkly with those in better understood problems that they lead to apparent contradictions. For example, merely by centring errors at their end-points rather than their means the problem can change from one with a familiar nonparametric character, where the optimal convergence rate is slower than n−1/2, to one in the super-efficient class, where the optimal rate is faster than n−1/2. Moreover, when the errors are centred in a non-standard way there is greater intrinsic interest in estimating characteristics of the error distribution, as well as of the regression mean itself. The paper will also address this aspect of the problem.

First Page: Show Hide
Full-text: Access denied (no subscription detected)
We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber.
If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription. Read more about accessing full-text
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.bj/1251463274
Digital Object Identifier: doi:10.3150/08-BEJ173
Mathematical Reviews number (MathSciNet): MR2555192
Zentralblatt MATH identifier: 05815948

References

Aigner, D., Lovell, C.A., Knox, K. and Schmidt, P. (1977). Formulation and estimation of stochastic frontier production function models. J. Econometrics 6 21–37.
Mathematical Reviews (MathSciNet): MR448782
Zentralblatt MATH: 0366.90026
Digital Object Identifier: doi:10.1016/0304-4076(77)90052-5
Breen, R. (1996). Regression Models: Censored, Sample Selected, or Truncated Data. Thousand Oaks, CA: Sage Publications.
Campo, S., Guerre, E., Perrigne, I. and Vuong, Q. (2002). Semiparametric estimation of first-price auctions with risk averse bidders. Available at http://grizzly.la.psu.edu/~iup2/forthcoming/CGPV4.pdf.
Mathematical Reviews (MathSciNet): MR2807722
Zentralblatt MATH: 1215.91028
Digital Object Identifier: doi:10.1093/restud/rdq001
Chernozhukov, V. (1998). Nonparametric extreme regression quantiles. Technical report, Stanford Univ.
Chernozhukov, V. (2005). Extremal quantile regression. Ann. Statist. 33 806–839.
Mathematical Reviews (MathSciNet): MR2163160
Zentralblatt MATH: 1068.62063
Digital Object Identifier: doi:10.1214/009053604000001165
Project Euclid: euclid.aos/1117114337
Chernozhukov, V. and Hong, A. (2004). Likelihood estimation and inference in a class of nonregular econometric models. Econometrica 72 1445–1480.
Mathematical Reviews (MathSciNet): MR2077489
Digital Object Identifier: doi:10.1111/j.1468-0262.2004.00540.x
Christensen, L. and Greene, R. (1976). Economies of scale in U.S. electric power generation. J. Polit. Econom. 84 653–667.
Donald, S.G. and Paarsch, H.J. (1993). Piecewise pseudo-maximum likelihood estimation in empirical models of auctions. Internat. Econom. Rev. 34 121–148.
Mathematical Reviews (MathSciNet): MR1201732
Zentralblatt MATH: 0771.90020
Digital Object Identifier: doi:10.2307/2526953
Donald, S.G. and Paarsch, H.J. (2002). Superconsistent estimation and inference in structural econometric models using extreme order statistics. J. Econometrics 109 305–340.
Mathematical Reviews (MathSciNet): MR1921058
Zentralblatt MATH: 1043.62103
Digital Object Identifier: doi:10.1016/S0304-4076(02)00116-1
Gijbels, I., Mammen, E., Park, B.U. and Simar, L. (1999). On estimation of monotone and concave frontier functions. J. Amer. Statist. Assoc. 94 220–228.
Mathematical Reviews (MathSciNet): MR1689226
Zentralblatt MATH: 1043.62105
Digital Object Identifier: doi:10.2307/2669696
Gijbels, I. and Peng, L. (2000). Estimation of a support curve via order statistics. Extremes 3 251–277.
Mathematical Reviews (MathSciNet): MR1856200
Digital Object Identifier: doi:10.1023/A:1011407111136
Greene, W.H. (1990). A Gamma-distributed stochastic frontier model. J. Econometrics 46 141–163.
Mathematical Reviews (MathSciNet): MR1080869
Digital Object Identifier: doi:10.1016/0304-4076(90)90052-U
Hall, P. (1978). Representations and limit theorems for extreme value distributions. J. Appl. Probab. 15 639–644.
Mathematical Reviews (MathSciNet): MR494433
Zentralblatt MATH: 0388.60030
Digital Object Identifier: doi:10.2307/3213128
Hall, P. (1982). On estimating the end-point of a distribution. Ann. Statist. 10 556–568.
Mathematical Reviews (MathSciNet): MR653530
Zentralblatt MATH: 0489.62029
Digital Object Identifier: doi:10.1214/aos/1176345796
Project Euclid: euclid.aos/1176345796
Hall, P., Nussbaum, M. and Stern, S.E. (1997). On the estimation of a support curve of indeterminate sharpness. J. Multivariate Anal. 62 204–232.
Mathematical Reviews (MathSciNet): MR1473874
Zentralblatt MATH: 0890.62029
Digital Object Identifier: doi:10.1006/jmva.1997.1681
Hall, P., Park, B.U. and Stern, S.E. (1998). On polynomial estimators of frontiers and boundaries. J. Multivariate Anal. 66 71–98.
Mathematical Reviews (MathSciNet): MR1648521
Zentralblatt MATH: 1127.62358
Digital Object Identifier: doi:10.1006/jmva.1998.1738
Hall, P. and Park, B.U. (2004). Bandwidth choice for local polynomial estimation of smooth boundaries. J. Multivariate Anal. 91 240–261.
Mathematical Reviews (MathSciNet): MR2087845
Zentralblatt MATH: 1056.62050
Digital Object Identifier: doi:10.1016/j.jmva.2003.10.002
Hall, P. and Simar, L. (2002). Estimating a changepoint, boundary, or frontier in the presence of observation error. J. Amer. Statist. Assoc. 97 523–534.
Mathematical Reviews (MathSciNet): MR1941469
Zentralblatt MATH: 1073.62521
Digital Object Identifier: doi:10.1198/016214502760047050
Härdle, W., Park, B.U. and Tsybakov, A.B. (1995). Estimation of non-sharp support boundaries. J. Multivariate Anal. 55 205–218.
Mathematical Reviews (MathSciNet): MR1370400
Zentralblatt MATH: 0863.62030
Digital Object Identifier: doi:10.1006/jmva.1995.1075
Harter, H.L. and Moore, A.H. (1965). Maximum-likelihood estimation of the parameters of gamma and Weilbull populations from complete and from censored samples. Technometrics 7 639–643.
Mathematical Reviews (MathSciNet): MR185726
Digital Object Identifier: doi:10.2307/1266401
Hill, B.M. (1975). A simple general approach to inference about the tail of a distribution. Ann. Statist. 3 1163–1174.
Mathematical Reviews (MathSciNet): MR378204
Zentralblatt MATH: 0323.62033
Digital Object Identifier: doi:10.1214/aos/1176343247
Project Euclid: euclid.aos/1176343247
Hirano, K. and Porter, J.R. (2003). Asymptotic efficiency in parametric structural models with parameter-dependent support. Econometrica 71 1307–1338.
Mathematical Reviews (MathSciNet): MR2000249
Digital Object Identifier: doi:10.1111/1468-0262.00451
Jofre-Bonet, M. and Pesendorfer, M. (2003). Estimation of a dynamic auction game. Econometrica 71 1443–1489.
Mathematical Reviews (MathSciNet): MR2000253
Digital Object Identifier: doi:10.1111/1468-0262.00455
Jurečková, J. (2000). Test of tails based on extreme regression quantiles. Statist. Probab. Lett. 49 53–61.
Kneip, A., Park, B.U. and Simar, L. (1998). A note on the convergence of nonparametric DEA estimators for production efficiency scores. Econometric Theory 14 783–793.
Mathematical Reviews (MathSciNet): MR1666696
Digital Object Identifier: doi:10.1017/S0266466698146042
Knight, K. (2001a). Epi-convergence in distribution and stochastic equi-semicontinuity. Manuscript.
Knight, K. (2001b). Limiting distributions of linear programming estimators. Extremes 4 87–103.
Mathematical Reviews (MathSciNet): MR1893873
Digital Object Identifier: doi:10.1023/A:1013991808181
Koenker, R., Ng, P. and Portnoy, S. (1994). Quantile smoothing splines. Biometrika 81 673–680.
Mathematical Reviews (MathSciNet): MR1326417
Zentralblatt MATH: 0810.62040
Digital Object Identifier: doi:10.1093/biomet/81.4.673
Korostelev, A.P., Simar, L. and Tsybakov, A.B. (1995a). Efficient estimation of monotone boundaries. Ann. Statist. 23 476–489.
Mathematical Reviews (MathSciNet): MR1332577
Zentralblatt MATH: 0829.62043
Digital Object Identifier: doi:10.1214/aos/1176324531
Project Euclid: euclid.aos/1176324531
Korostelev, A.P., Simar, L. and Tsybakov, A.B. (1995b). On estimation of monotone and convex boundaries. Publ. Inst. Statist. Univ. Paris 39 3–18.
Mathematical Reviews (MathSciNet): MR1744393
Zentralblatt MATH: 0817.62023
Korostelev, A.P. and Tsybakov, A.B. (1993). Minimax Theory of Image Reconstruction. Lecture Notes in Statistics 82. New York: Springer.
Mathematical Reviews (MathSciNet): MR1226450
Long, S.J. (1997). Regression Models for Categorical and Limited Dependent Variables. Thousand Oaks, CA: Sage Publications.
Paarsch, H.J. (1992). Deciding between the common and private value paradigms in empirical models of auctions. J. Econometrics 51 191–215.
Park, B.U. and Simar, L. (1994). Efficient semiparametric estimation in a stochastic frontier model. J. Amer. Statist. Assoc. 89 929–936.
Mathematical Reviews (MathSciNet): MR1294737
Zentralblatt MATH: 0804.62100
Digital Object Identifier: doi:10.2307/2290918
Portnoy, S. and Jurečková, J. (2000). On extreme regression quantiles. Extremes 2 227–243.
Robinson, W.T. and Chiang, J.W. (1996). Are Sutton’s predictions robust? Empirical insights into advertising, R&D, and concentration. J. Indust. Economics 44 389–408.
Smith, R.L. (1985). Maximum likelihood estimation in a class of nonregular cases. Biometrika 72 67–90.
Mathematical Reviews (MathSciNet): MR790201
Zentralblatt MATH: 0583.62026
Digital Object Identifier: doi:10.1093/biomet/72.1.67
Smith, R.L. (1994). Nonregular regression. Biometrika 81 173–183.
Mathematical Reviews (MathSciNet): MR1279665
Zentralblatt MATH: 0803.62056
Digital Object Identifier: doi:10.1093/biomet/81.1.173
Zipf, G.K. (1941). National Unity and Disunity: The Nation as a Bio-Social Organism. Bloomington, IN: Principia Press.
Zipf, G.K. (1949). Human Behavior and the Principle of Least Effort: An Introduction to Human Ecology. Cambridge, MA: Addison-Wesley.

2012 © Bernoulli Society for Mathematical Statistics and Probability

Bernoulli

Bernoulli

Turn MathJax Off
What is MathJax?