Open Access
2018 Adaptive estimation in the nonparametric random coefficients binary choice model by needlet thresholding
Eric Gautier, Erwan Le Pennec
Electron. J. Statist. 12(1): 277-320 (2018). DOI: 10.1214/17-EJS1383
Abstract

In the random coefficients binary choice model, a binary variable equals 1 iff an index $X^{\top}\beta$ is positive. The vectors $X$ and $\beta$ are independent and belong to the sphere $\mathbb{S}^{d-1}$ in $\mathbb{R}^{d}$. We prove lower bounds on the minimax risk for estimation of the density $f_{\beta}$ over Besov bodies where the loss is a power of the $\mathrm{L}^{p}(\mathbb{S}^{d-1})$ norm for $1\le p\le \infty$. We show that a hard thresholding estimator based on a needlet expansion with data-driven thresholds achieves these lower bounds up to logarithmic factors.

References

1.

[1] Atkinson, K. and Han, W. (2012)., Spherical Harmonics and Approximations on the Unit Sphere: An Introduction. Springer. 1254.41015[1] Atkinson, K. and Han, W. (2012)., Spherical Harmonics and Approximations on the Unit Sphere: An Introduction. Springer. 1254.41015

2.

[2] Baldi, P., Kerkyacharian, G., Marinucci, D., and Picard, D. (2009). Adaptive density estimation for directional data using needlets., Ann. Statist. 37 3362–3395. 1369.62061 10.1214/09-AOS682 euclid.aos/1250515390[2] Baldi, P., Kerkyacharian, G., Marinucci, D., and Picard, D. (2009). Adaptive density estimation for directional data using needlets., Ann. Statist. 37 3362–3395. 1369.62061 10.1214/09-AOS682 euclid.aos/1250515390

3.

[3] Beran, R., Feuerverger, A., and Hall, P. (1996). Estimating coefficient distributions in random coefficient regression., Ann. Statist. 24 2569–2592. 0867.62021 10.1214/aos/1032181170 euclid.aos/1032181170[3] Beran, R., Feuerverger, A., and Hall, P. (1996). Estimating coefficient distributions in random coefficient regression., Ann. Statist. 24 2569–2592. 0867.62021 10.1214/aos/1032181170 euclid.aos/1032181170

4.

[4] Beran, R. and Millar, P. W. (1994). Minimum distance estimation in random coefficient regression models., Ann. Statist. 22 1976–1992. 0828.62031 10.1214/aos/1176325767 euclid.aos/1176325767[4] Beran, R. and Millar, P. W. (1994). Minimum distance estimation in random coefficient regression models., Ann. Statist. 22 1976–1992. 0828.62031 10.1214/aos/1176325767 euclid.aos/1176325767

5.

[5] Bertin, K., Le Pennec, E., and Rivoirard, V. (2011). Adaptive Dantzig density estimation., Ann. Inst. H. Poincaré Probab. Statist. 47 43–74. 1207.62077 10.1214/09-AIHP351 euclid.aihp/1294170229[5] Bertin, K., Le Pennec, E., and Rivoirard, V. (2011). Adaptive Dantzig density estimation., Ann. Inst. H. Poincaré Probab. Statist. 47 43–74. 1207.62077 10.1214/09-AIHP351 euclid.aihp/1294170229

6.

[6] Durastanti, C., Geller, D., and Marinucci, D. (2012). Adaptive nonparametric regression on spin fiber bundles., J. Multivariate Anal. 104 16–38. 1270.62069 10.1016/j.jmva.2011.05.012[6] Durastanti, C., Geller, D., and Marinucci, D. (2012). Adaptive nonparametric regression on spin fiber bundles., J. Multivariate Anal. 104 16–38. 1270.62069 10.1016/j.jmva.2011.05.012

7.

[7] Funk, P. (1916). Uber eine geometrische anwendung der abelschen integralgleichung., Math. Ann. 77 129–135. 45.0533.01 10.1007/BF01456824[7] Funk, P. (1916). Uber eine geometrische anwendung der abelschen integralgleichung., Math. Ann. 77 129–135. 45.0533.01 10.1007/BF01456824

8.

[8] Gaillac, C., and Gautier, E. (2017). Nonparametric identification in some random coefficients models when regressors have limited variation. Working, paper.[8] Gaillac, C., and Gautier, E. (2017). Nonparametric identification in some random coefficients models when regressors have limited variation. Working, paper.

9.

[9] Gautier, E., and Hoderlein, S. (2011, 2015). A triangular treatment effect model with random coefficients in the selection equation. Preprint,  arXiv:1109.0362v4.[9] Gautier, E., and Hoderlein, S. (2011, 2015). A triangular treatment effect model with random coefficients in the selection equation. Preprint,  arXiv:1109.0362v4.

10.

[10] Gautier, E., and Kitamura, Y. (2013). Nonparametric estimation in random coefficients binary choice models., Econometrica 81 581–607. 1274.62267 10.3982/ECTA8675[10] Gautier, E., and Kitamura, Y. (2013). Nonparametric estimation in random coefficients binary choice models., Econometrica 81 581–607. 1274.62267 10.3982/ECTA8675

11.

[11] Groemer, H. (1996)., Geometric Applications of Fourier Series and Spherical Harmonics. Cambridge University Press, Cambridge, Encyclopedia of Mathematics and its ApplicationsMR1412143 0877.52002[11] Groemer, H. (1996)., Geometric Applications of Fourier Series and Spherical Harmonics. Cambridge University Press, Cambridge, Encyclopedia of Mathematics and its ApplicationsMR1412143 0877.52002

12.

[12] Healy, D. M., and Kim, P. T. (1996). An empirical bayes approach to directional data and efficient computation on the sphere., Ann. Statist. 24 232–254. 0856.62010 10.1214/aos/1033066208 euclid.aos/1033066208[12] Healy, D. M., and Kim, P. T. (1996). An empirical bayes approach to directional data and efficient computation on the sphere., Ann. Statist. 24 232–254. 0856.62010 10.1214/aos/1033066208 euclid.aos/1033066208

13.

[13] Ichimura, H., and Thompson, T. S. (1998). Maximum likelihood estimation of a binary choice model with random coefficients of unknown distribution., J. Econometrics 86 269–295. 0955.62118 10.1016/S0304-4076(97)00117-6[13] Ichimura, H., and Thompson, T. S. (1998). Maximum likelihood estimation of a binary choice model with random coefficients of unknown distribution., J. Econometrics 86 269–295. 0955.62118 10.1016/S0304-4076(97)00117-6

14.

[14] Kamzolov, A. I. (1983). The best approximation of the class of functions $\mathbfW^\alpha_p(\mathbbS^n)$ by polynomials in spherical harmonics., Mat. Zametki 32 285–293. 0514.41031[14] Kamzolov, A. I. (1983). The best approximation of the class of functions $\mathbfW^\alpha_p(\mathbbS^n)$ by polynomials in spherical harmonics., Mat. Zametki 32 285–293. 0514.41031

15.

[15] Kerkyacharian, G., Nickl, R., Picard, D. (2012). Concentration inequalities and confidence bands for needlet density estimators on compact homogeneous manifolds., Probab. Theory Relat. Fields 153 363–404. 06062621 10.1007/s00440-011-0348-5[15] Kerkyacharian, G., Nickl, R., Picard, D. (2012). Concentration inequalities and confidence bands for needlet density estimators on compact homogeneous manifolds., Probab. Theory Relat. Fields 153 363–404. 06062621 10.1007/s00440-011-0348-5

16.

[16] Kim, P. and Koo, J. (2000). Directional mixture models and optimal esimation of the mixing density., Canad. J. Statist. 28 383–398. 0981.62032 10.2307/3315986[16] Kim, P. and Koo, J. (2000). Directional mixture models and optimal esimation of the mixing density., Canad. J. Statist. 28 383–398. 0981.62032 10.2307/3315986

17.

[17] Kerkyacharian, G., Kyriazis, G., Le Pennec, E., Petrushev, P., and Picard, D. (2010). Inversion of noisy radon transform by SVD based needlets., Appl. Comput. Harmon. Anal. 28 24–45. MR2563258 1213.42117 10.1016/j.acha.2009.06.001[17] Kerkyacharian, G., Kyriazis, G., Le Pennec, E., Petrushev, P., and Picard, D. (2010). Inversion of noisy radon transform by SVD based needlets., Appl. Comput. Harmon. Anal. 28 24–45. MR2563258 1213.42117 10.1016/j.acha.2009.06.001

18.

[18] Kerkyacharian, G., Petrushev, P., Picard D., and Willer, T. (2007). Needlet algorithms for estimation in inverse problems., Electron. J. Stat. 1 30–76. 1320.62072 10.1214/07-EJS014[18] Kerkyacharian, G., Petrushev, P., Picard D., and Willer, T. (2007). Needlet algorithms for estimation in inverse problems., Electron. J. Stat. 1 30–76. 1320.62072 10.1214/07-EJS014

19.

[19] Kerkyacharian, G., Phan Ngoc, T. M., and Picard, D. (2009). Localized deconvolution on the sphere., Ann. Statist. 39 1042–1068. 1216.62059 10.1214/10-AOS858 euclid.aos/1302268086[19] Kerkyacharian, G., Phan Ngoc, T. M., and Picard, D. (2009). Localized deconvolution on the sphere., Ann. Statist. 39 1042–1068. 1216.62059 10.1214/10-AOS858 euclid.aos/1302268086

20.

[20] Korostelev, V. and Tsybakov, A. (1993)., Minimax Theory of Image Reconstruction. Springer. 0833.62039[20] Korostelev, V. and Tsybakov, A. (1993)., Minimax Theory of Image Reconstruction. Springer. 0833.62039

21.

[21] Mc Fadden, D. (2001). Economic choices - Nobel Lecture, December 2000., American Economic Review 91 351–378.[21] Mc Fadden, D. (2001). Economic choices - Nobel Lecture, December 2000., American Economic Review 91 351–378.

22.

[22] Mardia, K. V. and Jupp, E. (2000)., Directional Statistics. Wiley. 0935.62065[22] Mardia, K. V. and Jupp, E. (2000)., Directional Statistics. Wiley. 0935.62065

23.

[23] Maurer, A. and Pontil, M. (2009). Empirical Bernstein bounds and sample variance penalization., COLT 2009.[23] Maurer, A. and Pontil, M. (2009). Empirical Bernstein bounds and sample variance penalization., COLT 2009.

24.

[24] Monnier, J.-B. (2011). Nonparametric regression on the hyper-sphere with uniform design., TEST 20, 412–446 1274.62295 10.1007/s11749-011-0233-7[24] Monnier, J.-B. (2011). Nonparametric regression on the hyper-sphere with uniform design., TEST 20, 412–446 1274.62295 10.1007/s11749-011-0233-7

25.

[25] Narcowich, F., Petrushev, P., and Ward, J. (2006). Decomposition of Besov and Triebel-Lizorkin spaces on the sphere., J. Funct. Anal. 238 530–564. 1114.46026 10.1016/j.jfa.2006.02.011[25] Narcowich, F., Petrushev, P., and Ward, J. (2006). Decomposition of Besov and Triebel-Lizorkin spaces on the sphere., J. Funct. Anal. 238 530–564. 1114.46026 10.1016/j.jfa.2006.02.011

26.

[26] Rubin, B. (1999). Inversion and characterization of the hemispherical transform., J. Anal. Math. 77 105–128. 1054.44500 10.1007/BF02791259[26] Rubin, B. (1999). Inversion and characterization of the hemispherical transform., J. Anal. Math. 77 105–128. 1054.44500 10.1007/BF02791259

27.

[27] Tsybakov, A. (2009)., Introduction to Nonparametric Estimation. Springer. 1176.62032[27] Tsybakov, A. (2009)., Introduction to Nonparametric Estimation. Springer. 1176.62032
Eric Gautier and Erwan Le Pennec "Adaptive estimation in the nonparametric random coefficients binary choice model by needlet thresholding," Electronic Journal of Statistics 12(1), 277-320, (2018). https://doi.org/10.1214/17-EJS1383
Received: 1 October 2016; Published: 2018
Vol.12 • No. 1 • 2018
Back to Top