Bayesian Analysis

Bayesian estimation of intensity surfaces on the sphere via needlet shrinkage and selection

James G. Scott

Full-text: Open access


This paper describes an approach for Bayesian modeling in spherical data sets. Our method is based upon a recent construction called the needlet, which is a particular form of spherical wavelet with many favorable statistical and computational properties. We perform shrinkage and selection of needlet coefficients, focusing on two main alternatives: empirical-Bayes thresholding, and Bayesian local shrinkage rules. We study the performance of the proposed methodology both on simulated data and on two real data sets: one involving the cosmic microwave background radiation, and one involving the reconstruction of a global news intensity surface inferred from published Reuters articles in August, 1996. The fully Bayesian approach based on robust, sparse shrinkage priors seems to outperform other alternatives.

Article information

Bayesian Anal. Volume 6, Number 2 (2011), 307-327.

First available in Project Euclid: 13 June 2012

Permanent link to this document

Digital Object Identifier

Mathematical Reviews number (MathSciNet)

Zentralblatt MATH identifier

Primary: 62H11: Directional data; spatial statistics
Secondary: 42C40: Wavelets and other special systems 62F15: Bayesian inference 62H12: Estimation 62J07: Ridge regression; shrinkage estimators 62M40: Random fields; image analysis 62P25: Applications to social sciences

needlets shrinkage estimate spherical wavelets


Scott, James G. Bayesian estimation of intensity surfaces on the sphere via needlet shrinkage and selection. Bayesian Anal. 6 (2011), no. 2, 307--327. doi:10.1214/11-BA611.

Export citation


  • Bae, K. and Mallick, B. (2004). "Gene selection using a two-level hierarchical Bayesian model." Bioinformatics, 20(18): 3423–30.
  • Baldi, P., Kerkyacharian, G., Marinucci, D., and Picard, D. (2009). "Adaptive density estimation for directional data using needlets." The Annals of Statistics, 37(6A): 3362–95.
  • –- (2009). "Asymptotics for Spherical Needlets." The Annals of Statistics, 37(3): 1150–71.
  • –- (2009). "Subsampling Needlet Coefficients on the Sphere." Bernoulli, 15(2): 438–63. ArXiv:0706.4169v1 [math.ST].
  • Barndorff-Nielsen, O., Kent, J., and Sorensen, M. (1982). "Normal variance-mean mixtures and z distributions." International Statistical Review, 50: 145–59.
  • Butler, R. and Wood, A. (2002). "Laplace Approximations for Hypergeometric Functions With Matrix Argument." The Annals of Statistics, 30: 1155–77.
  • Carvalho, C. M., Polson, N. G., and Scott, J. G. (2009). "Handling Sparsity via the Horseshoe." Journal of Machine Learning Research W&CP, 5(73–80).
  • –- (2010). "The horseshoe estimator for sparse signals." Biometrika, 97(2): 465–80.
  • Clyde, M. and George, E. I. (2000). "Flexible Empirical Bayes Estimation for Wavelets." Journal of the Royal Statistical Society, Series B (Methodology), 62(4): 681–98.
  • Damien, P., Wakefield, J. C., and Walker, S. G. (1999). "Bayesian nonconjugate and hierarchical models by using auxiliary variables." J. R. Stat. Soc. Ser. B, Stat. Methodol., 61: 331–44.
  • Faucheur, X., Vidakovic, B., and Tannenbaum, A. (2007). "Bayesian Spherical Wavelet Shrinkage:Applications to shape analysis." In Proceedings of SPIE Optics.
  • Figueiredo, M. (2003). "Adaptive sparseness for supervised learning." IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(9): 1150–9.
  • Gelman, A. (2006). "Prior distributions for variance parameters in hierarchical models." Bayesian Anal., 1(3): 515–33.
  • Gordy, M. B. (1998). "A generalization of generalized beta distributions." In Finance and Economics Discussion Series. Board of Governors of the Federal Reserve System.
  • Gradshteyn, I. and Ryzhik, I. (1965). Table of Integrals, Series, and Products. Academic Press.
  • Johnstone, I. and Silverman, B. W. (2004). "Needles and Straw in Haystacks: Empirical-Bayes estimates of possibly sparse sequences." The Annals of Statistics, 32(4): 1594–1649.
  • Johnstone, I. M. and Silverman, B. W. (2005). "Empirical Bayes Selection Of Wavelet Thresholds." Ann. Statist, 33: 1700–1752.
  • Lan, X. and Marinucci, D. (2009). "On the dependence structure of wavelet coefficients for spherical random fields." Stochastic Processes and their Applications, 119(10): 3749–66.
  • Leidner, J. L. (2008). Toponym Resolution in Text : Annotation, Evaluation and Applications of Spatial Grounding of Place Names. Universal Press.
  • Marinucci, D., Pietrobon, D., Balbi, A., Baldi, P., Cabella, P., Kerkyacharian, G., Natoli, P., Picard, D., and Vittorio, N. (2008). "Spherical needlets for cosmic microwave background data analysis." Monthly Notices of the Royal Astronomical Society, 8(2): 539–45.
  • Masreliez, C. (1975). "Approximate non-Gaussian filtering with linear state and observation relations." IEEE. Trans. Autom. Control.
  • Mayeli, A. (2010). "Asymptotic uncorrelation for Mexican needlets." Journal of Mathematical Analysis and Applications, 363(1): 336–44.
  • Narcowich, F., Petrushev, P., and Ward, D. (2006). "Localized tight frames on spheres." SIAM J. Math. Anal., 38: 574–94.
  • Pericchi, L. R. and Smith, A. (1992). "Exact and Approximate Posterior Moments for a Normal Location Parameter." Journal of the Royal Statistical Society (Series B), 54(3): 793–804.
  • Polson, N. G. (1991). "A representation of the posterior mean for a location model." Biometrika, 78: 426–30.
  • Scott, J. G. and Berger, J. O. (2006). "An exploration of aspects of Bayesian multiple testing." Journal of Statistical Planning and Inference, 136(7): 2144–2162.
  • Tibshirani, R. (1996). "Regression shrinkage and selection via the lasso." J. Royal. Statist. Soc B., 58(1): 267–88.
  • Tipping, M. (2001). "Sparse Bayesian learning and the relevance vector machine." Journal of Machine Learning Research, 1: 211–44.
  • Vidakovic, B. and Muller, P. (1999). Bayesian Inference in Wavelet Based Models, chapter An introduction to wavelets. Springer–Verlag.