November 2021 The illusion of the illusion of sparsity: An exercise in prior sensitivity
Bruno Fava, Hedibert F. Lopes
Author Affiliations +
Braz. J. Probab. Stat. 35(4): 699-720 (November 2021). DOI: 10.1214/21-BJPS503

Abstract

The emergence of Big Data raises the question of how to model economic relations when there is a large number of possible explanatory variables. We revisit the issue by comparing the possibility of using dense or sparse models in a Bayesian approach, allowing for variable selection and shrinkage. More specifically, we discuss the results reached by Giannone, Lenza and Primiceri (2020) through a “Spike-and-Slab” prior, which suggest an “illusion of sparsity” in economic data, as no clear patterns of sparsity could be detected. We make a further revision of the posterior distributions of the model, and propose three experiments to evaluate the robustness of the adopted prior distribution. We find that the pattern of sparsity is sensitive to the prior distribution of the regression coefficients, and present evidence that the model indirectly induces variable selection and shrinkage, which suggests that the “illusion of sparsity” could be, itself, an illusion. Code is available on Github ( github.com/bfava/IllusionOfIllusion).

Citation

Download Citation

Bruno Fava. Hedibert F. Lopes. "The illusion of the illusion of sparsity: An exercise in prior sensitivity." Braz. J. Probab. Stat. 35 (4) 699 - 720, November 2021. https://doi.org/10.1214/21-BJPS503

Information

Received: 1 September 2020; Accepted: 1 May 2021; Published: November 2021
First available in Project Euclid: 13 December 2021

MathSciNet: MR4350956
zbMATH: 07477281
Digital Object Identifier: 10.1214/21-BJPS503

Keywords: Bayesian econometrics , high dimensional data , Model selection , shrinkage , Sparsity

Rights: Copyright © 2021 Brazilian Statistical Association

Vol.35 • No. 4 • November 2021
Back to Top