Open Access
April 2015 Rate-optimal posterior contraction for sparse PCA
Chao Gao, Harrison H. Zhou
Ann. Statist. 43(2): 785-818 (April 2015). DOI: 10.1214/14-AOS1268

Abstract

Principal component analysis (PCA) is possibly one of the most widely used statistical tools to recover a low-rank structure of the data. In the high-dimensional settings, the leading eigenvector of the sample covariance can be nearly orthogonal to the true eigenvector. A sparse structure is then commonly assumed along with a low rank structure. Recently, minimax estimation rates of sparse PCA were established under various interesting settings. On the other side, Bayesian methods are becoming more and more popular in high-dimensional estimation, but there is little work to connect frequentist properties and Bayesian methodologies for high-dimensional data analysis. In this paper, we propose a prior for the sparse PCA problem and analyze its theoretical properties. The prior adapts to both sparsity and rank. The posterior distribution is shown to contract to the truth at optimal minimax rates. In addition, a computationally efficient strategy for the rank-one case is discussed.

Citation

Download Citation

Chao Gao. Harrison H. Zhou. "Rate-optimal posterior contraction for sparse PCA." Ann. Statist. 43 (2) 785 - 818, April 2015. https://doi.org/10.1214/14-AOS1268

Information

Published: April 2015
First available in Project Euclid: 23 March 2015

zbMATH: 1312.62078
MathSciNet: MR3325710
Digital Object Identifier: 10.1214/14-AOS1268

Subjects:
Primary: 62G05 , 62H25

Keywords: Bayesian estimation , posterior contraction , Principal Component Analysis

Rights: Copyright © 2015 Institute of Mathematical Statistics

Vol.43 • No. 2 • April 2015
Back to Top