October 2024 Computational lower bounds for graphon estimation via low-degree polynomials
Yuetian Luo, Chao Gao
Author Affiliations +
Ann. Statist. 52(5): 2318-2348 (October 2024). DOI: 10.1214/24-AOS2437

Abstract

Graphon estimation has been one of the most fundamental problems in network analysis and has received considerable attention in the past decade. From the statistical perspective, the minimax error rate of graphon estimation has been established by (Ann. Statist. 43 (2015) 2624–2652) for both stochastic block model (SBM) and nonparametric graphon estimation. The statistical optimal estimators are based on constrained least squares and have computational complexity exponential in the dimension. From the computational perspective, the best-known, polynomial-time estimator is based on universal singular value thresholding (USVT), but it can only achieve a much slower estimation error rate than the minimax one. It is natural to wonder if such a gap is essential. The computational optimality of the USVT or the existence of a computational barrier in graphon estimation has been a long-standing open problem. In this work, we take the first step toward it and provide rigorous evidence for the computational barrier in graphon estimation via low-degree polynomials. Specifically, in SBM graphon estimation, we show that for low-degree polynomial estimators, their estimation error rates cannot be significantly better than that of the USVT under a wide range of parameter regimes and in nonparametric graphon estimation, we show low-degree polynomial estimators achieve estimation error rates strictly slower than the minimax rate. Our results are proved based on the recent development of low-degree polynomials by (Ann. Statist. 50 (2022) 1833–1858), while we overcome a few key challenges in applying it to the general graphon estimation problem. By leveraging our main results, we also provide a computational lower bound on the clustering error for community detection in SBM with a growing number of communities and this yields a new piece of evidence for the conjectured Kesten–Stigum threshold for efficient community recovery. Finally, we extend our computational lower bounds to sparse graphon estimation and biclustering with additive Gaussian noise, and provide discussion on the optimality of our results.

Funding Statement

The research of C. Gao is supported in part by NSF Grants ECCS-2216912 and DMS-2310769, NSF Career Award DMS-1847590 and an Alfred Sloan fellowship.

Acknowledgments

The authors would like to thank an Associated Editor, and two anonymous referees for their helpful suggestions, which helped improve the presentation and quality of this paper.

Citation

Download Citation

Yuetian Luo. Chao Gao. "Computational lower bounds for graphon estimation via low-degree polynomials." Ann. Statist. 52 (5) 2318 - 2348, October 2024. https://doi.org/10.1214/24-AOS2437

Information

Received: 1 September 2023; Revised: 1 May 2024; Published: October 2024
First available in Project Euclid: 20 November 2024

Digital Object Identifier: 10.1214/24-AOS2437

Subjects:
Primary: 05C80 , 62H30 , 68Q17
Secondary: 62C20 , 62G05

Keywords: Community detection , computational lower bound , Graphon estimation , Kesten–Stigum threshold , Low-degree polynomials , statistical–computational tradeoffs

Rights: Copyright © 2024 Institute of Mathematical Statistics

Vol.52 • No. 5 • October 2024
Back to Top