The Low-Degree Hardness of Finding Large Independent Sets in Sparse Random Hypergraphs (2404.03842v2)
Abstract: We study the algorithmic task of finding large independent sets in Erdos-Renyi $r$-uniform hypergraphs on $n$ vertices having average degree $d$. Krivelevich and Sudakov showed that the maximum independent set has density $\left(\frac{r\log d}{(r-1)d}\right){1/(r-1)}$. We show that the class of low-degree polynomial algorithms can find independent sets of density $\left(\frac{\log d}{(r-1)d}\right){1/(r-1)}$ but no larger. This extends and generalizes earlier results of Gamarnik and Sudan, Rahman and Virag, and Wein on graphs, and answers a question of Bal and Bennett. We conjecture that this statistical-computational gap holds for this problem. Additionally, we explore the universality of this gap by examining $r$-partite hypergraphs. A hypergraph $H=(V,E)$ is $r$-partite if there is a partition $V=V_1\cup\cdots\cup V_r$ such that each edge contains exactly one vertex from each set $V_i$. We consider the problem of finding large balanced independent sets (independent sets containing the same number of vertices in each partition) in random $r$-partite hypergraphs with $n$ vertices in each partition and average degree $d$. We prove that the maximum balanced independent set has density $\left(\frac{r\log d}{(r-1)d}\right){1/(r-1)}$ asymptotically. Furthermore, we prove an analogous low-degree computational threshold of $\left(\frac{\log d}{(r-1)d}\right){1/(r-1)}$. Our results recover and generalize recent work of Perkins and the second author on bipartite graphs. While the graph case has been extensively studied, this work is the first to consider statistical-computational gaps of optimization problems on random hypergraphs. Our results suggest that these gaps persist for larger uniformities as well as across many models. A somewhat surprising aspect of the gap for balanced independent sets is that the algorithm achieving the lower bound is a simple degree-1 polynomial.
- “Algorithmic barriers from phase transitions” In 2008 49th Annual IEEE Symposium on Foundations of Computer Science, 2008, pp. 793–802 IEEE
- Geir Agnarsson, Magnús M Halldórsson and Elena Losievskaja “SDP-based algorithms for maximum independent set problems on hypergraphs” In Theoretical Computer Science 470 Elsevier, 2013, pp. 1–9
- “Community detection in dense random networks” In The Annals of Statistics JSTOR, 2014, pp. 940–969
- “Bipartite independence number in graphs with bounded maximum degree” In SIAM Journal on Discrete Mathematics 35.2 SIAM, 2021, pp. 1136–1148
- “Larger matchings and independent sets in regular uniform hypergraphs of high girth”, https://arxiv.org/abs/2307.15601, 2023
- “A nearly tight sum-of-squares lower bound for the planted clique problem” In SIAM Journal on Computing 48.2 SIAM, 2019, pp. 687–735
- “Computational lower bounds for sparse PCA”, https://arxiv.org/abs/1304.0828, 2013
- “Detecting high log-densities: an O (n 1/4141/41 / 4) approximation for densest k-subgraph” In Proceedings of the forty-second ACM symposium on Theory of computing, 2010, pp. 201–210
- Fabiano C Botelho, Nicholas Wormald and Nivio Ziviani “Cores of random r-partite hypergraphs” In Information Processing Letters 112.8-9 Elsevier, 2012, pp. 314–319
- “Matchings in multipartite hypergraphs”, https://arxiv.org/abs/2403.05219, 2024
- “Optimal average-case reductions to sparse pca: From weak assumptions to strong hardness” In Conference on Learning Theory, 2019, pp. 469–470 PMLR
- “The algorithmic phase transition of random k-sat for low degree polynomials” In 2021 IEEE 62nd Annual Symposium on Foundations of Computer Science (FOCS), 2022, pp. 298–309 IEEE
- Debsoumya Chakraborti “Extremal bipartite independence number and balanced coloring” In European Journal of Combinatorics 113 Elsevier, 2023, pp. 103750
- Antares Chen, Neng Huang and Kunal Marwaha “Local algorithms and the failure of log-depth quantum advantage on sparse random CSPs” In arXiv preprint arXiv:2310.01563, 2023
- “Suboptimality of local algorithms for a class of max-cut problems” In Annals of Probability 47.3 Institute of Mathematical Statistics, 2019, pp. 1587–1618
- “The densest k-subhypergraph problem” In SIAM Journal on Discrete Mathematics 32.2 SIAM, 2018, pp. 1458–1477
- Amin Coja-Oghlan, Amir Haqshenas and Samuel Hetterich “Walksat stalls well below satisfiability” In SIAM Journal on Discrete Mathematics 31.2 SIAM, 2017, pp. 1160–1173
- “Statistical and computational thresholds for the planted k-densest sub-hypergraph problem” In International Conference on Artificial Intelligence and Statistics, 2022, pp. 11615–11640 PMLR
- “Asymptotic analysis of the stochastic block model for modular networks and its algorithmic applications” In Physical review E 84.6 APS, 2011, pp. 066106
- “Improved sum-of-squares lower bounds for hidden clique and hidden submatrix problems” In Conference on Learning Theory, 2015, pp. 523–562 PMLR
- Abhishek Dhawan “Balanced independent sets and colorings of hypergraphs”, https://arxiv.org/abs/2311.01940, 2023
- Abhishek Dhawan “List colorings of k𝑘kitalic_k-partite k𝑘kitalic_k-graphs”, https://arxiv.org/abs/2311.03111, 2023
- Abhishek Dhawan, Cheng Mao and Alexander S Wein “Detection of Dense Subhypergraphs by Low-Degree Polynomials”, https://arxiv.org/abs/2304.08135, 2023
- Hang Du, Shuyang Gong and Rundong Huang “The algorithmic phase transition of random graph alignment problem”, https://arxiv.org/abs/2307.06590, 2023
- Martin Dyer, Alan Frieze and Mark Jerrum “On counting independent sets in sparse graphs” In SIAM Journal on Computing 31.5 SIAM, 2002, pp. 1527–1541
- Odile Favaron, Pedro Mago and Oscar Ordaz “On the bipartite independence number of a balanced bipartite graph” In Discrete mathematics 121.1-3 Elsevier, 1993, pp. 55–63
- “On the Densest K-subgraph Problem”, 1997
- Vitaly Feldman, Will Perkins and Santosh Vempala “On the complexity of random satisfiability problems with planted solutions” In Proceedings of the forty-seventh annual ACM symposium on Theory of Computing, 2015, pp. 77–86
- Alan M Frieze “On the independence number of random graphs” In Discrete Mathematics 81.2 Elsevier, 1990, pp. 171–175
- David Gamarnik “The overlap gap property: A topological barrier to optimizing over random structures” In Proceedings of the National Academy of Sciences 118.41 National Acad Sciences, 2021, pp. e2108492118
- David Gamarnik, Aukosh Jagannath and Alexander S Wein “Low-degree hardness of random optimization problems” In 2020 IEEE 61st Annual Symposium on Foundations of Computer Science (FOCS), 2020, pp. 131–140 IEEE
- David Gamarnik, Aukosh Jagannath and Alexander S Wein “Hardness of Random Optimization Problems for Boolean Circuits, Low-Degree Polynomials, and Langevin Dynamics” In SIAM Journal on Computing 53.1 SIAM, 2024, pp. 1–46
- “Limits of local algorithms over sparse random graphs” In Proceedings of the 5th conference on Innovations in theoretical computer science, 2014, pp. 369–376
- “Performance of the survey propagation-guided decimation algorithm for the random NAE-K-SAT problem”, https://arxiv.org/abs/1402.0052, 2014
- Venkatesan Guruswami, Sushant Sachdeva and Rishi Saket “Inapproximability of minimum vertex cover on k-uniform k-partite hypergraphs” In SIAM Journal on Discrete Mathematics 29.1 SIAM, 2015, pp. 36–58
- Venkatesan Guruswami and Ali Kemal Sinop “The complexity of finding independent sets in bounded degree (hyper) graphs of low chromatic number” In Proceedings of the Twenty-Second Annual ACM-SIAM Symposium on Discrete Algorithms, 2011, pp. 1615–1626 SIAM
- Bruce Hajek, Yihong Wu and Jiaming Xu “Computational lower bounds for community detection on random graphs” In Conference on Learning Theory, 2015, pp. 899–928 PMLR
- “Streaming algorithms for independent sets in sparse hypergraphs” In Algorithmica 76 Springer, 2016, pp. 490–501
- Magnús M Halldórsson and Elena Losievskaja “Independent sets in bounded-degree hypergraphs” In Discrete applied mathematics 157.8 Elsevier, 2009, pp. 1773–1786
- Eran Halperin “Improved approximation algorithms for the vertex cover problem in graphs and hypergraphs” In SIAM Journal on Computing 31.5 SIAM, 2002, pp. 1608–1623
- Johan Hastad “Clique is hard to approximate within n/sup 1-/spl epsiv” In Proceedings of 37th Conference on Foundations of Computer Science, 1996, pp. 627–636 IEEE
- “The power of sum-of-squares for detecting hidden structures” In 2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS), 2017, pp. 720–731 IEEE
- Samuel B Hopkins, Jonathan Shi and David Steurer “Tensor principal component analysis via sum-of-square proofs” In Conference on Learning Theory, 2015, pp. 956–1006 PMLR
- Samuel B Hopkins and David Steurer “Bayesian estimation from few samples: community detection and related problems”, https://arxiv.org/abs/1710.00264, 2017
- Mark Jerrum “Large cliques elude the Metropolis process” In Random Structures & Algorithms 3.4 Wiley Online Library, 1992, pp. 347–359
- “Sum-of-squares lower bounds for densest k-subgraph” In Proceedings of the 55th Annual ACM Symposium on Theory of Computing, 2023, pp. 84–95
- Nina Kamčev, Benny Sudakov and Jan Volec “Bounded colorings of multipartite graphs and hypergraphs” In European journal of combinatorics 66 Elsevier, 2017, pp. 235–249
- R Karp “Probabilistic analysis of some combinatorial search problems. Traub, JF (ed.): Algorithms and complexity: New Directions and Recent Results” Academic Press, 1976
- Richard M Karp “Reducibility among combinatorial problems” Springer, 2010
- Michael Kearns “Efficient noise-tolerant learning from statistical queries” In Journal of the ACM (JACM) 45.6 ACM New York, NY, USA, 1998, pp. 983–1006
- Yash Khanna, Anand Louis and Rameesh Paul “Independent sets in semi-random hypergraphs” In Algorithms and Data Structures: 17th International Symposium, WADS 2021, Virtual Event, August 9–11, 2021, Proceedings 17, 2021, pp. 528–542 Springer
- Subhash Khot “Improved inapproximability results for maxclique, chromatic number and approximate graph coloring” In Proceedings 42nd IEEE Symposium on Foundations of Computer Science, 2001, pp. 600–609 IEEE
- “Reconstruction on trees and low-degree polynomials” In Advances in Neural Information Processing Systems 35, 2022, pp. 18942–18954
- “Sum of squares lower bounds for refuting any CSP” In Proceedings of the 49th Annual ACM SIGACT Symposium on Theory of Computing, 2017, pp. 132–145
- “The chromatic numbers of random hypergraphs” In Random Structures & Algorithms 12.4 Wiley Online Library, 1998, pp. 381–403
- Thibault Lesieur, Florent Krzakala and Lenka Zdeborová “Phase transitions in sparse PCA” In 2015 IEEE International Symposium on Information Theory (ISIT), 2015, pp. 1635–1639 IEEE
- Yuetian Luo and Anru R Zhang “Tensor clustering with planted structures: Statistical optimality and computational limits” In The Annals of Statistics 50.1 Institute of Mathematical Statistics, 2022, pp. 584–613
- Cheng Mao, Alexander S Wein and Shenduo Zhang “Detection-Recovery Gap for Planted Dense Cycles”, https://arxiv.org/abs/2302.06737, 2023
- Cheng Mao, Alexander S Wein and Shenduo Zhang “Information-Theoretic Thresholds for Planted Dense Cycles”, https://arxiv.org/abs/2402.00305, 2024
- D Matula “The largest clique size in a random graph. Southern Methodist University”, 1976
- Raghu Meka, Aaron Potechin and Avi Wigderson “Sum-of-squares lower bounds for planted clique” In Proceedings of the forty-seventh annual ACM symposium on Theory of computing, 2015, pp. 87–96
- “Randomized greedy algorithm for independent sets in regular uniform hypergraphs with large girth” In Random Structures & Algorithms 59.1 Wiley Online Library, 2021, pp. 79–95
- “Community detection in the sparse hypergraph stochastic block model” In Random Structures & Algorithms 59.3 Wiley Online Library, 2021, pp. 407–463
- “On the hardness of finding balanced independent sets in random bipartite graphs” In Proceedings of the 2024 Annual ACM-SIAM Symposium on Discrete Algorithms (SODA), 2024, pp. 2376–2397 SIAM
- “Local algorithms for independent sets are half-optimal” In Annals of Probability 45.3 Institute of Mathematical Statistics, 2017, pp. 1543–1577
- Prayaag Venkat “Efficient algorithms for certifying lower bounds on the discrepancy of random matrices”, https://arxiv.org/abs/2211.07503, 2022
- Alexander S Wein “Optimal low-degree hardness of maximum independent set” In Mathematical Statistics and Learning 4.3, 2022, pp. 221–251
- “Heterogeneous dense subhypergraph detection”, https://arxiv.org/abs/2104.04047, 2021
- “Information limits for detecting a subhypergraph” In Stat 10.1 Wiley Online Library, 2021, pp. e407
- David Zuckerman “Linear degree extractors and the inapproximability of max clique and chromatic number” In Proceedings of the thirty-eighth annual ACM symposium on Theory of computing, 2006, pp. 681–690