Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
129 tokens/sec
GPT-4o
28 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

The Low-Degree Hardness of Finding Large Independent Sets in Sparse Random Hypergraphs (2404.03842v2)

Published 5 Apr 2024 in cs.CC, cs.DS, math.CO, math.PR, and stat.ML

Abstract: We study the algorithmic task of finding large independent sets in Erdos-Renyi $r$-uniform hypergraphs on $n$ vertices having average degree $d$. Krivelevich and Sudakov showed that the maximum independent set has density $\left(\frac{r\log d}{(r-1)d}\right){1/(r-1)}$. We show that the class of low-degree polynomial algorithms can find independent sets of density $\left(\frac{\log d}{(r-1)d}\right){1/(r-1)}$ but no larger. This extends and generalizes earlier results of Gamarnik and Sudan, Rahman and Virag, and Wein on graphs, and answers a question of Bal and Bennett. We conjecture that this statistical-computational gap holds for this problem. Additionally, we explore the universality of this gap by examining $r$-partite hypergraphs. A hypergraph $H=(V,E)$ is $r$-partite if there is a partition $V=V_1\cup\cdots\cup V_r$ such that each edge contains exactly one vertex from each set $V_i$. We consider the problem of finding large balanced independent sets (independent sets containing the same number of vertices in each partition) in random $r$-partite hypergraphs with $n$ vertices in each partition and average degree $d$. We prove that the maximum balanced independent set has density $\left(\frac{r\log d}{(r-1)d}\right){1/(r-1)}$ asymptotically. Furthermore, we prove an analogous low-degree computational threshold of $\left(\frac{\log d}{(r-1)d}\right){1/(r-1)}$. Our results recover and generalize recent work of Perkins and the second author on bipartite graphs. While the graph case has been extensively studied, this work is the first to consider statistical-computational gaps of optimization problems on random hypergraphs. Our results suggest that these gaps persist for larger uniformities as well as across many models. A somewhat surprising aspect of the gap for balanced independent sets is that the algorithm achieving the lower bound is a simple degree-1 polynomial.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (70)
  1. “Algorithmic barriers from phase transitions” In 2008 49th Annual IEEE Symposium on Foundations of Computer Science, 2008, pp. 793–802 IEEE
  2. Geir Agnarsson, Magnús M Halldórsson and Elena Losievskaja “SDP-based algorithms for maximum independent set problems on hypergraphs” In Theoretical Computer Science 470 Elsevier, 2013, pp. 1–9
  3. “Community detection in dense random networks” In The Annals of Statistics JSTOR, 2014, pp. 940–969
  4. “Bipartite independence number in graphs with bounded maximum degree” In SIAM Journal on Discrete Mathematics 35.2 SIAM, 2021, pp. 1136–1148
  5. “Larger matchings and independent sets in regular uniform hypergraphs of high girth”, https://arxiv.org/abs/2307.15601, 2023
  6. “A nearly tight sum-of-squares lower bound for the planted clique problem” In SIAM Journal on Computing 48.2 SIAM, 2019, pp. 687–735
  7. “Computational lower bounds for sparse PCA”, https://arxiv.org/abs/1304.0828, 2013
  8. “Detecting high log-densities: an O (n 1/4141/41 / 4) approximation for densest k-subgraph” In Proceedings of the forty-second ACM symposium on Theory of computing, 2010, pp. 201–210
  9. Fabiano C Botelho, Nicholas Wormald and Nivio Ziviani “Cores of random r-partite hypergraphs” In Information Processing Letters 112.8-9 Elsevier, 2012, pp. 314–319
  10. “Matchings in multipartite hypergraphs”, https://arxiv.org/abs/2403.05219, 2024
  11. “Optimal average-case reductions to sparse pca: From weak assumptions to strong hardness” In Conference on Learning Theory, 2019, pp. 469–470 PMLR
  12. “The algorithmic phase transition of random k-sat for low degree polynomials” In 2021 IEEE 62nd Annual Symposium on Foundations of Computer Science (FOCS), 2022, pp. 298–309 IEEE
  13. Debsoumya Chakraborti “Extremal bipartite independence number and balanced coloring” In European Journal of Combinatorics 113 Elsevier, 2023, pp. 103750
  14. Antares Chen, Neng Huang and Kunal Marwaha “Local algorithms and the failure of log-depth quantum advantage on sparse random CSPs” In arXiv preprint arXiv:2310.01563, 2023
  15. “Suboptimality of local algorithms for a class of max-cut problems” In Annals of Probability 47.3 Institute of Mathematical Statistics, 2019, pp. 1587–1618
  16. “The densest k-subhypergraph problem” In SIAM Journal on Discrete Mathematics 32.2 SIAM, 2018, pp. 1458–1477
  17. Amin Coja-Oghlan, Amir Haqshenas and Samuel Hetterich “Walksat stalls well below satisfiability” In SIAM Journal on Discrete Mathematics 31.2 SIAM, 2017, pp. 1160–1173
  18. “Statistical and computational thresholds for the planted k-densest sub-hypergraph problem” In International Conference on Artificial Intelligence and Statistics, 2022, pp. 11615–11640 PMLR
  19. “Asymptotic analysis of the stochastic block model for modular networks and its algorithmic applications” In Physical review E 84.6 APS, 2011, pp. 066106
  20. “Improved sum-of-squares lower bounds for hidden clique and hidden submatrix problems” In Conference on Learning Theory, 2015, pp. 523–562 PMLR
  21. Abhishek Dhawan “Balanced independent sets and colorings of hypergraphs”, https://arxiv.org/abs/2311.01940, 2023
  22. Abhishek Dhawan “List colorings of k𝑘kitalic_k-partite k𝑘kitalic_k-graphs”, https://arxiv.org/abs/2311.03111, 2023
  23. Abhishek Dhawan, Cheng Mao and Alexander S Wein “Detection of Dense Subhypergraphs by Low-Degree Polynomials”, https://arxiv.org/abs/2304.08135, 2023
  24. Hang Du, Shuyang Gong and Rundong Huang “The algorithmic phase transition of random graph alignment problem”, https://arxiv.org/abs/2307.06590, 2023
  25. Martin Dyer, Alan Frieze and Mark Jerrum “On counting independent sets in sparse graphs” In SIAM Journal on Computing 31.5 SIAM, 2002, pp. 1527–1541
  26. Odile Favaron, Pedro Mago and Oscar Ordaz “On the bipartite independence number of a balanced bipartite graph” In Discrete mathematics 121.1-3 Elsevier, 1993, pp. 55–63
  27. “On the Densest K-subgraph Problem”, 1997
  28. Vitaly Feldman, Will Perkins and Santosh Vempala “On the complexity of random satisfiability problems with planted solutions” In Proceedings of the forty-seventh annual ACM symposium on Theory of Computing, 2015, pp. 77–86
  29. Alan M Frieze “On the independence number of random graphs” In Discrete Mathematics 81.2 Elsevier, 1990, pp. 171–175
  30. David Gamarnik “The overlap gap property: A topological barrier to optimizing over random structures” In Proceedings of the National Academy of Sciences 118.41 National Acad Sciences, 2021, pp. e2108492118
  31. David Gamarnik, Aukosh Jagannath and Alexander S Wein “Low-degree hardness of random optimization problems” In 2020 IEEE 61st Annual Symposium on Foundations of Computer Science (FOCS), 2020, pp. 131–140 IEEE
  32. David Gamarnik, Aukosh Jagannath and Alexander S Wein “Hardness of Random Optimization Problems for Boolean Circuits, Low-Degree Polynomials, and Langevin Dynamics” In SIAM Journal on Computing 53.1 SIAM, 2024, pp. 1–46
  33. “Limits of local algorithms over sparse random graphs” In Proceedings of the 5th conference on Innovations in theoretical computer science, 2014, pp. 369–376
  34. “Performance of the survey propagation-guided decimation algorithm for the random NAE-K-SAT problem”, https://arxiv.org/abs/1402.0052, 2014
  35. Venkatesan Guruswami, Sushant Sachdeva and Rishi Saket “Inapproximability of minimum vertex cover on k-uniform k-partite hypergraphs” In SIAM Journal on Discrete Mathematics 29.1 SIAM, 2015, pp. 36–58
  36. Venkatesan Guruswami and Ali Kemal Sinop “The complexity of finding independent sets in bounded degree (hyper) graphs of low chromatic number” In Proceedings of the Twenty-Second Annual ACM-SIAM Symposium on Discrete Algorithms, 2011, pp. 1615–1626 SIAM
  37. Bruce Hajek, Yihong Wu and Jiaming Xu “Computational lower bounds for community detection on random graphs” In Conference on Learning Theory, 2015, pp. 899–928 PMLR
  38. “Streaming algorithms for independent sets in sparse hypergraphs” In Algorithmica 76 Springer, 2016, pp. 490–501
  39. Magnús M Halldórsson and Elena Losievskaja “Independent sets in bounded-degree hypergraphs” In Discrete applied mathematics 157.8 Elsevier, 2009, pp. 1773–1786
  40. Eran Halperin “Improved approximation algorithms for the vertex cover problem in graphs and hypergraphs” In SIAM Journal on Computing 31.5 SIAM, 2002, pp. 1608–1623
  41. Johan Hastad “Clique is hard to approximate within n/sup 1-/spl epsiv” In Proceedings of 37th Conference on Foundations of Computer Science, 1996, pp. 627–636 IEEE
  42. “The power of sum-of-squares for detecting hidden structures” In 2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS), 2017, pp. 720–731 IEEE
  43. Samuel B Hopkins, Jonathan Shi and David Steurer “Tensor principal component analysis via sum-of-square proofs” In Conference on Learning Theory, 2015, pp. 956–1006 PMLR
  44. Samuel B Hopkins and David Steurer “Bayesian estimation from few samples: community detection and related problems”, https://arxiv.org/abs/1710.00264, 2017
  45. Mark Jerrum “Large cliques elude the Metropolis process” In Random Structures & Algorithms 3.4 Wiley Online Library, 1992, pp. 347–359
  46. “Sum-of-squares lower bounds for densest k-subgraph” In Proceedings of the 55th Annual ACM Symposium on Theory of Computing, 2023, pp. 84–95
  47. Nina Kamčev, Benny Sudakov and Jan Volec “Bounded colorings of multipartite graphs and hypergraphs” In European journal of combinatorics 66 Elsevier, 2017, pp. 235–249
  48. R Karp “Probabilistic analysis of some combinatorial search problems. Traub, JF (ed.): Algorithms and complexity: New Directions and Recent Results” Academic Press, 1976
  49. Richard M Karp “Reducibility among combinatorial problems” Springer, 2010
  50. Michael Kearns “Efficient noise-tolerant learning from statistical queries” In Journal of the ACM (JACM) 45.6 ACM New York, NY, USA, 1998, pp. 983–1006
  51. Yash Khanna, Anand Louis and Rameesh Paul “Independent sets in semi-random hypergraphs” In Algorithms and Data Structures: 17th International Symposium, WADS 2021, Virtual Event, August 9–11, 2021, Proceedings 17, 2021, pp. 528–542 Springer
  52. Subhash Khot “Improved inapproximability results for maxclique, chromatic number and approximate graph coloring” In Proceedings 42nd IEEE Symposium on Foundations of Computer Science, 2001, pp. 600–609 IEEE
  53. “Reconstruction on trees and low-degree polynomials” In Advances in Neural Information Processing Systems 35, 2022, pp. 18942–18954
  54. “Sum of squares lower bounds for refuting any CSP” In Proceedings of the 49th Annual ACM SIGACT Symposium on Theory of Computing, 2017, pp. 132–145
  55. “The chromatic numbers of random hypergraphs” In Random Structures & Algorithms 12.4 Wiley Online Library, 1998, pp. 381–403
  56. Thibault Lesieur, Florent Krzakala and Lenka Zdeborová “Phase transitions in sparse PCA” In 2015 IEEE International Symposium on Information Theory (ISIT), 2015, pp. 1635–1639 IEEE
  57. Yuetian Luo and Anru R Zhang “Tensor clustering with planted structures: Statistical optimality and computational limits” In The Annals of Statistics 50.1 Institute of Mathematical Statistics, 2022, pp. 584–613
  58. Cheng Mao, Alexander S Wein and Shenduo Zhang “Detection-Recovery Gap for Planted Dense Cycles”, https://arxiv.org/abs/2302.06737, 2023
  59. Cheng Mao, Alexander S Wein and Shenduo Zhang “Information-Theoretic Thresholds for Planted Dense Cycles”, https://arxiv.org/abs/2402.00305, 2024
  60. D Matula “The largest clique size in a random graph. Southern Methodist University”, 1976
  61. Raghu Meka, Aaron Potechin and Avi Wigderson “Sum-of-squares lower bounds for planted clique” In Proceedings of the forty-seventh annual ACM symposium on Theory of computing, 2015, pp. 87–96
  62. “Randomized greedy algorithm for independent sets in regular uniform hypergraphs with large girth” In Random Structures & Algorithms 59.1 Wiley Online Library, 2021, pp. 79–95
  63. “Community detection in the sparse hypergraph stochastic block model” In Random Structures & Algorithms 59.3 Wiley Online Library, 2021, pp. 407–463
  64. “On the hardness of finding balanced independent sets in random bipartite graphs” In Proceedings of the 2024 Annual ACM-SIAM Symposium on Discrete Algorithms (SODA), 2024, pp. 2376–2397 SIAM
  65. “Local algorithms for independent sets are half-optimal” In Annals of Probability 45.3 Institute of Mathematical Statistics, 2017, pp. 1543–1577
  66. Prayaag Venkat “Efficient algorithms for certifying lower bounds on the discrepancy of random matrices”, https://arxiv.org/abs/2211.07503, 2022
  67. Alexander S Wein “Optimal low-degree hardness of maximum independent set” In Mathematical Statistics and Learning 4.3, 2022, pp. 221–251
  68. “Heterogeneous dense subhypergraph detection”, https://arxiv.org/abs/2104.04047, 2021
  69. “Information limits for detecting a subhypergraph” In Stat 10.1 Wiley Online Library, 2021, pp. e407
  70. David Zuckerman “Linear degree extractors and the inapproximability of max clique and chromatic number” In Proceedings of the thirty-eighth annual ACM symposium on Theory of computing, 2006, pp. 681–690

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com