Semirandom Planted Clique and the Restricted Isometry Property (2404.14159v2)
Abstract: We give a simple, greedy $O(n{\omega+0.5})=O(n{2.872})$-time algorithm to list-decode planted cliques in a semirandom model introduced in CSV17 that succeeds whenever the size of the planted clique is $k\geq O(\sqrt{n} \log2 n)$. In the model, the edges touching the vertices in the planted $k$-clique are drawn independently with probability $p=1/2$ while the edges not touching the planted clique are chosen by an adversary in response to the random choices. Our result shows that the computational threshold in the semirandom setting is within a $O(\log2 n)$ factor of the information-theoretic one [Ste17] thus resolving an open question of Steinhardt. This threshold also essentially matches the conjectured computational threshold for the well-studied special case of fully random planted clique. All previous algorithms [CSV17, MMT20, BKS23] in this model are based on rather sophisticated rounding algorithms for entropy-constrained semidefinite programming relaxations and their sum-of-squares strengthenings and the best known guarantee is a $n{O(1/\epsilon)}$-time algorithm to list-decode planted cliques of size $k \geq \tilde{O}(n{1/2+\epsilon})$. In particular, the guarantee trivializes to quasi-polynomial time if the planted clique is of size $O(\sqrt{n} \operatorname{polylog} n)$. Our algorithm achieves an almost optimal guarantee with a surprisingly simple greedy algorithm. The prior state-of-the-art algorithmic result above is based on a reduction to certifying bounds on the size of unbalanced bicliques in random graphs -- closely related to certifying the restricted isometry property (RIP) of certain random matrices and known to be hard in the low-degree polynomial model. Our key idea is a new approach that relies on the truth of -- but not efficient certificates for -- RIP of a new class of matrices built from the input graphs.
- Finding a large hidden clique in a random graph. In Proceedings of the Eighth International Conference “Random Structures and Algorithms” (Poznan, 1997), volume 13, pages 457–466, 1998.
- Reducibility and statistical-computational gaps from secret leakage. In Conference on Learning Theory, pages 648–847. PMLR, 2020.
- Reducibility and computational lower bounds for problems with planted sparse structure. In Conference On Learning Theory, pages 48–166. PMLR, 2018.
- Certifying the restricted isometry property is hard. IEEE Trans. Information Theory, 59(6):3448–3450, 2013.
- A Nearly Tight Sum-of-Squares Lower Bound for the Planted Clique Problem. In Proceedings of the 57th Annual IEEE Symposium on Foundations of Computer Science, 2016.
- Algorithms approaching the threshold for semi-random planted clique. In STOC’23—Proceedings of the 55th Annual ACM Symposium on Theory of Computing, pages 1918–1926. ACM, New York, [2023] ©2023.
- An improved lower bound for sparse reconstruction from subsampled walsh matrices. Discrete Analysis, 5 2023.
- Complexity theoretic lower bounds for sparse principal component detection. In COLT, volume 30 of JMLR Workshop and Conference Proceedings, pages 1046–1066. JMLR.org, 2013.
- Computational lower bounds for sparse pca. arXiv preprint arXiv:1304.0828, 2013.
- A. Blum and J. Spencer. Coloring random and semi-random k-colorable graphs. Journal of Algorithms, 19(2):204 – 234, 1995.
- Learning from untrusted data. In STOC, pages 47–60. ACM, 2017.
- The average-case time complexity of certifying the restricted isometry property. IEEE Trans. Inform. Theory, 67(11):7355–7361, 2021.
- Uriel Feige. Introduction to semirandom models. In Tim Roughgarden, editor, Beyond Worst-case Analysis of Algorithms, chapter 10, pages 266–290. Oxford, 2019.
- Statistical algorithms and a lower bound for detecting planted cliques. J. ACM, 64(2):Art. 8, 37, 2017.
- Finding and certifying a large hidden clique in a semirandom graph. Random Struct. Algorithms, 16(2):195–208, 2000.
- Heuristics for semirandom graph problems. Journal of Computer and System Sciences, 63(4):639 – 671, 2001.
- A Mathematical Introduction to Compressive Sensing. Birkhäuser Basel, 2013.
- Johan Håstad. Clique is hard to approximate within n1−εsuperscript𝑛1𝜀n^{1-\varepsilon}italic_n start_POSTSUPERSCRIPT 1 - italic_ε end_POSTSUPERSCRIPT. Acta Math., 182(1):105–142, 1999.
- The power of sum-of-squares for detecting hidden structures. In 2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS), pages 720–731. IEEE, 2017.
- Mark Jerrum. Large cliques elude the metropolis process. Random Struct. Algorithms, 3(4):347–360, 1992.
- Polynomial-time sum-of-squares can robustly estimate mean and covariance of gaussians optimally. In International Conference on Algorithmic Learning Theory, pages 638–667. PMLR, 2022.
- Ludek Kucera. Expected complexity of graph partitioning problems. Discrete Applied Mathematics, 57(2-3):193–212, 1995.
- Hidden cliques and the certification of the restricted isometry property. IEEE Trans. Information Theory, 60(8):4999–5006, 2014.
- Hidden cliques and the certification of the restricted isometry property. IEEE Trans. Inform. Theory, 60(8):4999–5006, 2014.
- Yudell L. Luke. Chapter II. The Gamma Function and Related Functions. In The Special Functions and Their Approximations, volume 53 of Mathematics in Science and Engineering, pages 8–37. Elsevier, 1969.
- A new algorithm for the robust semi-random independent set problem. In Shuchi Chawla, editor, Proceedings of the 2020 ACM-SIAM Symposium on Discrete Algorithms, pages 738–746, 2020.
- How robust are reconstruction thresholds for community detection? In STOC, pages 828–841. ACM, 2016.
- Holger Rauhut. Compressive sensing and structured random matrices. In Theoretical foundations and numerical methods for sparse recovery, volume 9 of Radon Ser. Comput. Appl. Math., pages 1–92. Walter de Gruyter, Berlin, 2010.
- Guaranteed minimum-rank solutions of linear matrix equations via nuclear norm minimization. SIAM Review, 52(3):471–501, 2010.
- On sparse reconstruction from Fourier and Gaussian measurements. Comm. Pure Appl. Math., 61(8):1025–1045, 2008.
- Jacob Steinhardt. Does robustness imply tractability? a lower bound for planted clique in the semi-random model. arXiv preprint arXiv:1704.05120, 2017.
- David Zuckerman. Linear degree extractors and the inapproximability of max clique and chromatic number. Theory Comput., 3:103–128, 2007.