The Overlap Gap Property limits limit swapping in QAOA (2404.06087v4)
Abstract: The Quantum Approximate Optimization Algorithm (QAOA) is a quantum algorithm designed for Combinatorial Optimization Problem (COP). We show that if a local algorithm is limited in performance at logarithmic depth for a spin glass type COP with an underlying Erd\"os--R\'enyi hypergraph, then a random regular hypergraph exhibits it as well. As such, we re-derived the fact that the average-case value obtained by QAOA for the Max-$q$-XORSAT for even $q\ge 4$ is bounded away from optimality even when the algorithm runs indefinitely if optimised using the so-called tree parameters due to the presence of the Overlap Gap Property (OGP). While this result was proven before, the proof is rather technical compared to ours. In addition, we show that the earlier result implicitly also implies limitation at logarithmic depth $p \le \epsilon \log n$ providing an improvement over limitation at superconstant depth. Lastly, the results suggests that even when sub-optimised, the performance of QAOA on spin glass is equal in performance to classical algorithms in solving the mean field spin glass problem providing further evidence that the conjecture of getting the exact solution under limit swapping for the Sherrington--Kirkpatrick model to be true.
- D. Gamarnik, C. Moore, and L. Zdeborová , “Disordered systems insights on computational hardness,” Journal of Statistical Mechanics: Theory and Experiment, vol. 2022, no. 11, p. 114015, nov 2022. [Online]. Available: https://doi.org/10.1088%2F1742-5468%2Fac9cc8
- E. Farhi, J. Goldstone, and S. Gutmann, “A quantum approximate optimization algorithm,” 2014.
- E. Farhi, J. Goldstone, S. Gutmann, and L. Zhou, “The Quantum Approximate Optimization Algorithm and the Sherrington-Kirkpatrick Model at Infinite Size,” Quantum, vol. 6, p. 759, Jul. 2022. [Online]. Available: https://doi.org/10.22331/q-2022-07-07-759
- J. Basso, E. Farhi, K. Marwaha, B. Villalonga, and L. Zhou, “The quantum approximate optimization algorithm at high depth for maxcut on large-girth regular graphs and the Sherrington-Kirkpatrick model.” Schloss Dagstuhl - Leibniz-Zentrum für Informatik, 2022. [Online]. Available: https://drops.dagstuhl.de/opus/volltexte/2022/16514/
- E. Farhi, D. Gamarnik, and S. Gutmann, “The Quantum Approximate Optimization Algorithm Needs to See the Whole Graph: A Typical Case,” 4 2020.
- J. Basso, D. Gamarnik, S. Mei, and L. Zhou, “Performance and limitations of the QAOA at constant levels on large sparse hypergraphs and spin glass models,” in 2022 IEEE 63rd Annual Symposium on Foundations of Computer Science (FOCS). IEEE, oct 2022. [Online]. Available: https://doi.org/10.1109%2Ffocs54457.2022.00039
- S. F. Edwards and P. W. Anderson, “Theory of spin glasses,” Journal of Physics F: Metal Physics, vol. 5, no. 5, p. 965, may 1975. [Online]. Available: https://dx.doi.org/10.1088/0305-4608/5/5/017
- D. Sherrington and S. Kirkpatrick, “Solvable model of a spin-glass,” Phys. Rev. Lett., vol. 35, pp. 1792–1796, Dec 1975. [Online]. Available: https://link.aps.org/doi/10.1103/PhysRevLett.35.1792
- T. Castellani and A. Cavagna, “Spin-glass theory for pedestrians,” Journal of Statistical Mechanics: Theory and Experiment, vol. 2005, no. 05, p. P05012, May 2005. [Online]. Available: http://dx.doi.org/10.1088/1742-5468/2005/05/P05012
- G. Parisi, “A Sequence of Approximated Solutions to the S-K𝐾Kitalic_K Model for Spin Glasses,” J. Phys. A, vol. 13, p. L115, 1980.
- M. Talagrand, “The Parisi formula,” Annals of Mathematics, vol. 163, no. 1, pp. 221–263, 2006. [Online]. Available: http://www.jstor.org/stable/20159953
- D. Panchenko, “The Parisi formula for mixed p𝑝pitalic_p-spin models,” The Annals of Probability, vol. 42, no. 3, May 2014. [Online]. Available: http://dx.doi.org/10.1214/12-AOP800
- T. Luczak, “On the equivalence of two basic models of random graph,” in Proceedings of Random graphs, vol. 87, 1990, pp. 151–159.
- B. Bollobás, “A probabilistic proof of an asymptotic formula for the number of labelled regular graphs,” European Journal of Combinatorics, vol. 1, no. 4, pp. 311–316, 1980. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0195669880800308
- A. Dembo, A. Montanari, and S. Sen, “Extremal cuts of sparse random graphs,” The Annals of Probability, vol. 45, no. 2, Mar. 2017. [Online]. Available: http://dx.doi.org/10.1214/15-AOP1084
- M. Dietzfelbinger, A. Goerdt, M. Mitzenmacher, A. Montanari, R. Pagh, and M. Rink, “Tight thresholds for cuckoo hashing via xorsat,” in Automata, Languages and Programming, S. Abramsky, C. Gavoille, C. Kirchner, F. Meyer auf der Heide, and P. G. Spirakis, Eds. Berlin, Heidelberg: Springer Berlin Heidelberg, 2010, pp. 213–225.
- S. Sen, “Optimization on sparse random hypergraphs and spin glasses,” Random Structures & Algorithms, vol. 53, no. 3, pp. 504–536, 2018. [Online]. Available: https://onlinelibrary.wiley.com/doi/abs/10.1002/rsa.20774
- D. Gamarnik and Q. li, “Finding a large submatrix of a Gaussian random matrix,” Annals of Statistics, vol. 46, 02 2016.
- D. Achlioptas, A. Coja-Oghlan, and F. Ricci-Tersenghi, “On the solution-space geometry of random constraint satisfaction problems,” Random Structures & Algorithms, vol. 38, no. 3, pp. 251–268, 2011. [Online]. Available: https://onlinelibrary.wiley.com/doi/abs/10.1002/rsa.20323
- M. Mézard, T. Mora, and R. Zecchina, “Clustering of solutions in the random satisfiability problem,” Physical Review Letters, vol. 94, no. 19, May 2005. [Online]. Available: http://dx.doi.org/10.1103/PhysRevLett.94.197205
- D. Gamarnik, “The overlap gap property: A topological barrier to optimizing over random structures,” Proceedings of the National Academy of Sciences, vol. 118, no. 41, oct 2021. [Online]. Available: https://doi.org/10.1073%2Fpnas.2108492118
- W.-K. Chen, D. Gamarnik, D. Panchenko, and M. Rahman, “Suboptimality of local algorithms for a class of max-cut problems,” The Annals of Probability, vol. 47, no. 3, may 2019. [Online]. Available: https://doi.org/10.1214%2F18-aop1291
- C.-N. Chou, P. J. Love, J. S. Sandhu, and J. Shi, “Limitations of Local Quantum Algorithms on Random MAX-k-XOR and Beyond,” in 49th International Colloquium on Automata, Languages, and Programming (ICALP 2022), ser. Leibniz International Proceedings in Informatics (LIPIcs), M. Bojańczyk, E. Merelli, and D. P. Woodruff, Eds., vol. 229. Dagstuhl, Germany: Schloss Dagstuhl – Leibniz-Zentrum für Informatik, 2022, pp. 41:1–41:20. [Online]. Available: https://drops.dagstuhl.de/entities/document/10.4230/LIPIcs.ICALP.2022.41
- L. Zhou, S.-T. Wang, S. Choi, H. Pichler, and M. D. Lukin, “Quantum approximate optimization algorithm: Performance, mechanism, and implementation on near-term devices,” Physical Review X, vol. 10, no. 2, Jun. 2020. [Online]. Available: http://dx.doi.org/10.1103/PhysRevX.10.021067
- D. Gamarnik and I. Zadik, “The landscape of the planted clique problem: Dense subgraphs and the overlap gap property,” 2019.
- A. Dudek, A. Frieze, A. Ruciński, and M. Šileikis, “Embedding the erdős–rényi hypergraph into the random regular hypergraph and hamiltonicity,” Journal of Combinatorial Theory, Series B, vol. 122, p. 719–740, Jan. 2017. [Online]. Available: http://dx.doi.org/10.1016/j.jctb.2016.09.003
- D. Ellis and N. Linial, “On regular hypergraphs of high girth,” Electron. J. Comb., vol. 21, p. 1, 2013. [Online]. Available: https://api.semanticscholar.org/CorpusID:961773
- D. J. Poole, “On the strength of connectedness of a random hypergraph,” Electron. J. Comb., vol. 22, no. 1, p. 1, 2015. [Online]. Available: https://doi.org/10.37236/4666
- M. Goh. (2024) The overlap gap property limits limit swapping. [Online]. Available: https://github.com/capselo/The-Overlap-Gap-Property-limits-limit-swapping
- A. E. Alaoui and A. Montanari, “Algorithmic thresholds in mean field spin glasses,” 2020.