On sampling diluted Spin Glasses using Glauber dynamics (2403.08921v1)
Abstract: Spin-glasses are Gibbs distributions that have been studied in CS for many decades. Recently, they have gained renewed attention as they emerge naturally in learning, inference, optimisation etc. We consider the Edwards-Anderson (EA) spin-glass distribution at inverse temperature $\beta$ when the underlying graph is an instance of $G(n,d/n)$. This is the random graph on $n$ vertices where each edge appears independently with probability $d/n$ and $d=\Theta(1)$. We study the problem of approximate sampling from this distribution using Glauber dynamics. For a range of $\beta$ that depends on $d$ and for typical instances of the EA model on $G(n,d/n)$, we show that the corresponding Glauber dynamics exhibits mixing time $O(n{2+\frac{3}{\log2 d}})$. The range of $\beta$ for which we obtain our rapid-mixing results correspond to the expected influence being $<1/d$; we conjecture that this is the best possible. Unlike the mean-field spin-glasses, where the problem has been studied before, the diluted case has not. We utilise the well-known path-coupling technique. In the standard Glauber dynamics on $G(n,d/n)$, one has to deal with the so-called effect of high degree vertices. Here, rather than considering degrees, it is more natural to use a different measure on the vertices called aggregate influence. We build on the block-construction approach proposed by [Dyer et al. 2006] to circumvent the problem of high-degree vertices. Specifically, we first establish rapid mixing for an appropriately defined block-dynamics. We design this dynamics such that vertices of large aggregate influence are placed deep inside their blocks. Then, we obtain rapid mixing for the Glauber dynamics utilising a comparison argument.
- Algorithmic barriers from phase transitions. In 49th Annual IEEE Symposium on Foundations of Computer Science, FOCS 2008, pages 793–802. IEEE Computer Society, 2008. URL: https://doi.org/10.1109/FOCS.2008.11.
- Algorithmic thresholds in mean field spin glasses. arXiv preprint arXiv:2009.11481, 2020.
- Optimization of mean-field spin glasses. The Annals of Probability, 49(6):2922 – 2960, 2021. URL: https://doi.org/10.1214/21-AOP1519.
- Sampling from the sherrington-kirkpatrick gibbs measure via algorithmic stochastic localization. In 63rd IEEE Annual Symposium on Foundations of Computer Science, FOCS 2022, pages 323–334. IEEE, 2022.
- Spectral independence in high-dimensional expanders and applications to the hardcore model. In 61st IEEE Annual Symposium on Foundations of Computer Science, FOCS 2020, pages 1319–1330. IEEE, 2020.
- A very simple proof of the lsi for high temperature spin systems. Journal of Functional Analysis, 276(8):2582–2588, 2019.
- Fast sampling via spectral independence beyond bounded-degree graphs. In 49th International Colloquium on Automata, Languages, and Programming, ICALP 2022, volume 229, pages 21:1–21:16, 2022.
- Path coupling: A technique for proving rapid mixing in markov chains. In Proceedings 38th Annual Symposium on Foundations of Computer Science, pages 223–231. IEEE, 1997.
- Optimal mixing for two-state anti-ferromagnetic spin systems. In 63rd IEEE Annual Symposium on Foundations of Computer Science, FOCS 2022, pages 588–599. IEEE, 2022.
- Optimal mixing of glauber dynamics: entropy factorization via high-dimensional expansion. In STOC ’21: 53rd Annual ACM SIGACT Symposium on Theory of Computing, Virtual Event, Italy, June 21-25, 2021, pages 1537–1550. ACM, 2021.
- From algorithms to connectivity and back: Finding a giant component in random k-sat. In Proceedings of the 2023 ACM-SIAM Symposium on Discrete Algorithms, SODA 2023, pages 3437–3470. SIAM, 2023. URL: https://doi.org/10.1137/1.9781611977554.ch132.
- On independent sets in random graphs. In Proceedings of the Twenty-Second Annual ACM-SIAM Symposium on Discrete Algorithms, SODA 2011, pages 136–144. SIAM, 2011. URL: https://doi.org/10.1137/1.9781611973082.12.
- Charting the replica symmetric phase. Communications in Mathematical Physics, 359:603–698, 2018.
- Randomly coloring sparse random graphs with fewer colors than the maximum degree. Random Structures & Algorithms, 29(4):450–465, 2006.
- Randomly coloring random graphs. Random Struct. Algorithms, 36(3):251–272, 2010. URL: https://doi.org/10.1002/rsa.20286.
- Theory of spin glasses. Journal of Physics F: Metal Physics, 5(5):965, 1975.
- Charilaos Efthymiou. MCMC sampling colourings and independent sets of G(n, d/n) near uniqueness threshold. In Proceedings of the Twenty-Fifth Annual ACM-SIAM Symposium on Discrete Algorithms, SODA 2014, pages 305–316. SIAM, 2014.
- Charilaos Efthymiou. On Sampling Symmetric Gibbs Distributions on Sparse Random Graphs and Hypergraphs. In 49th International Colloquium on Automata, Languages, and Programming, ICALP 2022, July 4-8, 2022, volume 229, pages 57:1–57:16. Schloss Dagstuhl - Leibniz-Zentrum für Informatik, 2022.
- On the mixing time of glauber dynamics for the hard-core and related models on g(n, d/n). CoRR, abs/2302.06172, 2023. URL: https://doi.org/10.48550/arXiv.2302.06172, arXiv:2302.06172.
- Sampling random colorings of sparse random graphs. In Proceedings of the Twenty-Ninth Annual ACM-SIAM Symposium on Discrete Algorithms, SODA 2018, pages 1759–1771. SIAM, 2018.
- Sampling random colorings of sparse random graphs. In Proceedings of the Twenty-Ninth Annual ACM-SIAM Symposium on Discrete Algorithms, pages 1759–1771. SIAM, 2018.
- Broadcasting with random matrices. CoRR, abs/2302.11657, 2023. arXiv:2302.11657, doi:10.48550/arXiv.2302.11657.
- A spectral condition for spectral gap: fast mixing in high-temperature ising models. Probability theory and related fields, 182(3-4):1035–1051, 2022.
- Exact solutions for diluted spin glasses and optimization problems. Physical review letters, 87(12):127209, 2001.
- Inapproximability for antiferromagnetic spin systems in the tree nonuniqueness region. J. ACM, 62(6):50:1–50:60, 2015.
- Low-degree hardness of random optimization problems. In 61st IEEE Annual Symposium on Foundations of Computer Science, FOCS 2020, pages 131–140. IEEE, 2020. URL: https://doi.org/10.1109/FOCS46700.2020.00021.
- Performance of sequential local algorithms for the random NAE-K-SAT problem. SIAM J. Comput., 46(2):590–619, 2017.
- The high temperature region of the Viana-Bray diluted spin glass model. Journal of statistical physics, 115:531–555, 2004.
- Sampling approximately low-rank ising models: MCMC meets variational methods. In Conference on Learning Theory, 2022, volume 178 of Proceedings of Machine Learning Research, pages 4945–4988. PMLR, 2022.
- Fabio Martinelli. Lectures on glauber dynamics for discrete spin models. Lectures on probability theory and statistics (Saint-Flour, 1997), 1717:93–191, 1999.
- Spin glass theory and beyond. World Scientific, 1987.
- Gibbs rapidly samples colorings of g (n, d/n). Probability theory and related fields, 148(1-2):37–69, 2010.
- Dmitry Panchenko. The parisi ultrametricity conjecture. Annals of Mathematics, pages 383–393, 2013.
- Bounds for diluted mean-fields spin glass models. Probability Theory and Related Fields, 130(3):319–336, 2004. doi:10.1007/s00440-004-0342-2.
- Giorgio Parisi. Infinite number of order parameters for spin-glasses. Physical Review Letters, 43(23):1754, 1979.
- Solvable model of a spin-glass. Physical review letters, 35(26):1792, 1975.
- The computational hardness of counting in two-spin models on d-regular graphs. In 53rd Annual IEEE Symposium on Foundations of Computer Science, FOCS 2012, pages 361–369. IEEE Computer Society, 2012. URL: https://doi.org/10.1109/FOCS.2012.56.
- Spin glasses and complexity, volume 4. Princeton University Press, 2013.
- Michel Talagrand. The Parisi formula. Ann. Math. (2), 163(1):221–263, 2006. doi:10.4007/annals.2006.163.221.