Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
129 tokens/sec
GPT-4o
28 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Fast Mixing in Sparse Random Ising Models (2405.06616v2)

Published 10 May 2024 in math.PR, cs.DS, and math.CO

Abstract: Motivated by the community detection problem in Bayesian inference, as well as the recent explosion of interest in spin glasses from statistical physics, we study the classical Glauber dynamics for sampling from Ising models with sparse random interactions. It is now well-known that when the interaction matrix has spectral diameter less than $1$, Glauber dynamics mixes in $O(n\log n)$ steps. Unfortunately, such criteria fail dramatically for interactions supported on arguably the most well-studied sparse random graph: the Erd\H{o}s--R\'{e}nyi random graph $G(n,d/n)$, due to the presence of almost linearly many outlier eigenvalues of unbounded magnitude. We prove that for the \emph{Viana--Bray spin glass}, where the interactions are supported on $G(n,d/n)$ and randomly assigned $\pm\beta$, Glauber dynamics mixes in $n{1+o(1)}$ time with high probability as long as $\beta \le O(1/\sqrt{d})$, independent of $n$. We further extend our results to random graphs drawn according to the $2$-community stochastic block model, as well as when the interactions are given by a "centered" version of the adjacency matrix. The latter setting is particularly relevant for the inference problem in community detection. Indeed, we use this to show that Glauber dynamics succeeds at recovering communities in the stochastic block model in a companion paper [LMR+24]. The primary technical ingredient in our proof is showing that with high probability, a sparse random graph can be decomposed into two parts -- a \emph{bulk} which behaves like a graph with bounded maximum degree and a well-behaved spectrum, and a \emph{near-forest} with favorable pseudorandom properties. We then use this decomposition to design a localization procedure that interpolates to simpler Ising models supported only on the near-forest, and then execute a pathwise analysis to establish a modified log-Sobolev inequality.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (59)
  1. Fractionally log-concave and sector-stable polynomials: counting planar matchings and more. In Proceedings of the 53rd Annual ACM SIGACT Symposium on Theory of Computing, pages 433–446, 2021.
  2. Emmanuel Abbe. Community detection and stochastic block models: Recent developments. Journal of Machine Learning Research, 18(177):1–86, 2018.
  3. Parallel discrete sampling via continuous walks. In Proceedings of the 55th Annual ACM Symposium on Theory of Computing, pages 103–116, 2023.
  4. Entropic independence I: Modified log-Sobolev inequalities for fractionally log-concave distributions and high-temperature ising models. arXiv preprint arXiv:2106.04105, 2021.
  5. Entropic independence II: optimal sampling and concentration via restricted modified log-Sobolev inequalities. arXiv preprint arXiv:2111.03247, 2021.
  6. Universality of Spectral Independence with Applications to Fast Mixing in Spin Glasses, pages 5029–5056. 2024.
  7. Community detection in general stochastic block models: Fundamental limits and efficient algorithms for recovery. In 2015 IEEE 56th Annual Symposium on Foundations of Computer Science, pages 670–688. IEEE, 2015.
  8. A very simple proof of the lsi for high temperature spin systems. Journal of Functional Analysis, 276(8):2582–2588, 2019.
  9. Kawasaki dynamics beyond the uniqueness threshold. arXiv preprint arXiv:2310.04609, 2023.
  10. On Mixing of Markov Chains: Coupling, Spectral Independence, and Entropy Factorization. In Proceedings of the 2022 Annual ACM-SIAM Symposium on Discrete Algorithms (SODA), pages 3670–3692. SIAM, 2022.
  11. Path coupling: A technique for proving rapid mixing in Markov chains. In Proceedings 38th Annual Symposium on Foundations of Computer Science, pages 223–231. IEEE, 1997.
  12. Fast Sampling via Spectral Independence Beyond Bounded-degree Graphs. ACM Trans. Algorithms, 20(1), jan 2024.
  13. Non-backtracking spectrum of random graphs: community detection and non-regular ramanujan graphs. In 2015 IEEE 56th Annual Symposium on Foundations of Computer Science, pages 1347–1357. IEEE, 2015.
  14. Modified logarithmic sobolev inequalities in discrete settings. Journal of Theoretical Probability, 19(2):289–336, Jun 2006.
  15. Y. Chen and R. Eldan. Localization Schemes: A Framework for Proving Mixing Bounds for Markov Chains (extended abstract). In 2022 IEEE 63rd Annual Symposium on Foundations of Computer Science (FOCS), pages 110–122, Los Alamitos, CA, USA, nov 2022. IEEE Computer Society.
  16. Optimal mixing of glauber dynamics: entropy factorization via high-dimensional expansion. In Proceedings of the 53rd Annual ACM SIGACT Symposium on Theory of Computing, STOC 2021, page 1537–1550. Association for Computing Machinery, 2021.
  17. Asymptotic analysis of the stochastic block model for modular networks and its algorithmic applications. Phys. Rev. E, 84:066106, Dec 2011.
  18. PL Dobruschin. The description of a random field by means of conditional probabilities and conditions of its regularity. Theory of Probability & Its Applications, 13(2):197–224, 1968.
  19. A new correlation inequality for Ising models with external fields. Probability Theory and Related Fields, 186(1):477–492, 2023.
  20. An information-theoretic view of stochastic localization. IEEE Transactions on Information Theory, 68(11):7423–7426, 2022.
  21. Sampling from the Sherrington-Kirkpatrick Gibbs measure via algorithmic stochastic localization. In 2022 IEEE 63rd Annual Symposium on Foundations of Computer Science (FOCS), pages 323–334. IEEE, 2022.
  22. Sampling from Mean-Field Gibbs Measures via Diffusion Processes. arXiv preprint arXiv:2310.08912, 2023.
  23. On the Mixing Time of Glauber Dynamics for the Hard-Core and Related Models on 𝖦⁢(n,d/n)𝖦𝑛𝑑𝑛\mathsf{G}(n,d/n)sansserif_G ( italic_n , italic_d / italic_n ). In Kousha Etessami, Uriel Feige, and Gabriele Puppis, editors, 50th International Colloquium on Automata, Languages, and Programming (ICALP 2023), volume 261 of Leibniz International Proceedings in Informatics (LIPIcs), pages 54:1–54:17, Dagstuhl, Germany, 2023. Schloss Dagstuhl – Leibniz-Zentrum für Informatik.
  24. Broadcasting on trees and the ising model. Ann. Appl. Probab., 10(2):410–433, 2000.
  25. A spectral condition for spectral gap: fast mixing in high-temperature ising models. Probability theory and related fields, 182(3):1035–1051, 2022.
  26. Ronen Eldan. Thin shell implies spectral gap up to polylog via a stochastic localization scheme. Geometric and Functional Analysis, 23(2):532–569, March 2013.
  27. On sampling diluted spin glasses using glauber dynamics. arXiv preprint arXiv:2403.08921, 2024.
  28. How well do local algorithms solve semidefinite programs? In Proceedings of the 49th Annual ACM SIGACT Symposium on Theory of Computing, pages 604–614, 2017.
  29. Statistical mechanics of lattice systems. a concrete mathematical introduction. 2017.
  30. Sharad Goel. Modified logarithmic sobolev inequalities for some models of random walk. Stochastic processes and their applications, 114(1):51–79, 2004.
  31. Geoffrey Grimmett. The random-cluster model, volume 333. Springer, 2006.
  32. The high temperature region of the viana–bray diluted spin glass model. Journal of statistical physics, 115:531–555, 2004.
  33. Thomas P Hayes. A simple condition implying rapid mixing of single-site dynamics on spin systems. In 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS’06), pages 39–46. IEEE, 2006.
  34. Sampling from spherical spin glasses in total variation via algorithmic stochastic localization. arXiv preprint arXiv:2404.15651, 2024.
  35. Logarithmic sobolev inequalities and stochastic ising models. 1986.
  36. Polynomial-time approximation algorithms for the ising model. SIAM Journal on computing, 22(5):1087–1116, 1993.
  37. Sampling approximately low-rank ising models: Mcmc meets variational methods. In Conference on Learning Theory, pages 4945–4988. PMLR, 2022.
  38. Dmitriy Kunisky. Optimality of glauber dynamics for general-purpose ising model sampling and free energy approximation. arXiv preprint arXiv:2307.12581, 2023.
  39. Michel Ledoux. Logarithmic sobolev inequalities for unbounded spin systems revisited. Séminaire de Probabilités XXXV, pages 167–194, 2001.
  40. Kuikui Liu. From coupling to spectral independence and blackbox comparison with the down-up walk. In Approximation, Randomization, and Combinatorial Optimization. Algorithms and Techniques (APPROX/RANDOM 2021). Schloss Dagstuhl-Leibniz-Zentrum für Informatik, 2021.
  41. On statistical inference when fixed points of belief propagation are unstable. In 2021 IEEE 62nd Annual Symposium on Foundations of Computer Science (FOCS), pages 395–405. IEEE, 2022.
  42. Laurent Massoulié. Community detection thresholds and the weak ramanujan property. In Proceedings of the forty-sixth annual ACM symposium on Theory of computing, pages 694–703, 2014.
  43. Information, Physics, and Computation. Oxford University Press, 01 2009.
  44. Belief propagation, robust reconstruction and optimal recovery of block models. In Conference on Learning Theory, pages 356–370. PMLR, 2014.
  45. Reconstruction and estimation in the planted partition model. Probability Theory and Related Fields, 162(3-4):431–461, 2015.
  46. A proof of the block model threshold conjecture. Combinatorica, 38(3):665–708, jun 2018.
  47. Rémi Monasson. Optimization problems and replica symmetry breaking in finite connectivity spin glasses. Journal of Physics A: Mathematical and General, 31(2):513, 1998.
  48. Andrea Montanari. Sampling, diffusions, and stochastic localization. arXiv preprint arXiv:2305.10690, 2023.
  49. The bethe lattice spin glass revisited. The European Physical Journal B, 20:217–233, 2001.
  50. The cavity method at zero temperature. Journal of Statistical Physics, 111:1–34, 2003.
  51. Exact thresholds for ising–gibbs samplers on general graphs. 2013.
  52. Posterior sampling from the spiked models via diffusion processes. arXiv preprint arXiv:2304.11449, 2023.
  53. Sebastien Roch. Modern Discrete Probability: An Essential Toolkit. Cambridge Series in Statistical and Probabilistic Mathematics. Cambridge University Press, 2024.
  54. Non-backtracking spectra of weighted inhomogeneous random graphs. Mathematical Statistics and Learning, 5(3):201–271, 2022.
  55. The computational hardness of counting in two-spin models on d-regular graphs. In 2012 IEEE 53rd Annual Symposium on Foundations of Computer Science, pages 361–369, 2012.
  56. Zeta functions of finite graphs and coverings. Advances in Mathematics, 121(1):124–165, 1996.
  57. Michel Talagrand. Mean Field Models for Spin Glasses: Volume I: Basic Examples, volume 54 of A Series of Modern Surveys in Mathematics. Springer-Verlag, 2011.
  58. Graphical Models, Exponential Families, and Variational Inference, volume 1 of Foundations and Trends in Machine Learning. Now Publishers Inc, 2008.
  59. Ising model on locally tree-like graphs: Uniqueness of solutions to cavity equations. IEEE Transactions on Information Theory, 2023.
Citations (4)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com