Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
125 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Expanderizing Higher Order Random Walks (2405.08927v3)

Published 14 May 2024 in cs.DS

Abstract: We study a variant of the down-up and up-down walks over an $n$-partite simplicial complex, which we call expanderized higher order random walks -- where the sequence of updated coordinates correspond to the sequence of vertices visited by a random walk over an auxiliary expander graph $H$. When $H$ is the clique, this random walk reduces to the usual down-up walk and when $H$ is the directed cycle, this random walk reduces to the well-known systematic scan Glauber dynamics. We show that whenever the usual higher order random walks satisfy a log-Sobolev inequality or a Poincar\'e inequality, the expanderized walks satisfy the same inequalities with a loss of quality related to the two-sided expansion of the auxillary graph $H$. Our construction can be thought as a higher order random walk generalization of the derandomized squaring algorithm of Rozenman and Vadhan. We show that when initiated with an expander graph our expanderized random walks have mixing time $O(n \log n)$ for sampling a uniformly random list colorings of a graph $G$ of maximum degree $\Delta = O(1)$ where each vertex has at least $(11/6 - \epsilon) \Delta$ and at most $O(\Delta)$ colors and $O\left( \frac{n \log n}{(1 - | J|)2}\right)$ for sampling the Ising model with a PSD interaction matrix $J \in R{n \times n}$ satisfying $| J | \le 1$ and the external field $h \in Rn$-- here the $O(\bullet)$ notation hides a constant that depends linearly on the largest entry of $h$. As expander graphs can be very sparse, this decreases the amount of randomness required to simulate the down-up walks by a logarithmic factor. We also prove some simple results which enable us to argue about log-Sobolev constants of higher order random walks and provide a simple and self-contained analysis of local-to-global $\Phi$-entropy contraction in simplicial complexes -- giving simpler proofs for many pre-existing results.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (68)
  1. Fractionally log-concave and sector-stable polynomials: counting planar matchings and more. In Proceedings of the 53rd Annual ACM SIGACT Symposium on Theory of Computing, pages 433–446, 2021.
  2. Reversible Markov chains and random walks on graphs, 1995.
  3. Entropic independence ii: optimal sampling and concentration via restricted modified log-sobolev inequalities. arXiv preprint arXiv:2111.03247, 2021.
  4. Entropic independence: optimal mixing of down-up random walks. In Proceedings of the 54th Annual ACM SIGACT Symposium on Theory of Computing, pages 1418–1430, 2022.
  5. Universality of spectral independence with applications to fast mixing in spin glasses. CoRR, abs/2307.10466, 2023.
  6. Improved analysis of higher order random walks and applications. In STOC, pages 1198–1211, 2020.
  7. Spectral independence in high-dimensional expanders and applications to the hardcore model. CoRR, abs/2001.00303, 2020.
  8. Noga Alon. Explicit expanders of every degree and size. Combinatorica, 41(4):447–463, 2021.
  9. Log-concave polynomials iv: approximate exchange, tight mixing times, and near-optimal sampling of forests. In Proceedings of the 53rd Annual ACM SIGACT Symposium on Theory of Computing, pages 408–420, 2021.
  10. Sequential sweeps and high dimensional expansion. CoRR, abs/2312.02089, 2023.
  11. On mixing of markov chains: Coupling, spectral independence, and entropy factorization. In Proceedings of the 2022 Annual ACM-SIAM Symposium on Discrete Algorithms (SODA), pages 3670–3692. SIAM, 2022.
  12. Entropy decay in the swendsen–wang dynamics on zd. In Proceedings of the 53rd Annual ACM SIGACT Symposium on Theory of Computing, pages 1551–1564, 2021.
  13. Path coupling: A technique for proving rapid mixing in Markov chains. In FOCS, pages 223–231, 1997.
  14. Rajendra Bhatia. Matrix Analysis, volume 169. Springer Science & Business Media, 2013.
  15. High dimensional expanders: Eigenstripping, pseudorandomness, and unique games. In Proceedings of the 2022 Annual ACM-SIAM Symposium on Discrete Algorithms (SODA), pages 1069–1128. SIAM, 2022.
  16. Hypercontractivity on high dimensional expanders. In Proceedings of the 54th Annual ACM SIGACT Symposium on Theory of Computing, pages 185–194, 2022.
  17. Concentration Inequalities - A Nonasymptotic Theory of Independence. Oxford University Press, 2013.
  18. Improved bounds for randomly sampling colorings via linear programming. In SODA, pages 2216–2234, 2019.
  19. Localization schemes: A framework for proving mixing bounds for markov chains. In 2022 IEEE 63rd Annual Symposium on Foundations of Computer Science (FOCS), pages 110–122. IEEE, 2022.
  20. Rapid mixing for colorings via spectral independence. CoRR, abs/2007.08058, 2020.
  21. Djalil Chafaï. Entropies, convexity, and functional inequalities, on ϕitalic-ϕ\phiitalic_ϕ-entropies and ϕitalic-ϕ\phiitalic_ϕ-sobolev inequalities. Journal of Mathematics of Kyoto University, 44(2):325–363, 2004.
  22. Yuansi Chen. An almost constant lower bound of the isoperimetric coefficient in the kls conjecture. Geometric and Functional Analysis, 31:34–61, 2021.
  23. Rapid mixing of Glauber dynamics up to uniqueness via contraction. arXiv preprint arXiv:2004.09083, 2020.
  24. Optimal mixing of glauber dynamics: Entropy factorization via high-dimensional expansion. In Proceedings of the 53rd Annual ACM SIGACT Symposium on Theory of Computing, pages 1537–1550, 2021.
  25. Agreement testing theorems on layered set systems. 2019.
  26. Boolean function analysis on high-dimensional expanders. In APPROX/RANDOM, pages 38:1–38:20, 2018.
  27. Systematic scan for sampling colorings. The Annals of Applied Probability, 16(1):185–230, 2006.
  28. Dobrushin conditions and systematic scan. Combinatorics, Probability and Computing, 17(6):761–779, 2008.
  29. High dimensional expanders imply agreement expanders. In FOCS, pages 974–985, 2017.
  30. Roland L Dobrushin. Prescribing a system of random variables by conditional distributions. Theory of Probability & Its Applications, 15(3):458–486, 1970.
  31. Analysis of systematic scan metropolis algorithms using iwahori-hecke algebra techniques. Michigan Mathematical Journal, 48(1):157–190, 2000.
  32. Logarithmic Sobolev inequalities for finite Markov chains. The Annals of Applied Probability, 6(3):695–750, 1996.
  33. A spectral condition for spectral gap: fast mixing in high-temperature ising models. Probability theory and related fields, 182(3):1035–1051, 2022.
  34. Ronen Eldan. Thin shell implies spectral gap up to polylog via a stochastic localization scheme. Geometric and Functional Analysis, 23(2):532–569, 2013.
  35. Ronen Eldan. Taming correlations through entropy-efficient measure decompositions with applications to mean-field approximation. Probability Theory and Related Fields, 176(3):737–755, 2020.
  36. Log concavity and concentration of lipschitz functions on the boolean hypercube. Journal of functional analysis, 282(8):109392, 2022.
  37. Towards derandomising markov chain monte carlo. In 64th IEEE Annual Symposium on Foundations of Computer Science, FOCS 2023, Santa Cruz, CA, USA, November 6-9, 2023, pages 1963–1990. IEEE, 2023.
  38. Rapid mixing from spectral independence beyond the boolean domain. arXiv preprint arXiv:2007.08091, 2020.
  39. Howard Garland. p-adic curvature and the cohomology of discrete subgroups of p-adic groups. Annals of Mathematics, pages 375–423, 1973.
  40. Hypercontractivity on high dimensional expanders. In Proceedings of the 54th Annual ACM SIGACT Symposium on Theory of Computing, pages 176–184, 2022.
  41. Local-to-global contraction in simplicial complexes, 2021.
  42. Thomas P Hayes. A simple condition implying rapid mixing of single-site dynamics on spin systems. In 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS’06), pages 39–46. IEEE, 2006.
  43. Matrix Analysis. Cambridge university press, 2012.
  44. Expander graphs and their applications. Bulletin of the American Mathematical Society, 43(4):439–561, 2006.
  45. Mark Jerrum. A very simple algorithm for estimating the number of k-colorings of a low-degree graph. Random Struct. Algorithms, 7(2):157–166, 1995.
  46. High dimensional expansion using zig-zag product. arXiv preprint arXiv:2001.08829, 2020.
  47. Bo’az Klartag. Eldan’s stochastic localization and tubular neighborhoods of complex-analytic sets. The Journal of Geometric Analysis, 28:2008–2027, 2018.
  48. High dimensional random walks and colorful expansion. In ITCS, pages 4:1–4:27, 2017.
  49. B Klartag and V Milman. The slicing problem by bourgain. In Analysis at Large: Dedicated to the Life and Work of Jean Bourgain, pages 203–231. Springer, 2022.
  50. High order random walks: Beyond spectral gap. In APPROX/RANDOM, pages 47:1–47:17, 2018.
  51. Holden Lee. Parallelising glauber dynamics. arXiv preprint arXiv:2307.07131, 2023.
  52. Kuikui Liu. From coupling to spectral independence and blackbox comparison with the down-up walk. arXiv preprint arXiv:2103.11609, 2021.
  53. Explicit expanders and the ramanujan conjectures. In STOC, pages 240–246, 1986.
  54. G. A. Margulis. Explicit group-theoretic constructions of combinatorial schemes and their applications in the construction of expanders and concentrators. Problemy Peredachi Informatsii, 24(1):51–60, 1988.
  55. Laurent Miclo. Remarques sur l’hypercontractivité et l’évolution de l’entropie pour des chaînes de Markov finies. Springer, 1997.
  56. Derandomization beyond connectivity: Undirected laplacian systems in nearly logarithmic space. In 2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS), pages 801–812. IEEE, 2017.
  57. Deterministic approximation of random walks in small space. Theory of Computing, 17(1), 2021.
  58. Mathematical aspects of mixing times in Markov chains. Foundations and Trends in Theoretical Computer Science, 1(3), 2005.
  59. Izhar Oppenheim. Local spectral expansion approach to high dimensional expanders part ii: Mixing and geometrical overlapping, 2018.
  60. Maxim Raginsky. Strong data processing inequalities and ϕitalic-ϕ\phiitalic_ϕ-sobolev inequalities for discrete channels. IEEE Transactions on Information Theory, 62(6):3355–3389, 2016.
  61. Omer Reingold. Undirected connectivity in log-space. Journal of the ACM (JACM), 55(4):1–24, 2008.
  62. Surprising convergence properties of some simple gibbs samplers under various scans. International Journal of Statistics and Probability, 5(1):51–60, 2015.
  63. Derandomized squaring of graphs. In International Workshop on Approximation Algorithms for Combinatorial Optimization, pages 436–447. Springer, 2005.
  64. Entropy waves, the zig-zag graph product, and new constant-degree expanders and extractors. In FOCS, pages 3–13, 2000.
  65. Laurent Saloff-Coste. Lectures on finite Markov chains. In Lectures on probability theory and statistics, pages 301–413. Springer, 1997.
  66. Lecture notes on spectral independence and bases of a matroid: Local-to-global and trickle-down from a markov chain perspective, 2023.
  67. Eric Vigoda. Improved bounds for sampling colorings. Journal of Mathematical Physics, 41(3):1555–1569, 2000.
  68. Markov chains and mixing times. American Mathematical Soc., Providence, 2009.
Citations (1)

Summary

We haven't generated a summary for this paper yet.