Expanderizing Higher Order Random Walks (2405.08927v3)
Abstract: We study a variant of the down-up and up-down walks over an $n$-partite simplicial complex, which we call expanderized higher order random walks -- where the sequence of updated coordinates correspond to the sequence of vertices visited by a random walk over an auxiliary expander graph $H$. When $H$ is the clique, this random walk reduces to the usual down-up walk and when $H$ is the directed cycle, this random walk reduces to the well-known systematic scan Glauber dynamics. We show that whenever the usual higher order random walks satisfy a log-Sobolev inequality or a Poincar\'e inequality, the expanderized walks satisfy the same inequalities with a loss of quality related to the two-sided expansion of the auxillary graph $H$. Our construction can be thought as a higher order random walk generalization of the derandomized squaring algorithm of Rozenman and Vadhan. We show that when initiated with an expander graph our expanderized random walks have mixing time $O(n \log n)$ for sampling a uniformly random list colorings of a graph $G$ of maximum degree $\Delta = O(1)$ where each vertex has at least $(11/6 - \epsilon) \Delta$ and at most $O(\Delta)$ colors and $O\left( \frac{n \log n}{(1 - | J|)2}\right)$ for sampling the Ising model with a PSD interaction matrix $J \in R{n \times n}$ satisfying $| J | \le 1$ and the external field $h \in Rn$-- here the $O(\bullet)$ notation hides a constant that depends linearly on the largest entry of $h$. As expander graphs can be very sparse, this decreases the amount of randomness required to simulate the down-up walks by a logarithmic factor. We also prove some simple results which enable us to argue about log-Sobolev constants of higher order random walks and provide a simple and self-contained analysis of local-to-global $\Phi$-entropy contraction in simplicial complexes -- giving simpler proofs for many pre-existing results.
- Fractionally log-concave and sector-stable polynomials: counting planar matchings and more. In Proceedings of the 53rd Annual ACM SIGACT Symposium on Theory of Computing, pages 433–446, 2021.
- Reversible Markov chains and random walks on graphs, 1995.
- Entropic independence ii: optimal sampling and concentration via restricted modified log-sobolev inequalities. arXiv preprint arXiv:2111.03247, 2021.
- Entropic independence: optimal mixing of down-up random walks. In Proceedings of the 54th Annual ACM SIGACT Symposium on Theory of Computing, pages 1418–1430, 2022.
- Universality of spectral independence with applications to fast mixing in spin glasses. CoRR, abs/2307.10466, 2023.
- Improved analysis of higher order random walks and applications. In STOC, pages 1198–1211, 2020.
- Spectral independence in high-dimensional expanders and applications to the hardcore model. CoRR, abs/2001.00303, 2020.
- Noga Alon. Explicit expanders of every degree and size. Combinatorica, 41(4):447–463, 2021.
- Log-concave polynomials iv: approximate exchange, tight mixing times, and near-optimal sampling of forests. In Proceedings of the 53rd Annual ACM SIGACT Symposium on Theory of Computing, pages 408–420, 2021.
- Sequential sweeps and high dimensional expansion. CoRR, abs/2312.02089, 2023.
- On mixing of markov chains: Coupling, spectral independence, and entropy factorization. In Proceedings of the 2022 Annual ACM-SIAM Symposium on Discrete Algorithms (SODA), pages 3670–3692. SIAM, 2022.
- Entropy decay in the swendsen–wang dynamics on zd. In Proceedings of the 53rd Annual ACM SIGACT Symposium on Theory of Computing, pages 1551–1564, 2021.
- Path coupling: A technique for proving rapid mixing in Markov chains. In FOCS, pages 223–231, 1997.
- Rajendra Bhatia. Matrix Analysis, volume 169. Springer Science & Business Media, 2013.
- High dimensional expanders: Eigenstripping, pseudorandomness, and unique games. In Proceedings of the 2022 Annual ACM-SIAM Symposium on Discrete Algorithms (SODA), pages 1069–1128. SIAM, 2022.
- Hypercontractivity on high dimensional expanders. In Proceedings of the 54th Annual ACM SIGACT Symposium on Theory of Computing, pages 185–194, 2022.
- Concentration Inequalities - A Nonasymptotic Theory of Independence. Oxford University Press, 2013.
- Improved bounds for randomly sampling colorings via linear programming. In SODA, pages 2216–2234, 2019.
- Localization schemes: A framework for proving mixing bounds for markov chains. In 2022 IEEE 63rd Annual Symposium on Foundations of Computer Science (FOCS), pages 110–122. IEEE, 2022.
- Rapid mixing for colorings via spectral independence. CoRR, abs/2007.08058, 2020.
- Djalil Chafaï. Entropies, convexity, and functional inequalities, on ϕitalic-ϕ\phiitalic_ϕ-entropies and ϕitalic-ϕ\phiitalic_ϕ-sobolev inequalities. Journal of Mathematics of Kyoto University, 44(2):325–363, 2004.
- Yuansi Chen. An almost constant lower bound of the isoperimetric coefficient in the kls conjecture. Geometric and Functional Analysis, 31:34–61, 2021.
- Rapid mixing of Glauber dynamics up to uniqueness via contraction. arXiv preprint arXiv:2004.09083, 2020.
- Optimal mixing of glauber dynamics: Entropy factorization via high-dimensional expansion. In Proceedings of the 53rd Annual ACM SIGACT Symposium on Theory of Computing, pages 1537–1550, 2021.
- Agreement testing theorems on layered set systems. 2019.
- Boolean function analysis on high-dimensional expanders. In APPROX/RANDOM, pages 38:1–38:20, 2018.
- Systematic scan for sampling colorings. The Annals of Applied Probability, 16(1):185–230, 2006.
- Dobrushin conditions and systematic scan. Combinatorics, Probability and Computing, 17(6):761–779, 2008.
- High dimensional expanders imply agreement expanders. In FOCS, pages 974–985, 2017.
- Roland L Dobrushin. Prescribing a system of random variables by conditional distributions. Theory of Probability & Its Applications, 15(3):458–486, 1970.
- Analysis of systematic scan metropolis algorithms using iwahori-hecke algebra techniques. Michigan Mathematical Journal, 48(1):157–190, 2000.
- Logarithmic Sobolev inequalities for finite Markov chains. The Annals of Applied Probability, 6(3):695–750, 1996.
- A spectral condition for spectral gap: fast mixing in high-temperature ising models. Probability theory and related fields, 182(3):1035–1051, 2022.
- Ronen Eldan. Thin shell implies spectral gap up to polylog via a stochastic localization scheme. Geometric and Functional Analysis, 23(2):532–569, 2013.
- Ronen Eldan. Taming correlations through entropy-efficient measure decompositions with applications to mean-field approximation. Probability Theory and Related Fields, 176(3):737–755, 2020.
- Log concavity and concentration of lipschitz functions on the boolean hypercube. Journal of functional analysis, 282(8):109392, 2022.
- Towards derandomising markov chain monte carlo. In 64th IEEE Annual Symposium on Foundations of Computer Science, FOCS 2023, Santa Cruz, CA, USA, November 6-9, 2023, pages 1963–1990. IEEE, 2023.
- Rapid mixing from spectral independence beyond the boolean domain. arXiv preprint arXiv:2007.08091, 2020.
- Howard Garland. p-adic curvature and the cohomology of discrete subgroups of p-adic groups. Annals of Mathematics, pages 375–423, 1973.
- Hypercontractivity on high dimensional expanders. In Proceedings of the 54th Annual ACM SIGACT Symposium on Theory of Computing, pages 176–184, 2022.
- Local-to-global contraction in simplicial complexes, 2021.
- Thomas P Hayes. A simple condition implying rapid mixing of single-site dynamics on spin systems. In 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS’06), pages 39–46. IEEE, 2006.
- Matrix Analysis. Cambridge university press, 2012.
- Expander graphs and their applications. Bulletin of the American Mathematical Society, 43(4):439–561, 2006.
- Mark Jerrum. A very simple algorithm for estimating the number of k-colorings of a low-degree graph. Random Struct. Algorithms, 7(2):157–166, 1995.
- High dimensional expansion using zig-zag product. arXiv preprint arXiv:2001.08829, 2020.
- Bo’az Klartag. Eldan’s stochastic localization and tubular neighborhoods of complex-analytic sets. The Journal of Geometric Analysis, 28:2008–2027, 2018.
- High dimensional random walks and colorful expansion. In ITCS, pages 4:1–4:27, 2017.
- B Klartag and V Milman. The slicing problem by bourgain. In Analysis at Large: Dedicated to the Life and Work of Jean Bourgain, pages 203–231. Springer, 2022.
- High order random walks: Beyond spectral gap. In APPROX/RANDOM, pages 47:1–47:17, 2018.
- Holden Lee. Parallelising glauber dynamics. arXiv preprint arXiv:2307.07131, 2023.
- Kuikui Liu. From coupling to spectral independence and blackbox comparison with the down-up walk. arXiv preprint arXiv:2103.11609, 2021.
- Explicit expanders and the ramanujan conjectures. In STOC, pages 240–246, 1986.
- G. A. Margulis. Explicit group-theoretic constructions of combinatorial schemes and their applications in the construction of expanders and concentrators. Problemy Peredachi Informatsii, 24(1):51–60, 1988.
- Laurent Miclo. Remarques sur l’hypercontractivité et l’évolution de l’entropie pour des chaînes de Markov finies. Springer, 1997.
- Derandomization beyond connectivity: Undirected laplacian systems in nearly logarithmic space. In 2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS), pages 801–812. IEEE, 2017.
- Deterministic approximation of random walks in small space. Theory of Computing, 17(1), 2021.
- Mathematical aspects of mixing times in Markov chains. Foundations and Trends in Theoretical Computer Science, 1(3), 2005.
- Izhar Oppenheim. Local spectral expansion approach to high dimensional expanders part ii: Mixing and geometrical overlapping, 2018.
- Maxim Raginsky. Strong data processing inequalities and ϕitalic-ϕ\phiitalic_ϕ-sobolev inequalities for discrete channels. IEEE Transactions on Information Theory, 62(6):3355–3389, 2016.
- Omer Reingold. Undirected connectivity in log-space. Journal of the ACM (JACM), 55(4):1–24, 2008.
- Surprising convergence properties of some simple gibbs samplers under various scans. International Journal of Statistics and Probability, 5(1):51–60, 2015.
- Derandomized squaring of graphs. In International Workshop on Approximation Algorithms for Combinatorial Optimization, pages 436–447. Springer, 2005.
- Entropy waves, the zig-zag graph product, and new constant-degree expanders and extractors. In FOCS, pages 3–13, 2000.
- Laurent Saloff-Coste. Lectures on finite Markov chains. In Lectures on probability theory and statistics, pages 301–413. Springer, 1997.
- Lecture notes on spectral independence and bases of a matroid: Local-to-global and trickle-down from a markov chain perspective, 2023.
- Eric Vigoda. Improved bounds for sampling colorings. Journal of Mathematical Physics, 41(3):1555–1569, 2000.
- Markov chains and mixing times. American Mathematical Soc., Providence, 2009.