Papers
Topics
Authors
Recent
Assistant
AI Research Assistant
Well-researched responses based on relevant abstracts and paper content.
Custom Instructions Pro
Preferences or requirements that you'd like Emergent Mind to consider when generating responses.
Gemini 2.5 Flash
Gemini 2.5 Flash 145 tok/s
Gemini 2.5 Pro 53 tok/s Pro
GPT-5 Medium 28 tok/s Pro
GPT-5 High 30 tok/s Pro
GPT-4o 127 tok/s Pro
Kimi K2 200 tok/s Pro
GPT OSS 120B 433 tok/s Pro
Claude Sonnet 4.5 32 tok/s Pro
2000 character limit reached

Quenches in the Sherrington-Kirkpatrick model (2405.04267v2)

Published 7 May 2024 in cond-mat.dis-nn

Abstract: The Sherrington-Kirkpatrick (SK) model is a prototype of a complex non-convex energy landscape. Dynamical processes evolving on such landscapes and locally aiming to reach minima are generally poorly understood. Here, we study quenches, i.e. dynamics that locally aim to decrease energy. We analyse the energy at convergence for two distinct algorithmic classes, single-spin flip and synchronous dynamics, focusing on greedy and reluctant strategies. We provide precise numerical analysis of the finite size effects and conclude that, perhaps counter-intuitively, the reluctant algorithm is compatible with converging to the ground state energy density, while the greedy strategy is not. Inspired by the single-spin reluctant and greedy algorithms, we investigate two synchronous time algorithms, the sync-greedy and sync-reluctant algorithms. These synchronous processes can be analysed using dynamical mean field theory (DMFT), and a new backtracking version of DMFT. Notably, this is the first time the backtracking DMFT is applied to study dynamical convergence properties in fully connected disordered models. The analysis suggests that the sync-greedy algorithm can also achieve energies compatible with the ground state, and that it undergoes a dynamical phase transition.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (37)
  1. Backtracking dynamical cavity method. Physical Review X, 13(3):031021, 2023.
  2. Dynamical phase transitions in graph cellular automata. Phys. Rev. E, 109:044312, Apr 2024.
  3. Giorgio Parisi. Infinite number of order parameters for spin-glasses. Physical Review Letters, 43(23):1754, 1979.
  4. Spin Glass Theory and Beyond. WORLD SCIENTIFIC, 1986.
  5. Parallel dynamics of disordered ising spin systems on finitely connected random graphs. Journal of Physics A: Mathematical and General, 37(24):6201, 2004.
  6. I. Neri and D. Bollé. The cavity approach to parallel dynamics of Ising spins on a graph. Journal of Statistical Mechanics: Theory and Experiment, 2009(08):P08009, 2009.
  7. Parallel dynamics of disordered Ising spin systems on finitely connected directed random graphs with arbitrary degree distributions. Journal of Physics A: Mathematical and Theoretical, 42(41):415001, 2009.
  8. Dynamical mean-field theory of strongly correlated fermion systems and the limit of infinite dimensions. Reviews of Modern Physics, 68(1):13, 1996.
  9. H. Eissfeller and M. Opper. Mean-field monte carlo approach to the sherrington-kirkpatrick model with asymmetric couplings. Phys. Rev. E, 50:709–720, Aug 1994.
  10. On the number of limit cycles in asymmetric neural networks. Journal of Statistical Mechanics: Theory and Experiment, 2019(5):053402, 2019.
  11. John J Hopfield. Neural networks and physical systems with emergent collective computational abilities. Proceedings of the national academy of sciences, 79(8):2554–2558, 1982.
  12. Unlearnable games and ”satisficing” decisions: A simple model for a complex world, 2024.
  13. Manoranjan P. Singh. Synchronous dynamics of a hopfield model with random asymmetric interactions, 2003.
  14. R D Henkel and M Opper. Parallel dynamics of the neural network with the pseudoinverse coupling matrix. Journal of Physics A: Mathematical and General, 24(9):2201, may 1991.
  15. W Krauth and M Mezard. Learning algorithms with optimal stability in neural networks. Journal of Physics A: Mathematical and General, 20(11):L745, aug 1987.
  16. Satisfiability transition in asymmetric neural networks. Journal of Physics A: Mathematical and Theoretical, 55(30):305001, jul 2022.
  17. Giorgio Parisi. On the statistical properties of the larg time zero temperature dynamics of the sk model. Fractals, 11(supp01):161–171, 2003.
  18. Energy-decreasing dynamics in mean-field spin models. Journal of Physics A: Mathematical and General, 36(10):2413, feb 2003.
  19. Interpolating greedy and reluctant algorithms. Optimization Methods and Software, 20(4-5):509–514, 2005.
  20. Finding minima in complex landscapes: annealed, greedy and reluctant algorithms. Mathematical Models and Methods in Applied Sciences, 15(09):1349–1369, 2005.
  21. Andrea Montanari. Optimization of the sherrington–kirkpatrick hamiltonian. SIAM Journal on Computing, 0(0):FOCS19–1–FOCS19–38, 0.
  22. Algorithmic thresholds in mean field spin glasses, 2020.
  23. H. Horner. Time dependent local field distribution and metastable states in the sk-spin-glass. The European Physical Journal B, 60(4):413–422, Dec 2007.
  24. Nature’s way of optimizing. Artificial Intelligence, 119(1):275–286, 2000.
  25. Optimization with extremal dynamics. Phys. Rev. Lett., 86:5211–5214, Jun 2001.
  26. Energy exponents and corrections to scaling in ising spin glasses. Physical Review B, 68(22):224404, 2003.
  27. Sergey Pankov. Low-temperature solution of the sherrington-kirkpatrick model. Phys. Rev. Lett., 96:197204, May 2006.
  28. Out of equilibrium dynamics in spin-glasses and other glassy systems. Spin glasses and random fields, 12:161, 1998.
  29. Outer-totalistic cellular automata on graphs. Physics Letters A, 373(5):546–549, January 2009.
  30. (dis)assortative partitions on random regular graphs. Journal of Physics A: Mathematical and Theoretical, 55(39):395004, sep 2022.
  31. On perfectly friendly bisections of random graphs, 2023.
  32. Metastable states, internal field distributions and magnetic excitations in spin glasses. Journal of Physics C: Solid State Physics, 14(19):2629, jul 1981.
  33. Maximally-stable local optima in random graphs and spin glasses: Phase transitions and universality, 2023.
  34. Relaxation, closing probabilities and transition from oscillatory to chaotic attractors in asymmetric neural networks. Journal of Physics A: Mathematical and General, 31(20):4583, may 1998.
  35. Decreasing energy functions as a tool for studying threshold networks. Discrete Applied Mathematics, 12(3):261–277, 1985.
  36. On the energy minima of the sherrington-kirkpatrick model. Journal of Physics A: Mathematical and General, 33(21):3851, jun 2000.
  37. Alan Genz. Numerical computation of multivariate normal probabilities. Journal of Computational and Graphical Statistics, 1(2):141–149, 1992.
Citations (4)

Summary

We haven't generated a summary for this paper yet.

Dice Question Streamline Icon: https://streamlinehq.com

Open Problems

We're still in the process of identifying open problems mentioned in this paper. Please check back in a few minutes.

Lightbulb Streamline Icon: https://streamlinehq.com

Continue Learning

We haven't generated follow-up questions for this paper yet.

List To Do Tasks Checklist Streamline Icon: https://streamlinehq.com

Collections

Sign up for free to add this paper to one or more collections.

X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets

This paper has been mentioned in 3 tweets and received 54 likes.

Upgrade to Pro to view all of the tweets about this paper: