Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
144 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Matrix Diagonalization as a Board Game: Teaching an Eigensolver the Fastest Path to Solution (2306.10075v2)

Published 16 Jun 2023 in math.NA, cs.AI, cs.LG, cs.NA, and physics.comp-ph

Abstract: Matrix diagonalization is at the cornerstone of numerous fields of scientific computing. Diagonalizing a matrix to solve an eigenvalue problem requires a sequential path of iterations that eventually reaches a sufficiently converged and accurate solution for all the eigenvalues and eigenvectors. This typically translates into a high computational cost. Here we demonstrate how reinforcement learning, using the AlphaZero framework, can accelerate Jacobi matrix diagonalizations by viewing the selection of the fastest path to solution as a board game. To demonstrate the viability of our approach we apply the Jacobi diagonalization algorithm to symmetric Hamiltonian matrices that appear in quantum chemistry calculations. We find that a significant acceleration can often be achieved. Our findings highlight the opportunity to use machine learning as a promising tool to improve the performance of numerical linear algebra.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (23)
  1. David S Watkins. Fundamentals of Matrix Computations. John Wiley & Sons, August 2004.
  2. Modern Quantum Chemistry: Introduction to Advanced Electronic Structure Theory. Courier Corporation, June 2012.
  3. H Rutishauser. The jacobi method for real symmetric matrices. Numer. Math., 9(1):1–10, November 1966.
  4. Acceleration of symmetric sparse Matrix-Vector product using improved hierarchical diagonal blocking format. In Proceedings of the International Conference on High Performance Computing in Asia-Pacific Region, HPC Asia 2019, pages 63–70, New York, NY, USA, January 2019. Association for Computing Machinery.
  5. A projected preconditioned conjugate gradient algorithm for computing many extreme eigenpairs of a hermitian matrix. J. Comput. Phys., 290:73–89, June 2015.
  6. Discovering faster matrix multiplication algorithms with reinforcement learning. Nature, 610(7930):47–53, October 2022.
  7. Principal component analysis. Wiley interdisciplinary reviews: computational statistics, 2(4):433–459, 2010.
  8. Solving high-dimensional eigenvalue problems using deep neural networks: A diffusion monte carlo like approach. arXiv preprint arXiv:2002.02600, February 2020.
  9. Mixed precision Fermi-Operator expansion on tensor cores from a machine learning perspective. J. Chem. Theory Comput., April 2021.
  10. Quantum-Based molecular dynamics simulations using tensor cores. J. Chem. Theory Comput., 17(10):6180–6192, October 2021.
  11. Quantum perturbation theory using tensor cores and a deep neural network. J. Chem. Theory Comput., 18(7):4255–4268, July 2022.
  12. Where does alphago go: From church-turing thesis to alphago thesis and beyond. IEEE/CAA Journal of Automatica Sinica, 3(2):113–120, 2016.
  13. Mastering the game of go without human knowledge. nature, 550(7676):354–359, 2017.
  14. Alphafold: a solution to a 50-year-old grand challenge in biology. https://www.deepmind.com/blog/alphafold-a-solution-to-a-50-year-old-grand-challenge-in-biology.
  15. Mastering atari, go, chess and shogi by planning with a learned model. Nature, 588(7839):604–609, 2020.
  16. Numerical recipes in c. 2. Cambrige University, 1992.
  17. Ab Initio Molecular Dynamics: Basic Theory and Advanced Methods. Cambridge University Press, April 2009.
  18. LATTE, 2008.
  19. Self-consistent-charge density-functional tight-binding method for simulations of complex materials properties. Phys. Rev. B: Condens. Matter Mater. Phys., 58(11):7260–7268, 1998.
  20. fix latte command — LAMMPS documentation. https://guriang.unpad.ac.id/lammpsdoc/fix_latte.html. Accessed: 2022-5-3.
  21. https://www.deepmind.com/blog/alphazero-shedding-new-light-on-chess-shogi-and-go. Accessed: 2023-5-8.
  22. Playing atari with deep reinforcement learning. DeepMind Lab. arXiv, 1312, 2013.
  23. J C H Watkins Christopher and D Peter. Q-learning. Mach. Learn., 8:279–292, 1992.
Citations (2)

Summary

We haven't generated a summary for this paper yet.