Matrix Diagonalization as a Board Game: Teaching an Eigensolver the Fastest Path to Solution (2306.10075v2)
Abstract: Matrix diagonalization is at the cornerstone of numerous fields of scientific computing. Diagonalizing a matrix to solve an eigenvalue problem requires a sequential path of iterations that eventually reaches a sufficiently converged and accurate solution for all the eigenvalues and eigenvectors. This typically translates into a high computational cost. Here we demonstrate how reinforcement learning, using the AlphaZero framework, can accelerate Jacobi matrix diagonalizations by viewing the selection of the fastest path to solution as a board game. To demonstrate the viability of our approach we apply the Jacobi diagonalization algorithm to symmetric Hamiltonian matrices that appear in quantum chemistry calculations. We find that a significant acceleration can often be achieved. Our findings highlight the opportunity to use machine learning as a promising tool to improve the performance of numerical linear algebra.
- David S Watkins. Fundamentals of Matrix Computations. John Wiley & Sons, August 2004.
- Modern Quantum Chemistry: Introduction to Advanced Electronic Structure Theory. Courier Corporation, June 2012.
- H Rutishauser. The jacobi method for real symmetric matrices. Numer. Math., 9(1):1–10, November 1966.
- Acceleration of symmetric sparse Matrix-Vector product using improved hierarchical diagonal blocking format. In Proceedings of the International Conference on High Performance Computing in Asia-Pacific Region, HPC Asia 2019, pages 63–70, New York, NY, USA, January 2019. Association for Computing Machinery.
- A projected preconditioned conjugate gradient algorithm for computing many extreme eigenpairs of a hermitian matrix. J. Comput. Phys., 290:73–89, June 2015.
- Discovering faster matrix multiplication algorithms with reinforcement learning. Nature, 610(7930):47–53, October 2022.
- Principal component analysis. Wiley interdisciplinary reviews: computational statistics, 2(4):433–459, 2010.
- Solving high-dimensional eigenvalue problems using deep neural networks: A diffusion monte carlo like approach. arXiv preprint arXiv:2002.02600, February 2020.
- Mixed precision Fermi-Operator expansion on tensor cores from a machine learning perspective. J. Chem. Theory Comput., April 2021.
- Quantum-Based molecular dynamics simulations using tensor cores. J. Chem. Theory Comput., 17(10):6180–6192, October 2021.
- Quantum perturbation theory using tensor cores and a deep neural network. J. Chem. Theory Comput., 18(7):4255–4268, July 2022.
- Where does alphago go: From church-turing thesis to alphago thesis and beyond. IEEE/CAA Journal of Automatica Sinica, 3(2):113–120, 2016.
- Mastering the game of go without human knowledge. nature, 550(7676):354–359, 2017.
- Alphafold: a solution to a 50-year-old grand challenge in biology. https://www.deepmind.com/blog/alphafold-a-solution-to-a-50-year-old-grand-challenge-in-biology.
- Mastering atari, go, chess and shogi by planning with a learned model. Nature, 588(7839):604–609, 2020.
- Numerical recipes in c. 2. Cambrige University, 1992.
- Ab Initio Molecular Dynamics: Basic Theory and Advanced Methods. Cambridge University Press, April 2009.
- LATTE, 2008.
- Self-consistent-charge density-functional tight-binding method for simulations of complex materials properties. Phys. Rev. B: Condens. Matter Mater. Phys., 58(11):7260–7268, 1998.
- fix latte command — LAMMPS documentation. https://guriang.unpad.ac.id/lammpsdoc/fix_latte.html. Accessed: 2022-5-3.
- https://www.deepmind.com/blog/alphazero-shedding-new-light-on-chess-shogi-and-go. Accessed: 2023-5-8.
- Playing atari with deep reinforcement learning. DeepMind Lab. arXiv, 1312, 2013.
- J C H Watkins Christopher and D Peter. Q-learning. Mach. Learn., 8:279–292, 1992.