On Representing Electronic Wave Functions with Sign Equivariant Neural Networks (2403.05249v1)
Abstract: Recent neural networks demonstrated impressively accurate approximations of electronic ground-state wave functions. Such neural networks typically consist of a permutation-equivariant neural network followed by a permutation-antisymmetric operation to enforce the electronic exchange symmetry. While accurate, such neural networks are computationally expensive. In this work, we explore the flipped approach, where we first compute antisymmetric quantities based on the electronic coordinates and then apply sign equivariant neural networks to preserve the antisymmetry. While this approach promises acceleration thanks to the lower-dimensional representation, we demonstrate that it reduces to a Jastrow factor, a commonly used permutation-invariant multiplicative factor in the wave function. Our empirical results support this further, finding little to no improvements over baselines. We conclude with neither theoretical nor empirical advantages of sign equivariant functions for representing electronic wave functions within the evaluation of this work.
- JAX: Composable transformations of Python+NumPy programs, 2018.
- Neural network variational Monte Carlo for positronic chemistry, October 2023.
- Monte Carlo simulation of a many-fermion study. Physical Review B, 16(7):3081–3099, October 1977. doi: 10.1103/PhysRevB.16.3081.
- Electronic excited states in deep variational Monte Carlo. arXiv:2203.09472 [physics, stat], March 2022.
- Distributed Implementation of Full Configuration Interaction for One Trillion Determinants. Journal of Chemical Theory and Computation, February 2024. ISSN 1549-9618. doi: 10.1021/acs.jctc.3c01190.
- Ab-Initio Potential Energy Surfaces by Pairing GNNs with Neural Wave Functions. In International Conference on Learning Representations, April 2022.
- Generalizing Neural Wave Functions. In International Conference on Machine Learning, February 2023a. doi: 10.48550/arXiv.2302.04168.
- Sampling-free Inference for Ab-Initio Potential Energy Surface Networks. In The Eleventh International Conference on Learning Representations, February 2023b.
- Folx - Forward Laplacian for JAX, 2023.
- Gold-standard solutions to the Schrödinger equation using deep learning: How much physics do we need? Advances in Neural Information Processing Systems, May 2022.
- Ab initio quantum chemistry with neural-network wavefunctions. Nature Reviews Chemistry, 7(10):692–709, October 2023. ISSN 2397-3358. doi: 10.1038/s41570-023-00516-8.
- Tosio Kato. On the eigenfunctions of many-particle systems in quantum mechanics. Communications on Pure and Applied Mathematics, 10(2):151–177, 1957. ISSN 1097-0312. doi: 10.1002/cpa.3160100201.
- Neural-network quantum states for ultra-cold Fermi gases, May 2023.
- Adam: A Method for Stochastic Optimization. In 3rd International Conference for Learning Representations, December 2014.
- Ewald-based Long-Range Message Passing for Molecular Graphs, June 2023.
- Forward Laplacian: A New Computational Framework for Neural Network-based Variational Monte Carlo, July 2023.
- Neural Wave Functions for Superfluids, July 2023.
- Optimizing neural networks with Kronecker-factored approximate curvature. In Proceedings of the 32nd International Conference on International Conference on Machine Learning-Volume 37, pp. 2408–2417, 2015.
- Prodigy: An Expeditiously Adaptive Parameter-Free Learner, October 2023.
- Message-Passing Neural Quantum States for the Homogeneous Electron Gas, May 2023.
- Ab initio solution of the many-electron Schrödinger equation with deep neural networks. Physical Review Research, 2(3):033429, September 2020. doi: 10.1103/PhysRevResearch.2.033429.
- Natural Quantum Monte Carlo Computation of Excited States, August 2023.
- Towards the ground state of molecules via diffusion Monte Carlo on neural networks. Nature Communications, 14(1):1860, April 2023. ISSN 2041-1723. doi: 10.1038/s41467-023-37609-3.
- Solving the electronic Schrödinger equation for multiple nuclear geometries with weight-sharing deep neural networks. Nature Computational Science, 2(5):331–341, May 2022. ISSN 2662-8457. doi: 10.1038/s43588-022-00228-x.
- Variational Monte Carlo on a Budget — Fine-tuning pre-trained Neural Wavefunctions. In Thirty-Seventh Conference on Neural Information Processing Systems, November 2023.
- Towards a transferable fermionic neural wavefunction for molecules. Nature Communications, 15(1):120, January 2024. ISSN 2041-1723. doi: 10.1038/s41467-023-44216-9.
- Erwin Schrödinger. Quantisierung als eigenwertproblem. Annalen der physik, 385(13):437–490, 1926.
- SchNet – A deep learning architecture for molecules and materials. The Journal of Chemical Physics, 148(24):241722, June 2018. ISSN 0021-9606, 1089-7690. doi: 10.1063/1.5019779.
- Modern Quantum Chemistry: Introduction to Advanced Electronic Structure Theory. Courier Corporation, 2012.
- A Self-Attention Ansatz for Ab-initio Quantum Chemistry. In The Eleventh International Conference on Learning Representations, February 2023.
- Simulations of state-of-the-art fermionic neural network wave functions with diffusion Monte Carlo, March 2021.
- Wave function Ansatz (but Periodic) Networks and the Homogeneous Electron Gas, February 2022.
- Uncertainty Estimation for Molecules: Desiderata and Methods. In International Conference on Machine Learning, 2023.
- Artificial Intelligence for Science in Quantum, Atomistic, and Continuum Systems, November 2023.