Multi-Lattice Sampling of Quantum Field Theories via Neural Operator-based Flows (2401.00828v4)
Abstract: We consider the problem of sampling lattice field configurations on a lattice from the Boltzmann distribution corresponding to some action. Since such densities arise as approximationw of an underlying functional density, we frame the task as an instance of operator learning. We propose to approximate a time-dependent neural operator whose time integral provides a mapping between the functional distributions of the free and target theories. Once a particular lattice is chosen, the neural operator can be discretized to a finite-dimensional, time-dependent vector field which in turn induces a continuous normalizing flow between finite dimensional distributions over the chosen lattice. This flow can then be trained to be a diffeormorphism between the discretized free and target theories on the chosen lattice, and, by construction, can be evaluated on different discretizations of spacetime. We experimentally validate the proposal on the 2-dimensional $\phi4$-theory to explore to what extent such operator-based flow architectures generalize to lattice sizes they were not trained on, and show that pretraining on smaller lattices can lead to a speedup over training directly on the target lattice size.
- Flow-based generative models for markov chain monte carlo in lattice field theory. Physical Review D, 100(3):034515, 2019.
- Neural operator: Learning maps between function spaces. arXiv preprint arXiv:2108.08481, 2021.
- Neural ordinary differential equations. Advances in neural information processing systems, 31, 2018.
- Introduction to normalizing flows for lattice field theory, 2021a. URL https://arxiv.org/abs/2101.08176.
- Flow-based sampling in the lattice schwinger model at criticality, 2022. URL https://arxiv.org/abs/2202.11712.
- Gauge-equivariant flow models for sampling in lattice field theories with pseudofermions, 2022. URL https://arxiv.org/abs/2207.08945.
- Flow-based sampling for fermionic lattice field theories. Physical Review D, 104(11), dec 2021b. doi: 10.1103/physrevd.104.114507. URL https://doi.org/10.1103%2Fphysrevd.104.114507.
- Sampling using SU(n)SU𝑛\mathrm{SU}(n)roman_SU ( italic_n ) gauge equivariant flows. Phys. Rev. D, 103:074504, Apr 2021. doi: 10.1103/PhysRevD.103.074504. URL https://link.aps.org/doi/10.1103/PhysRevD.103.074504.
- Boltzmann generators – sampling equilibrium states of many-body systems with deep learning, 2018. URL https://arxiv.org/abs/1812.01729.
- Equivariant flows: Exact likelihood generative learning for symmetric densities, 2020. URL https://arxiv.org/abs/2006.02425.
- Asymptotically unbiased estimation of physical observables with neural samplers. Physical Review E, 101(2), feb 2020. doi: 10.1103/physreve.101.023304. URL https://doi.org/10.1103%2Fphysreve.101.023304.
- Estimation of thermodynamic observables in lattice field theories with deep generative models. Physical review letters, 126(3):032001, 2021.
- Detecting and mitigating mode-collapse for flow-based sampling of lattice field theories. arXiv preprint arXiv:2302.14082, 2023.
- Scaling up machine learning for quantum field theory with equivariant continuous flows, 2021. URL https://arxiv.org/abs/2110.02673.
- Learning lattice quantum field theories with equivariant continuous flows, 2022.
- Learning interpolations between boltzmann densities. Transactions on Machine Learning Research, 2023. ISSN 2835-8856. URL https://openreview.net/forum?id=TH6YrEcbth.
- Jos Thijssen. Computational Physics. Cambridge University Press, 2 edition, 2007. doi: 10.1017/CBO9781139171397.
- Neural networks with cheap differential operators. Advances in Neural Information Processing Systems, 32, 2019.
- Python reference manual. Centrum voor Wiskunde en Informatica Amsterdam, 1995.
- The DeepMind JAX Ecosystem, 2020. URL http://github.com/deepmind.
- Flax: A neural network library and ecosystem for JAX, 2023. URL http://github.com/google/flax.
- Array programming with NumPy. Nature, 585(7825):357–362, September 2020. doi: 10.1038/s41586-020-2649-2. URL https://doi.org/10.1038/s41586-020-2649-2.
- Omry Yadan. Hydra - a framework for elegantly configuring complex applications. Github, 2019. URL https://github.com/facebookresearch/hydra.
- J. D. Hunter. Matplotlib: A 2d graphics environment. Computing in Science & Engineering, 9(3):90–95, 2007. doi: 10.1109/MCSE.2007.55.
- IPython: a system for interactive scientific computing. Computing in Science and Engineering, 9(3):21–29, May 2007. ISSN 1521-9615. doi: 10.1109/MCSE.2007.53. URL https://ipython.org.
- Lukas Biewald. Experiment tracking with weights and biases, 2020. URL https://www.wandb.com/. Software available from wandb.com.