Score dynamics: scaling molecular dynamics with picoseconds timestep via conditional diffusion model (2310.01678v4)
Abstract: We propose score dynamics (SD), a general framework for learning accelerated evolution operators with large timesteps from molecular-dynamics simulations. SD is centered around scores, or derivatives of the transition log-probability with respect to the dynamical degrees of freedom. The latter play the same role as force fields in MD but are used in denoising diffusion probability models to generate discrete transitions of the dynamical variables in an SD timestep, which can be orders of magnitude larger than a typical MD timestep. In this work, we construct graph neural network based score dynamics models of realistic molecular systems that are evolved with 10~ps timesteps. We demonstrate the efficacy of score dynamics with case studies of alanine dipeptide and short alkanes in aqueous solution. Both equilibrium predictions derived from the stationary distributions of the conditional probability and kinetic predictions for the transition rates and transition paths are in good agreement with MD. Our current SD implementation is about two orders of magnitude faster than the MD counterpart for the systems studied in this work. Open challenges and possible future remedies to improve score dynamics are also discussed.
- “Understanding Molecular Simulation” Elsevier, 2002, pp. 658 DOI: 10.1016/B978-0-12-267351-1.X5000-7
- M. Tuckerman “Statistical Mechanics: Theory and Molecular Simulation”, Oxford Graduate Texts Oxford, 2010
- B J Alder and T E Wainwright “Phase Transition for a Hard Sphere System” In The Journal of Chemical Physics 27.5, 1957, pp. 1208–1209 DOI: 10.1063/1.1743957
- Michael Feig and Charles L. Brooks “Recent advances in the development and application of implicit solvent models in biomolecule simulations” In Current Opinion in Structural Biology 14.2, 2004, pp. 217–224 DOI: 10.1016/j.sbi.2004.03.009
- P J Hoogerbrugge and J M V A Koelman “Simulating Microscopic Hydrodynamic Phenomena with Dissipative Particle Dynamics” In EPL 19.3, 1992, pp. 155–160 DOI: 10.1209/0295-5075/19/3/001
- “A comparison of united atom, explicit atom, and coarse-grained simulation models for poly(ethylene oxide)” In Journal of Chemical Physics 124.23, 2006, pp. 1–11 DOI: 10.1063/1.2204035
- “Chapter 4 Accelerated Molecular Dynamics Methods: Introduction and Recent Developments” In Annual Reports in Computational Chemistry 5.09 Elsevier, 2009, pp. 79–98 DOI: 10.1016/S1574-1400(09)00504-0
- Arthur F. Voter “Parallel replica method for dynamics of infrequent events” In Physical Review B 57.22, 1998, pp. R13985–R13988 DOI: 10.1103/PhysRevB.57.R13985
- Cecilia Clementi “Coarse-grained models of protein folding: toy models or predictive tools?” In Current Opinion in Structural Biology 18.1, 2008, pp. 10–15 DOI: 10.1016/j.sbi.2007.10.005
- “The MARTINI coarse-grained force field: Extension to proteins” In Journal of Chemical Theory and Computation 4.5, 2008, pp. 819–834 DOI: 10.1021/ct700324x
- Arthur F. Voter “Hyperdynamics: Accelerated Molecular Dynamics of Infrequent Events” In Physical Review Letters 78.20, 1997, pp. 3908–3911 DOI: 10.1103/PhysRevLett.78.3908
- Mads R. Sørensen and Arthur F. Voter “Temperature-accelerated dynamics for simulation of infrequent events” In Journal of Chemical Physics 112.21, 2000, pp. 9599–9606 DOI: 10.1063/1.481576
- “Escaping free-energy minima” In Proceedings Of The National Academy Of Sciences Of The United States Of America 99.20 Ctr Svizzero Calcolo Sci, CH-6928 Manno, Switzerland: National Academy of Sciences, 2002, pp. 12562–12566 DOI: 10.1073/pnas.202427399
- “Replica-exchange molecular dynamics method for protein folding” In Chemical Physics Letters 314.1-2 New Jersey: Humana Press, 1999, pp. 141–151
- Erik C. Neyts and Annemie Bogaerts “Combining molecular dynamics with monte carlo simulations: Implementations and applications” In Theoretical Chemistry Accounts 132.2, 2013, pp. 1320 DOI: 10.1007/s00214-012-1320-x
- “Scalable parallel Monte Carlo algorithm for atomistic simulations of precipitation in alloys” In Physical Review B 85.18 APS, 2012, pp. 184203 DOI: 10.1103/PhysRevB.85.184203
- “Calculation of excess free energies of precipitates via direct thermodynamic integration across phase boundaries” In Physical Review B 86.13 APS, 2012, pp. 134204 DOI: 10.1103/PhysRevB.86.134204
- Arthur F. Voter “Introduction to the kinetic Monte Carlo method” In Radiation Effects in Solids 13.1 Dordrecht: Springer Netherlands, 1985, pp. 1–23 DOI: 10.1007/978-1-4020-5295-8_1
- “First-Passage Monte Carlo Algorithm: Diffusion without All the Hops” In Physical Review Letters 97.23 APS, 2006, pp. 230602 DOI: 10.1103/PhysRevLett.97.230602
- “Machine learning for molecular and materials science” In Nature 559 Nature Publishing Group, 2018, pp. 547 DOI: 10.1038/s41586-018-0337-2
- “Artificial intelligence for science in quantum, atomistic, and continuum systems” In arXiv preprint arXiv:2307.08423, 2023
- “Deep unsupervised learning using nonequilibrium thermodynamics” In International Conference on Machine Learning, 2015, pp. 2256–2265 PMLR
- Jonathan Ho, Ajay Jain and Pieter Abbeel “Denoising diffusion probabilistic models” In Advances in Neural Information Processing Systems 33, 2020, pp. 6840–6851
- “Score-based generative modeling through stochastic differential equations” In International Conference on Learning Representations, 2021
- Hazime Mori “Transport, collective motion, and Brownian motion” In Progress of theoretical physics 33.3 Oxford University Press, 1965, pp. 423–455
- Robert Zwanzig “Nonlinear generalized Langevin equations” In Journal of Statistical Physics 9, 1973, pp. 215 DOI: 10.1007/BF01008729
- “Introducing Memory in Coarse-Grained Molecular Simulations” In Journal of Physical Chemistry B 125.19, 2021, pp. 4931–4954 DOI: 10.1021/acs.jpcb.1c01120
- “Incorporation of memory effects in coarse-grained modeling via the Mori-Zwanzig formalism” In The Journal of Chemical Physics 143.24 AIP Publishing, LLC, 2015, pp. 243128 DOI: 10.1016/j.compstruc.2004.03.072
- “Construction of dissipative particle dynamics models for complex fluids via the Mori–Zwanzig formulation” In Soft Matter 10.43, 2014, pp. 8659–8672 DOI: 10.1039/C4SM01387E
- Qian Wang, Nicolò Ripamonti and Jan S Hesthaven “Recurrent neural network closure of parametric POD-Galerkin reduced-order models based on the Mori-Zwanzig formalism” In Journal of Computational Physics 410 Elsevier Inc., 2020, pp. 109402 DOI: 10.1016/j.jcp.2020.109402
- Hannes Risken “The Fokker-Planck Equation” 18, Springer Series in Synergetics Berlin: Springer, 1989 DOI: 10.1007/978-3-642-61544-3
- “Self-supervised learning and prediction of microstructure evolution with convolutional recurrent neural networks” In Patterns 2 Elsevier Inc., 2021, pp. 100243 DOI: 10.1016/j.patter.2021.100243
- “Butane dihedral angle dynamics in water is dominated by internal friction” In Proceedings of the National Academy of Sciences of the United States of America 115.20, 2018, pp. 5169–5174 DOI: 10.1073/pnas.1722327115
- “Diffusion models: A comprehensive survey of methods and applications” In ACM Computing Surveys 56.4 ACM New York, NY, USA, 2023, pp. 1–39
- “Dpm-solver: A fast ode solver for diffusion probabilistic model sampling in around 10 steps” In Advances in Neural Information Processing Systems 35, 2022, pp. 5775–5787
- Pascal Vincent “A connection between score matching and denoising autoencoders” In Neural computation 23.7 MIT Press, 2011, pp. 1661–1674
- “Pytorch: An imperative style, high-performance deep learning library” In Advances in neural information processing systems 32, 2019, pp. 8026–8037
- Matthias Fey and Jan Eric Lenssen “Fast graph representation learning with PyTorch Geometric” Preprint at https://arxiv.org/abs/1903.02428, 2019
- “Fourier features let networks learn high frequency functions in low dimensional domains” In Advances in Neural Information Processing Systems 33, 2020, pp. 7537–7547
- “Gaussian error linear units (gelus)” In arXiv preprint arXiv:1606.08415, 2016
- “Learning mesh-based simulation with graph networks” In arXiv preprint arXiv:2010.03409, 2020
- “Accelerating discrete dislocation dynamics simulations with graph neural networks” In Journal of Computational Physics 487 Elsevier, 2023, pp. 112180
- Nicolas Bertin, Vasily V Bulatov and Fei Zhou “Learning dislocation dynamics mobility laws from large-scale MD simulations” In arXiv preprint arXiv:2309.14450, 2023
- “Accelerate Microstructure Evolution Simulation Using Graph Neural Networks with Adaptive Spatiotemporal Resolution” In arXiv preprint arXiv:2310.15153, 2023
- Jörg Behler “Perspective: Machine learning potentials for atomistic simulations” In The Journal of Chemical Physics 145.17 AIP Publishing, LLC, 2016, pp. 170901 DOI: 10.1063/1.4966192
- “SE(3)-Equivariant Energy-based Models for End-to-End Protein Folding” In bioRxiv Cold Spring Harbor Laboratory, 2021 DOI: 10.1101/2021.06.06.447297
- “Boltzmann generators: Sampling equilibrium states of many-body systems with deep learning” In Science 365.6457, 2019, pp. 141–147 DOI: 10.1126/science.aaw1147
- “Poisson flow generative models” In Advances in Neural Information Processing Systems 35, 2022, pp. 16782–16795
- “Crystal diffusion variational autoencoder for periodic material generation” In arXiv preprint arXiv:2110.06197, 2021
- “Geodiff: A geometric diffusion model for molecular conformation generation” In ICLR, 2022 arXiv:2203.02923
- Jaehyeong Jo, Seul Lee and Sung Ju Hwang “Score-based generative modeling of graphs via the system of stochastic differential equations” In International Conference on Machine Learning, 2022, pp. 10362–10383 PMLR
- “Towards Predicting Equilibrium Distributions for Molecular Systems with Deep Learning” In arXiv preprint arXiv:2306.05445, 2023
- Yihang Wang, Lukas Herron and Pratyush Tiwary “From data to noise to data for mixing physics across temperatures with generative artificial intelligence” In Proceedings of the National Academy of Sciences of the United States of America 119.32, 2022, pp. 1–8 DOI: 10.1073/pnas.2203656119
- “Score-based denoising for atomic structure identification” In arXiv preprint arXiv:2212.02421, 2022
- “Machine Learning of Coarse-Grained Molecular Dynamics Force Fields” In ACS Central Science 5.5, 2019, pp. 755–767 DOI: 10.1021/acscentsci.8b00913
- “Machine learning to improve efficiency of non-empirical interaction parameter for dissipative particle dynamics (DPD) simulation” In Japanese Journal of Applied Physics 62.7 IOP Publishing, 2023, pp. 070901 DOI: 10.35848/1347-4065/ace575
- “Neural Parametric Fokker–Planck Equation” In SIAM Journal on Numerical Analysis 60.3, 2022, pp. 1385–1449
- “Timewarp: Transferable acceleration of molecular dynamics by learning time-coarsened dynamics” In arXiv preprint arXiv:2302.01170, 2023
- “Simulate time-integrated coarse-grained molecular dynamics with geometric machine learning” In arXiv preprint arXiv:2204.10348, 2022
- Fang Wu and Stan Z Li “DIFFMD: a geometric diffusion model for molecular dynamics simulations” In Proceedings of the AAAI Conference on Artificial Intelligence 37.4, 2023, pp. 5321–5329
- “Two for one: Diffusion models and force fields for coarse-grained molecular dynamics” In Journal of Chemical Theory and Computation 19.18 ACS Publications, 2023, pp. 6151–6159
- Jiarui Lu, Bozitao Zhong and Jian Tang “Score-based Enhanced Sampling for Protein Molecular Dynamics” In arXiv preprint arXiv:2306.03117, 2023
- Mathias Schreiner, Ole Winther and Simon Olsson “Implicit Transfer Operator Learning: Multiple Time-Resolution Surrogates for Molecular Dynamics” In arXiv preprint arXiv:2305.18046, 2023
- “Gromacs: High performance molecular simulations through multi-level parallelism from laptops to supercomputers” In SoftwareX 1-2, 2015, pp. 19–25 DOI: 10.1016/j.softx.2015.06.001
- William L. Jorgensen, David S. Maxwell and Julian Tirado-Rives “Development and testing of the OPLS all-atom force field on conformational energetics and properties of organic liquids” In Journal of the American Chemical Society 118.45, 1996, pp. 11225–11236 DOI: 10.1021/ja9621760
- “Comparison of simple potential functions for simulating liquid water” In The Journal of Chemical Physics 79.2, 1983, pp. 926–935 DOI: 10.1063/1.445869
- “LINCS: A linear constraint solver for molecular simulations” In Journal of Computational Chemistry 18.12, 1997, pp. 1463–1472
- Tom Darden, Darrin York and Lee Pedersen “Particle mesh Ewald: An Nlog(N) method for Ewald sums in large systems” In The Journal of Chemical Physics 98.12, 1993, pp. 10089–10092 DOI: 10.1063/1.464397
- “Molecular dynamics with coupling to an external bath” In The Journal of Chemical Physics 81.8, 1984, pp. 3684–3690 DOI: 10.1063/1.448118
- “Metadynamics As a Tool for Mapping the Conformational and Free-Energy Space of Peptides—The Alanine Dipeptide Case Study” In The Journal of Physical Chemistry B 114.16 ACS Publications, 2010, pp. 5632–5642