Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
162 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Score dynamics: scaling molecular dynamics with picoseconds timestep via conditional diffusion model (2310.01678v4)

Published 2 Oct 2023 in physics.comp-ph and cs.LG

Abstract: We propose score dynamics (SD), a general framework for learning accelerated evolution operators with large timesteps from molecular-dynamics simulations. SD is centered around scores, or derivatives of the transition log-probability with respect to the dynamical degrees of freedom. The latter play the same role as force fields in MD but are used in denoising diffusion probability models to generate discrete transitions of the dynamical variables in an SD timestep, which can be orders of magnitude larger than a typical MD timestep. In this work, we construct graph neural network based score dynamics models of realistic molecular systems that are evolved with 10~ps timesteps. We demonstrate the efficacy of score dynamics with case studies of alanine dipeptide and short alkanes in aqueous solution. Both equilibrium predictions derived from the stationary distributions of the conditional probability and kinetic predictions for the transition rates and transition paths are in good agreement with MD. Our current SD implementation is about two orders of magnitude faster than the MD counterpart for the systems studied in this work. Open challenges and possible future remedies to improve score dynamics are also discussed.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (70)
  1. “Understanding Molecular Simulation” Elsevier, 2002, pp. 658 DOI: 10.1016/B978-0-12-267351-1.X5000-7
  2. M. Tuckerman “Statistical Mechanics: Theory and Molecular Simulation”, Oxford Graduate Texts Oxford, 2010
  3. B J Alder and T E Wainwright “Phase Transition for a Hard Sphere System” In The Journal of Chemical Physics 27.5, 1957, pp. 1208–1209 DOI: 10.1063/1.1743957
  4. Michael Feig and Charles L. Brooks “Recent advances in the development and application of implicit solvent models in biomolecule simulations” In Current Opinion in Structural Biology 14.2, 2004, pp. 217–224 DOI: 10.1016/j.sbi.2004.03.009
  5. P J Hoogerbrugge and J M V A Koelman “Simulating Microscopic Hydrodynamic Phenomena with Dissipative Particle Dynamics” In EPL 19.3, 1992, pp. 155–160 DOI: 10.1209/0295-5075/19/3/001
  6. “A comparison of united atom, explicit atom, and coarse-grained simulation models for poly(ethylene oxide)” In Journal of Chemical Physics 124.23, 2006, pp. 1–11 DOI: 10.1063/1.2204035
  7. “Chapter 4 Accelerated Molecular Dynamics Methods: Introduction and Recent Developments” In Annual Reports in Computational Chemistry 5.09 Elsevier, 2009, pp. 79–98 DOI: 10.1016/S1574-1400(09)00504-0
  8. Arthur F. Voter “Parallel replica method for dynamics of infrequent events” In Physical Review B 57.22, 1998, pp. R13985–R13988 DOI: 10.1103/PhysRevB.57.R13985
  9. Cecilia Clementi “Coarse-grained models of protein folding: toy models or predictive tools?” In Current Opinion in Structural Biology 18.1, 2008, pp. 10–15 DOI: 10.1016/j.sbi.2007.10.005
  10. “The MARTINI coarse-grained force field: Extension to proteins” In Journal of Chemical Theory and Computation 4.5, 2008, pp. 819–834 DOI: 10.1021/ct700324x
  11. Arthur F. Voter “Hyperdynamics: Accelerated Molecular Dynamics of Infrequent Events” In Physical Review Letters 78.20, 1997, pp. 3908–3911 DOI: 10.1103/PhysRevLett.78.3908
  12. Mads R. Sørensen and Arthur F. Voter “Temperature-accelerated dynamics for simulation of infrequent events” In Journal of Chemical Physics 112.21, 2000, pp. 9599–9606 DOI: 10.1063/1.481576
  13. “Escaping free-energy minima” In Proceedings Of The National Academy Of Sciences Of The United States Of America 99.20 Ctr Svizzero Calcolo Sci, CH-6928 Manno, Switzerland: National Academy of Sciences, 2002, pp. 12562–12566 DOI: 10.1073/pnas.202427399
  14. “Replica-exchange molecular dynamics method for protein folding” In Chemical Physics Letters 314.1-2 New Jersey: Humana Press, 1999, pp. 141–151
  15. Erik C. Neyts and Annemie Bogaerts “Combining molecular dynamics with monte carlo simulations: Implementations and applications” In Theoretical Chemistry Accounts 132.2, 2013, pp. 1320 DOI: 10.1007/s00214-012-1320-x
  16. “Scalable parallel Monte Carlo algorithm for atomistic simulations of precipitation in alloys” In Physical Review B 85.18 APS, 2012, pp. 184203 DOI: 10.1103/PhysRevB.85.184203
  17. “Calculation of excess free energies of precipitates via direct thermodynamic integration across phase boundaries” In Physical Review B 86.13 APS, 2012, pp. 134204 DOI: 10.1103/PhysRevB.86.134204
  18. Arthur F. Voter “Introduction to the kinetic Monte Carlo method” In Radiation Effects in Solids 13.1 Dordrecht: Springer Netherlands, 1985, pp. 1–23 DOI: 10.1007/978-1-4020-5295-8_1
  19. “First-Passage Monte Carlo Algorithm: Diffusion without All the Hops” In Physical Review Letters 97.23 APS, 2006, pp. 230602 DOI: 10.1103/PhysRevLett.97.230602
  20. “Machine learning for molecular and materials science” In Nature 559 Nature Publishing Group, 2018, pp. 547 DOI: 10.1038/s41586-018-0337-2
  21. “Artificial intelligence for science in quantum, atomistic, and continuum systems” In arXiv preprint arXiv:2307.08423, 2023
  22. “Deep unsupervised learning using nonequilibrium thermodynamics” In International Conference on Machine Learning, 2015, pp. 2256–2265 PMLR
  23. Jonathan Ho, Ajay Jain and Pieter Abbeel “Denoising diffusion probabilistic models” In Advances in Neural Information Processing Systems 33, 2020, pp. 6840–6851
  24. “Score-based generative modeling through stochastic differential equations” In International Conference on Learning Representations, 2021
  25. Hazime Mori “Transport, collective motion, and Brownian motion” In Progress of theoretical physics 33.3 Oxford University Press, 1965, pp. 423–455
  26. Robert Zwanzig “Nonlinear generalized Langevin equations” In Journal of Statistical Physics 9, 1973, pp. 215 DOI: 10.1007/BF01008729
  27. “Introducing Memory in Coarse-Grained Molecular Simulations” In Journal of Physical Chemistry B 125.19, 2021, pp. 4931–4954 DOI: 10.1021/acs.jpcb.1c01120
  28. “Incorporation of memory effects in coarse-grained modeling via the Mori-Zwanzig formalism” In The Journal of Chemical Physics 143.24 AIP Publishing, LLC, 2015, pp. 243128 DOI: 10.1016/j.compstruc.2004.03.072
  29. “Construction of dissipative particle dynamics models for complex fluids via the Mori–Zwanzig formulation” In Soft Matter 10.43, 2014, pp. 8659–8672 DOI: 10.1039/C4SM01387E
  30. Qian Wang, Nicolò Ripamonti and Jan S Hesthaven “Recurrent neural network closure of parametric POD-Galerkin reduced-order models based on the Mori-Zwanzig formalism” In Journal of Computational Physics 410 Elsevier Inc., 2020, pp. 109402 DOI: 10.1016/j.jcp.2020.109402
  31. Hannes Risken “The Fokker-Planck Equation” 18, Springer Series in Synergetics Berlin: Springer, 1989 DOI: 10.1007/978-3-642-61544-3
  32. “Self-supervised learning and prediction of microstructure evolution with convolutional recurrent neural networks” In Patterns 2 Elsevier Inc., 2021, pp. 100243 DOI: 10.1016/j.patter.2021.100243
  33. “Butane dihedral angle dynamics in water is dominated by internal friction” In Proceedings of the National Academy of Sciences of the United States of America 115.20, 2018, pp. 5169–5174 DOI: 10.1073/pnas.1722327115
  34. “Diffusion models: A comprehensive survey of methods and applications” In ACM Computing Surveys 56.4 ACM New York, NY, USA, 2023, pp. 1–39
  35. “Dpm-solver: A fast ode solver for diffusion probabilistic model sampling in around 10 steps” In Advances in Neural Information Processing Systems 35, 2022, pp. 5775–5787
  36. Pascal Vincent “A connection between score matching and denoising autoencoders” In Neural computation 23.7 MIT Press, 2011, pp. 1661–1674
  37. “Pytorch: An imperative style, high-performance deep learning library” In Advances in neural information processing systems 32, 2019, pp. 8026–8037
  38. Matthias Fey and Jan Eric Lenssen “Fast graph representation learning with PyTorch Geometric” Preprint at https://arxiv.org/abs/1903.02428, 2019
  39. “Fourier features let networks learn high frequency functions in low dimensional domains” In Advances in Neural Information Processing Systems 33, 2020, pp. 7537–7547
  40. “Gaussian error linear units (gelus)” In arXiv preprint arXiv:1606.08415, 2016
  41. “Learning mesh-based simulation with graph networks” In arXiv preprint arXiv:2010.03409, 2020
  42. “Accelerating discrete dislocation dynamics simulations with graph neural networks” In Journal of Computational Physics 487 Elsevier, 2023, pp. 112180
  43. Nicolas Bertin, Vasily V Bulatov and Fei Zhou “Learning dislocation dynamics mobility laws from large-scale MD simulations” In arXiv preprint arXiv:2309.14450, 2023
  44. “Accelerate Microstructure Evolution Simulation Using Graph Neural Networks with Adaptive Spatiotemporal Resolution” In arXiv preprint arXiv:2310.15153, 2023
  45. Jörg Behler “Perspective: Machine learning potentials for atomistic simulations” In The Journal of Chemical Physics 145.17 AIP Publishing, LLC, 2016, pp. 170901 DOI: 10.1063/1.4966192
  46. “SE(3)-Equivariant Energy-based Models for End-to-End Protein Folding” In bioRxiv Cold Spring Harbor Laboratory, 2021 DOI: 10.1101/2021.06.06.447297
  47. “Boltzmann generators: Sampling equilibrium states of many-body systems with deep learning” In Science 365.6457, 2019, pp. 141–147 DOI: 10.1126/science.aaw1147
  48. “Poisson flow generative models” In Advances in Neural Information Processing Systems 35, 2022, pp. 16782–16795
  49. “Crystal diffusion variational autoencoder for periodic material generation” In arXiv preprint arXiv:2110.06197, 2021
  50. “Geodiff: A geometric diffusion model for molecular conformation generation” In ICLR, 2022 arXiv:2203.02923
  51. Jaehyeong Jo, Seul Lee and Sung Ju Hwang “Score-based generative modeling of graphs via the system of stochastic differential equations” In International Conference on Machine Learning, 2022, pp. 10362–10383 PMLR
  52. “Towards Predicting Equilibrium Distributions for Molecular Systems with Deep Learning” In arXiv preprint arXiv:2306.05445, 2023
  53. Yihang Wang, Lukas Herron and Pratyush Tiwary “From data to noise to data for mixing physics across temperatures with generative artificial intelligence” In Proceedings of the National Academy of Sciences of the United States of America 119.32, 2022, pp. 1–8 DOI: 10.1073/pnas.2203656119
  54. “Score-based denoising for atomic structure identification” In arXiv preprint arXiv:2212.02421, 2022
  55. “Machine Learning of Coarse-Grained Molecular Dynamics Force Fields” In ACS Central Science 5.5, 2019, pp. 755–767 DOI: 10.1021/acscentsci.8b00913
  56. “Machine learning to improve efficiency of non-empirical interaction parameter for dissipative particle dynamics (DPD) simulation” In Japanese Journal of Applied Physics 62.7 IOP Publishing, 2023, pp. 070901 DOI: 10.35848/1347-4065/ace575
  57. “Neural Parametric Fokker–Planck Equation” In SIAM Journal on Numerical Analysis 60.3, 2022, pp. 1385–1449
  58. “Timewarp: Transferable acceleration of molecular dynamics by learning time-coarsened dynamics” In arXiv preprint arXiv:2302.01170, 2023
  59. “Simulate time-integrated coarse-grained molecular dynamics with geometric machine learning” In arXiv preprint arXiv:2204.10348, 2022
  60. Fang Wu and Stan Z Li “DIFFMD: a geometric diffusion model for molecular dynamics simulations” In Proceedings of the AAAI Conference on Artificial Intelligence 37.4, 2023, pp. 5321–5329
  61. “Two for one: Diffusion models and force fields for coarse-grained molecular dynamics” In Journal of Chemical Theory and Computation 19.18 ACS Publications, 2023, pp. 6151–6159
  62. Jiarui Lu, Bozitao Zhong and Jian Tang “Score-based Enhanced Sampling for Protein Molecular Dynamics” In arXiv preprint arXiv:2306.03117, 2023
  63. Mathias Schreiner, Ole Winther and Simon Olsson “Implicit Transfer Operator Learning: Multiple Time-Resolution Surrogates for Molecular Dynamics” In arXiv preprint arXiv:2305.18046, 2023
  64. “Gromacs: High performance molecular simulations through multi-level parallelism from laptops to supercomputers” In SoftwareX 1-2, 2015, pp. 19–25 DOI: 10.1016/j.softx.2015.06.001
  65. William L. Jorgensen, David S. Maxwell and Julian Tirado-Rives “Development and testing of the OPLS all-atom force field on conformational energetics and properties of organic liquids” In Journal of the American Chemical Society 118.45, 1996, pp. 11225–11236 DOI: 10.1021/ja9621760
  66. “Comparison of simple potential functions for simulating liquid water” In The Journal of Chemical Physics 79.2, 1983, pp. 926–935 DOI: 10.1063/1.445869
  67. “LINCS: A linear constraint solver for molecular simulations” In Journal of Computational Chemistry 18.12, 1997, pp. 1463–1472
  68. Tom Darden, Darrin York and Lee Pedersen “Particle mesh Ewald: An Nlog(N) method for Ewald sums in large systems” In The Journal of Chemical Physics 98.12, 1993, pp. 10089–10092 DOI: 10.1063/1.464397
  69. “Molecular dynamics with coupling to an external bath” In The Journal of Chemical Physics 81.8, 1984, pp. 3684–3690 DOI: 10.1063/1.448118
  70. “Metadynamics As a Tool for Mapping the Conformational and Free-Energy Space of Peptides—The Alanine Dipeptide Case Study” In The Journal of Physical Chemistry B 114.16 ACS Publications, 2010, pp. 5632–5642
Citations (11)

Summary

We haven't generated a summary for this paper yet.