BAMBOO: a predictive and transferable machine learning force field framework for liquid electrolyte development (2404.07181v4)
Abstract: Despite the widespread applications of machine learning force field (MLFF) on solids and small molecules, there is a notable gap in applying MLFF to complex liquid electrolytes. In this work, we introduce BAMBOO (ByteDance AI Molecular Simulation Booster), a novel framework for molecular dynamics (MD) simulations, with a demonstration of its capabilities in the context of liquid electrolytes for lithium batteries. We design a physics-inspired graph equivariant transformer architecture as the backbone of BAMBOO to learn from quantum mechanical simulations. Additionally, we pioneer an ensemble knowledge distillation approach and apply it on MLFFs to improve the stability of MD simulations. Finally, we propose the density alignment algorithm to align BAMBOO with experimental measurements. BAMBOO demonstrates state-of-the-art accuracy in predicting key electrolyte properties such as density, viscosity, and ionic conductivity across various solvents and salt combinations. Our current model, trained on more than 15 chemical species, achieves the average density error of 0.01 g/cm$3$ on various compositions compared with experimental data. Moreover, our model demonstrates transferability to molecules not included in the quantum mechanical dataset. We envision this work as paving the way to a "universal MLFF" capable of simulating properties of common organic liquids.
- Kang Xu “Nonaqueous liquid electrolytes for lithium-based rechargeable batteries” In Chem. Rev. 104.10 ACS Publications, 2004, pp. 4303–4418
- Kang Xu “Electrolytes, Interfaces and Interphases: Fundamentals and Applications in Batteries” Royal Society of Chemistry, 2023
- Y Shirley Meng, Venkat Srinivasan and Kang Xu “Designing better electrolytes” In Science 378.6624 American Association for the Advancement of Science, 2022, pp. eabq3750
- “Superconcentrated electrolytes for a high-voltage lithium-ion battery” In Nat. Commun. 7.1 Nature Publishing Group UK London, 2016, pp. 12032
- “Localized high-concentration electrolytes get more localized through micelle-like structures” In Nat. Mater. 22.12 Nature Publishing Group UK London, 2023, pp. 1531–1539
- “Molecular design for electrolyte solvents enabling energy-dense and long-cycling lithium metal batteries” In Nat. Energy 5.7 Nature Publishing Group UK London, 2020, pp. 526–533
- “A new class of ionically conducting fluorinated ether electrolytes with high electrochemical stability” In J. Am. Chem. Soc. 142.16 ACS Publications, 2020, pp. 7393–7403
- “Ligand-channel-enabled ultrafast Li-ion conduction” In Nature Nature Publishing Group UK London, 2024, pp. 1–7
- “Solvation sheath of Li+ in nonaqueous electrolytes and its implication of graphite electrolyte interface chemistry” In J. Phys. Chem. C 111.20 ACS Publications, 2007, pp. 7411–7421
- “Uncharted waters: super-concentrated electrolytes” In Joule 4.1 Elsevier, 2020, pp. 69–100
- “Machine learning force fields” In Chem. Rev. 121.16 ACS Publications, 2021, pp. 10142–10186
- “Understanding molecular simulation: from algorithms to applications” Elsevier, 2023
- Thomas A Halgren “Merck molecular force field. I. Basis, form, scope, parameterization, and performance of MMFF94” In J. Comput. Chem. 17.5-6 Wiley Online Library, 1996, pp. 490–519
- “Generalized Neural-Network Representation of High-Dimensional Potential-Energy Surfaces” In Phys. Rev. Lett. 98 American Physical Society, 2007, pp. 146401 DOI: 10.1103/PhysRevLett.98.146401
- “Deep Potential Molecular Dynamics: A Scalable Model with the Accuracy of Quantum Mechanics” In Phys. Rev. Lett. 120 American Physical Society, 2018, pp. 143001 DOI: 10.1103/PhysRevLett.120.143001
- “Performant implementation of the atomic cluster expansion (PACE) and application to copper and silicon” In npj Comput. Mater. 7, 2021, pp. 97 DOI: 10.1038/s41524-021-00559-9
- “SchNet – A deep learning architecture for molecules and materials” In J. Chem. Phys. 148.24, 2018, pp. 241722 DOI: 10.1063/1.5019779
- “E(3)-equivariant graph neural networks for data-efficient and accurate interatomic potentials” In Nat. Commun. 13, 2022 DOI: 10.1038/s41467-022-29939-5
- “Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphs”, 2023 arXiv:2206.11990 [cs.LG]
- Philipp Thölke and Gianni De Fabritiis “TorchMD-NET: Equivariant Transformers for Neural Network based Molecular Potentials”, 2022 arXiv:2202.02541 [cs.LG]
- “A fourth-generation high-dimensional neural network potential with accurate electrostatics including non-local charge transfer” In Nat. Commun. 12.1 Nature Publishing Group UK London, 2021, pp. 398
- “A deep potential model with long-range electrostatic interactions” In J. Chem. Phys. 156.12, 2022, pp. 124107 DOI: 10.1063/5.0083669
- Dylan Anstine, Roman Zubatyuk and Olexandr Isayev “AIMNet2: A Neural Network Potential to Meet your Neutral, Charged, Organic, and Elemental-Organic Needs”, 2023 DOI: 10.26434/chemrxiv-2023-296ch
- “PhysNet: A Neural Network for Predicting Energies, Forces, Dipole Moments and Partial Charges” In J. Chem. Theory Comput. 15, 2019 DOI: 10.1021/acs.jctc.9b00181
- “SpookyNet: Learning force fields with electronic degrees of freedom and nonlocal effects” In Nat. Commun. 12, 2021 DOI: 10.1038/s41467-021-27504-0
- “Spin-Dependent Graph Neural Network Potential for Magnetic Materials”, 2023 arXiv:2203.02853 [physics.comp-ph]
- “A universal graph deep learning interatomic potential for the periodic table” In Nat. Comput. Sci. 2, 2022, pp. 718–728 DOI: 10.1038/s43588-022-00349-3
- “CHGNet as a pretrained universal neural network potential for charge-informed atomistic modelling” In Nat. Mach. Intell. 5.9, 2023 DOI: 10.1038/s42256-023-00716-3
- “Scaling deep learning for materials discovery” In Nature 624, 2023, pp. 1–6 DOI: 10.1038/s41586-023-06735-9
- “DPA-2: Towards a universal large atomic model for molecular and material simulation”, 2023 arXiv:2312.15492 [physics.chem-ph]
- “A foundation model for atomistic materials chemistry”, 2024 arXiv:2401.00096 [physics.chem-ph]
- “MACE-OFF23: Transferable Machine Learning Force Fields for Organic Molecules”, 2023 arXiv:2312.15211 [physics.chem-ph]
- “Force Field for Water Based on Neural Network” PMID: 29775313 In J. Phys. Chem. Lett. 9.12, 2018, pp. 3232–3240 DOI: 10.1021/acs.jpclett.8b01131
- “Machine learning force fields for molecular liquids: Ethylene Carbonate/Ethyl Methyl Carbonate binary solvent” In npj Comput. Mater. 9, 2023, pp. 1–15
- “A Differentiable Neural-Network Force Field for Ionic Liquids” PMID: 34941253 In J. Chem. Inf. Model. 62.1, 2022, pp. 88–101 DOI: 10.1021/acs.jcim.1c01380
- “Understanding the solvation structures of glyme-based electrolytes by machine learning molecular dynamics” In Chinese J. Struc. Chem. 42.9, 2023, pp. 100061 DOI: https://doi.org/10.1016/j.cjsc.2023.100061
- “High-Dimensional Neural Network Potential for Liquid Electrolyte Simulations” In J. Phys. Chem. B 126, 2022 DOI: 10.1021/acs.jpcb.2c03746
- “Transferable Neural Network Potential Energy Surfaces for Closed-Shell Organic Molecules: Extension to Ions” In J. Chem. Theory Comput. 18, 2022 DOI: 10.1021/acs.jctc.1c00821
- “Forces are not enough: Benchmark and critical evaluation for machine learning force fields with molecular simulations” In arXiv preprint arXiv:2210.07237, 2022
- “Convergence and equilibrium in molecular dynamics simulations” In Commun. Chem. 7, 2024 DOI: 10.1038/s42004-024-01114-5
- “DMFF: An Open-Source Automatic Differentiable Platform for Molecular Force Field Development and Molecular Dynamics Simulation” PMID: 37589304 In J. Chem. Theory Comput. 19.17, 2023, pp. 5897–5909 DOI: 10.1021/acs.jctc.2c01297
- Joe G. Greener and David T. Jones “Differentiable molecular simulation can learn all the parameters in a coarse-grained force field for proteins” In PLOS ONE 16.9 Public Library of Science, 2021, pp. 1–20 DOI: 10.1371/journal.pone.0256990
- “3M™ Novec™ 7000 Engineered Fluid” URL: https://multimedia.3m.com/mws/media/121372O/3m-novec-7000-engineered-fluid-tds.pdf
- Umar Asif, Jianbin Tang and Stefan Harrer “Ensemble knowledge distillation for learning improved and efficient networks” In arXiv preprint arXiv:1909.08097, 2019
- David Chandler, John D. Weeks and Hans C. Andersen “Van der Waals Picture of Liquids, Solids, and Phase Transformations” In Science 220.4599, 1983, pp. 787–794 DOI: 10.1126/science.220.4599.787
- Georgios M. Kontogeorgis, Bjørn Maribo-Mogensen and Kaj Thomsen “The Debye-Hückel theory and its importance in modeling electrolyte solutions” In Fluid Ph. Equilib. 462 Elsevier, 2018, pp. 130–152 DOI: 10.1016/j.fluid.2018.01.004
- “Molecular Dynamics Using Nonvariational Polarizable Force Fields: Theory, Periodic Boundary Conditions Implementation, and Application to the Bond Capacity Model” In J. Chem. Theory Comput. 2019, 2019 DOI: 10.1021/acs.jctc.9b00721
- Heiner Schröder, Anne Creon and Tobias Schwabe “Reformulation of the D3(Becke–Johnson) Dispersion Correction without Resorting to Higher than C6 Dispersion Coefficients” In J. Chem. Theory Comput. 11.7 American Chemical Society (ACS), 2015, pp. 3163–3170 DOI: 10.1021/acs.jctc.5b00400
- Alejandro Torres-Sánchez, Juan M. Vanegas and Marino Arroyo “Geometric derivation of the microscopic stress: A covariant central force decomposition” Special Issue in honor of Michael Ortiz In J. Mech. Phys. Solids 93, 2016, pp. 224–239 DOI: https://doi.org/10.1016/j.jmps.2016.03.006
- “Attention is all you need” In Advances in neural information processing systems 30, 2017
- “Examining graph neural networks for crystal structures: Limitations and opportunities for capturing periodicity” In Sci. Adv. 9.45, 2023, pp. eadi3245 DOI: 10.1126/sciadv.adi3245
- “LAMMPS - a flexible simulation tool for particle-based materials modeling at the atomic, meso, and continuum scales” In Comp. Phys. Comm. 271, 2022, pp. 108171 DOI: 10.1016/j.cpc.2021.108171
- “Learning local equivariant representations for large-scale atomistic dynamics” In Nat. Commun. 14.1 Nature Publishing Group UK London, 2023, pp. 579
- “ViSNet: an equivariant geometry-enhanced graph neural network with vector-scalar interactive message passing for molecules” In arXiv preprint arXiv:2210.16518, 2022
- “MACE: Higher order equivariant message passing neural networks for fast and accurate force fields” In Advances in Neural Information Processing Systems 35, 2022, pp. 11423–11436
- Raul P.Pelaez etal. “TorchMD-Net 2.0: Fast Neural Network Potentials for Molecular Simulations”, 2024 arXiv:2402.17660 [cs.LG]
- “OPLS4: Improving Force Field Accuracy on Challenging Regimes of Chemical Space” PMID: 34096718 In J. Chem. Theory Comput. 17.7, 2021, pp. 4291–4300 DOI: 10.1021/acs.jctc.1c00302
- Oleg Borodin “Polarizable Force Field Development and Molecular Dynamics Simulations of Ionic Liquids” PMID: 19637900 In J. Phys. Chem. B 113.33, 2009, pp. 11463–11478 DOI: 10.1021/jp905220k
- URL: https://wasatchmolecular.com/tables.pdf
- Georg Martius and Christoph H Lampert “Extrapolation and learning equations” In arXiv preprint arXiv:1610.02995, 2016
- Adarsh R. Dave “Automated Design and Discovery of Liquid Electrolytes for Lithium-Ion Batteries”, 2023 DOI: 10.1184/R1/22735025.v1
- “Physical properties of substituted 1, 3-dioxolan-2-ones” In Chem. Lett. 37.2 Oxford University Press, 2008, pp. 210–211
- Yukio Sasaki “Chapter 13 - Physical and electrochemical properties and application to lithium batteries of fluorinated organic solvents” In Fluorinated Materials for Energy Conversion Amsterdam: Elsevier Science, 2005, pp. 285–304 DOI: https://doi.org/10.1016/B978-008044472-7/50041-2
- “Fluoroethylene Carbonate and Propylene Carbonate Mixtures Based Electrolytes for Supercapacitors” In ECS Trans. 58.27 IOP Publishing, 2014, pp. 71
- “Liquid nonaqueous electrolytes” In Handbook of battery materials Wiley Online Library, 2011, pp. 525–626
- “Autonomous optimization of non-aqueous Li-ion battery electrolytes via robotic experimentation and machine learning coupling” In Nat. Commun. 13.1 Nature Publishing Group UK London, 2022, pp. 5454
- “A study of the transport properties of ethylene carbonate-free Li electrolytes” In J. Electrochem. Soc. 165.3 The Electrochemical Society, 2018, pp. A705–A716
- “On Relative Importance of Vehicular and Structural Motions in Defining Electrolyte Transport” In J. Electrochem. Soc. 170.11 IOP Publishing, 2023, pp. 110536
- “Exploring classes of co-solvents for fast-charging lithium-ion cells” In J. Electrochem. Soc. 165.10 IOP Publishing, 2018, pp. A2365
- “A study of highly conductive ester co-solvents in Li [Ni0. 5Mn0. 3Co0. 2] O2/Graphite pouch cells” In Electrochim. Acta. 270 Elsevier, 2018, pp. 215–223
- Kang Xu “Navigating the minefield of battery literature” In Commun. Mater. 3.1 Nature Publishing Group UK London, 2022, pp. 31
- “Transport and electrochemical properties and spectral features of non-aqueous electrolytes containing LiFSI in linear carbonate solvents” In J. Electrochem. Soc. 158.2 IOP Publishing, 2010, pp. A74
- “Physicochemical and electrochemical properties of the organic solvent electrolyte with lithium bis (fluorosulfonyl) imide (LiFSI) as lithium-ion conducting salt for lithium-ion batteries” In ECS Trans 64.24 IOP Publishing, 2015, pp. 11
- “Polymer architecture effect on sodium ion transport in PSTFSI-based ionomers: A molecular dynamics study” In Solid State Ion. 288 Elsevier, 2016, pp. 271–276
- Harish Gudla, Chao Zhang and Daniel Brandell “Effects of solvent polarity on Li-ion diffusion in polymer electrolytes: An all-atom molecular dynamics study with charge scaling” In J. Phys. Chem. B. 124.37 ACS Publications, 2020, pp. 8124–8131
- “Toward bottom-up understanding of transport in concentrated battery electrolytes” In ACS Cent. Sci. 8.7 ACS Publications, 2022, pp. 880–890
- “Tuning fluorination of linear carbonate for lithium-ion batteries” In J. Electrochem. Soc. 169.4 IOP Publishing, 2022, pp. 040555
- “Electrolyte engineering via ether solvent fluorination for developing stable non-aqueous lithium metal batteries” In Nat. Commun. 14.1 Nature Publishing Group UK London, 2023, pp. 299
- “Synthesis and electrochemical properties of partially fluorinated ether solvents for lithiumsulfur battery electrolytes” In J. Power Sources 401 Elsevier, 2018, pp. 271–277
- “Fluoroethylene Carbonate enabling a robust LiF-rich solid electrolyte interphase to enhance the stability of the MoS2 Anode for Lithium-ion storage” In Angew. Chem. Int. Ed. 130.14 Wiley Online Library, 2018, pp. 3718–3722
- “Design of fire-resistant liquid electrolyte formulation for safe and long-cycled lithium-ion batteries” In Adv. Funct. Mater 31.48 Wiley Online Library, 2021, pp. 2106102
- Z.Mu al. “BAMBOO”, 2024 URL: to%20be%20uploaded%20soon
- “Pytorch: An imperative style, high-performance deep learning library” In Advances in neural information processing systems 32, 2019
- Stefan Elfwing, Eiji Uchibe and Kenji Doya “Sigmoid-weighted linear units for neural network function approximation in reinforcement learning” In Neural networks 107 Elsevier, 2018, pp. 3–11
- Jimmy Lei Ba, Jamie Ryan Kiros and Geoffrey E Hinton “Layer normalization” In arXiv preprint arXiv:1607.06450, 2016
- “The Design Space of E(3)-Equivariant Atom-Centered Interatomic Potentials”, 2022 arXiv:2205.06643 [stat.ML]
- “Periodic Graph Transformers for Crystal Material Property Prediction”, 2022 arXiv:2209.11807 [cs.LG]
- “Polarizable Force Fields for Biomolecular Simulations: Recent Advances and Applications” In Annual Review of Biophysics 48.Volume 48, 2019 Annual Reviews, 2019, pp. 371–394 DOI: https://doi.org/10.1146/annurev-biophys-070317-033349
- “Molecular Dynamics Simulations of Ionic Liquids and Electrolytes Using Polarizable Force Fields” PMID: 31141351 In Chemical Reviews 119.13, 2019, pp. 7940–7995 DOI: 10.1021/acs.chemrev.8b00763
- Brad A. Wells and Alan L. Chaffee “Ewald Summation for Molecular Simulations” PMID: 26574452 In J. Chem. Theory Comput. 11.8, 2015, pp. 3684–3695 DOI: 10.1021/acs.jctc.5b00093
- Curt M. Breneman and Kenneth B. Wiberg “Determining atom-centered monopoles from molecular electrostatic potentials. The need for high sampling density in formamide conformational analysis” In J. Comput. Chem. 11.3, 1990, pp. 361–373 DOI: https://doi.org/10.1002/jcc.540110311
- Diederik P. Kingma and Jimmy Ba “Adam: A Method for Stochastic Optimization”, 2017 arXiv:1412.6980 [cs.LG]
- Axel D. Becke “Density‐functional thermochemistry. III. The role of exact exchange” In J. Chem. Phys. 98.7, 1993, pp. 5648–5652 DOI: 10.1063/1.464913
- “Development of new auxiliary basis functions of the Karlsruhe segmented contracted basis sets including diffuse basis functions (def2-SVPD, def2-TZVPPD, and def2-QVPPD) for RI-MP2 and RI-CC calculations” In Phys. Chem. Chem. Phys. 17 The Royal Society of Chemistry, 2015, pp. 1010–1017 DOI: 10.1039/C4CP04286G
- Florian Weigend “Hartree–Fock exchange fitting basis sets for H to Rn” In J. Comput. Chem. 29.2 Wiley Online Library, 2008, pp. 167–175
- X.Wu al. “GPU4PySCF”, 2023 URL: https://github.com/pyscf/gpu4pyscf
- Yihan Shao al. “Advances in molecular quantum chemistry contained in the Q-Chem 4 program package” In Mol. Phys. 113.2 Taylor & Francis, 2015, pp. 184–215 DOI: 10.1080/00268976.2014.952696
- “Amorphous bimetallic polysulfide for all-solid-state batteries with superior capacity and low-temperature tolerance” In Nano Energy 118, 2023, pp. 109029 DOI: https://doi.org/10.1016/j.nanoen.2023.109029
- “Commentary: The Materials Project: A materials genome approach to accelerating materials innovation” In APL Mater. 1.1, 2013, pp. 011002 DOI: 10.1063/1.4812323
- “QUANTUM ESPRESSO: a modular and open-source software project for quantum simulations of materials” In J. Phys. Condens. Matter 21.39, 2009, pp. 395502 DOI: 10.1088/0953-8984/21/39/395502
- John P. Perdew, Kieron Burke and Matthias Ernzerhof “Generalized Gradient Approximation Made Simple” In Phys. Rev. Lett. 77 American Physical Society, 1996, pp. 3865–3868 DOI: 10.1103/PhysRevLett.77.3865
- “CHAPTER XV - SCATTERING OF ELECTROMAGNETIC WAVES” In Electrodynamics of Continuous Media (Second Edition) 8, Course of Theoretical Physics Amsterdam: Pergamon, 1984, pp. 413–438 DOI: https://doi.org/10.1016/B978-0-08-030275-1.50021-7
- “Relation between fluid viscosity and compressibility” In J. Eng. Phys. 43.2, 1982, pp. 878–883 DOI: 10.1007/BF00825016
- “2 - PVT Tests and Correlations” In PVT and Phase Behaviour of Petroleum Reservoir Fluids 47, Developments in Petroleum Science Elsevier, 1998, pp. 33–104 DOI: https://doi.org/10.1016/S0376-7361(98)80024-1
- “Best Practices for Computing Transport Properties 1. Self-Diffusivity and Viscosity from Equilibrium Molecular Dynamics [Article v1.0]” In Living Journal of Computational Molecular Science 1.1, 2018, pp. 6324 DOI: 10.33011/livecoms.1.1.6324
- “MDAnalysis: a toolkit for the analysis of molecular dynamics simulations” In J. Comput. Chem. 32.10 Wiley Online Library, 2011, pp. 2319–2327
- R Väli, A Jänes and E Lust “Vinylene carbonate as co-solvent for low-temperature mixed electrolyte based Supercapacitors” In J. Electrochem. Soc. 163.6 IOP Publishing, 2016, pp. A851
- US Coast Guard “Chemical hazard response information system (CHRIS)-hazardous chemical data” In Commandant Instruction 16465, 1999
- W.M. Haynes “CRC Handbook of Chemistry and Physics”, CRC Handbook of Chemistry and Physics CRC Press, 2011
- Portal Produktowy Grupy PCC Manufacturer chemicals “PCC ROKITA Vinylene carbonate (VC)” URL: https://www.products.pcc.eu/wp-content/uploads/import/broszura/2023-05-24/e3746fad-c86b-4abf-a020-cb20e449f3c4/vinylene-carbonate-vc_broszura_en.pdf
- John A Dean “Lange’s handbook of chemistry”, 1999
- Michael S Ding and T Richard Jow “Conductivity and viscosity of PC-DEC and PC-EC solutions of LiPF6” In J. Electrochem. Soc. 150.5 IOP Publishing, 2003, pp. A620