PARCv2: Physics-aware Recurrent Convolutional Neural Networks for Spatiotemporal Dynamics Modeling (2402.12503v3)
Abstract: Modeling unsteady, fast transient, and advection-dominated physics problems is a pressing challenge for physics-aware deep learning (PADL). The physics of complex systems is governed by large systems of partial differential equations (PDEs) and ancillary constitutive models with nonlinear structures, as well as evolving state fields exhibiting sharp gradients and rapidly deforming material interfaces. Here, we investigate an inductive bias approach that is versatile and generalizable to model generic nonlinear field evolution problems. Our study focuses on the recent physics-aware recurrent convolutions (PARC), which incorporates a differentiator-integrator architecture that inductively models the spatiotemporal dynamics of generic physical systems. We extend the capabilities of PARC to simulate unsteady, transient, and advection-dominant systems. The extended model, referred to as PARCv2, is equipped with differential operators to model advection-reaction-diffusion equations, as well as a hybrid integral solver for stable, long-time predictions. PARCv2 is tested on both standard benchmark problems in fluid dynamics, namely Burgers and Navier-Stokes equations, and then applied to more complex shock-induced reaction problems in energetic materials. We evaluate the behavior of PARCv2 in comparison to other physics-informed and learning bias models and demonstrate its potential to model unsteady and advection-dominant dynamics regimes.
- Relating microstructure, temperature, and chemistry to explosive ignition and shock sensitivity. Combustion and Flame, 190:171–176, 2018. ISSN 0010-2180. doi:https://doi.org/10.1016/j.combustflame.2017.11.017. URL https://www.sciencedirect.com/science/article/pii/S001021801730456X.
- Preferred void orientation in uniaxially pressed PBX 9502. Propellants, Explosives, Pyrotechnics, 46:67–77, 2021. ISSN 0721-3115. doi:https://doi.org/10.1002/prep.202000154. URL https://doi.org/10.1002/prep.202000154.
- Effect of spatial distribution of mesoscale heterogeneities on the shock-to-detonation transition in liquid nitromethane. Combustion and Flame, 222:392–410, 2020. ISSN 0010-2180. doi:https://doi.org/10.1016/j.combustflame.2020.08.053. URL https://www.sciencedirect.com/science/article/pii/S0010218020303771.
- PARC: Physics-aware recurrent convolutional neural networks to assimilate meso scale reactive mechanics of energetic materials. Science Advances, 9(17):eadd6868, 4 2023a. doi:10.1126/sciadv.add6868.
- Physics-informed machine learning. Nature Reviews Physics, 3:422–440, 2021. ISSN 2522-5820. doi:10.1038/s42254-021-00314-5. URL https://doi.org/10.1038/s42254-021-00314-5.
- Convolutional neural networks for large-scale dynamical modeling of itinerant magnets. Phys. Rev. Res., 5:033188, Sep 2023. doi:10.1103/PhysRevResearch.5.033188. URL https://link.aps.org/doi/10.1103/PhysRevResearch.5.033188.
- Establishing structure-property localization linkages for elastic deformation of three-dimensional high contrast composites using deep learning approaches. Acta Materialia, 166:335–345, 2019. ISSN 1359-6454. doi:https://doi.org/10.1016/j.actamat.2018.12.045. URL https://www.sciencedirect.com/science/article/pii/S1359645418309960.
- Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational Physics, 378:686–707, 2019. ISSN 0021-9991. doi:https://doi.org/10.1016/j.jcp.2018.10.045. URL https://www.sciencedirect.com/science/article/pii/S0021999118307125.
- Automatic differentiation in machine learning: a survey. Journal of Machine Learning Research, 18(153):1–43, 2018. URL http://jmlr.org/papers/v18/17-468.html.
- Phycrnet: Physics-informed convolutional-recurrent network for solving spatiotemporal pdes. Computer Methods in Applied Mechanics and Engineering, 389:114399, 2022. ISSN 0045-7825. doi:https://doi.org/10.1016/j.cma.2021.114399. URL https://www.sciencedirect.com/science/article/pii/S0045782521006514.
- Physics-informed neural operator for learning partial differential equations, 2023.
- Critical investigation of failure modes in physics-informed neural networks. 12 2021. doi:10.2514/6.2022-2353.
- Characterizing possible failure modes in physics-informed neural networks. Advances in Neural Information Processing Systems, 34:26548–26560, 2021.
- When and why pinns fail to train: A neural tangent kernel perspective. Journal of Computational Physics, 449:110768, 2022. ISSN 0021-9991. doi:https://doi.org/10.1016/j.jcp.2021.110768. URL https://www.sciencedirect.com/science/article/pii/S002199912100663X.
- On the eigenvector bias of fourier feature networks: From regression to solving multi-scale pdes with physics-informed neural networks. Computer Methods in Applied Mechanics and Engineering, 384:113938, 2021. ISSN 0045-7825. doi:https://doi.org/10.1016/j.cma.2021.113938. URL https://www.sciencedirect.com/science/article/pii/S0045782521002759.
- Kolmogorov n–width and lagrangian physics-informed neural networks: A causality-conforming manifold for convection-dominated pdes. Computer Methods in Applied Mechanics and Engineering, 404:115810, 2023. ISSN 0045-7825. doi:https://doi.org/10.1016/j.cma.2022.115810. URL https://www.sciencedirect.com/science/article/pii/S0045782522007666.
- 3d steerable cnns: Learning rotationally equivariant features in volumetric data. In S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett, editors, Advances in Neural Information Processing Systems, volume 31. Curran Associates, Inc., 2018. URL https://proceedings.neurips.cc/paper_files/paper/2018/file/488e4104520c6aab692863cc1dba45af-Paper.pdf.
- E(3)-equivariant graph neural networks for data-efficient and accurate interatomic potentials. Nature Communications, 13(1), May 2022. ISSN 2041-1723. doi:10.1038/s41467-022-29939-5. URL http://dx.doi.org/10.1038/s41467-022-29939-5.
- General framework for e(3)-equivariant neural network representation of density functional theory hamiltonian. Nature Communications, 14(1), May 2023. ISSN 2041-1723. doi:10.1038/s41467-023-38468-8. URL http://dx.doi.org/10.1038/s41467-023-38468-8.
- Learning neural constitutive laws from motion observations for generalizable pde dynamics. In International Conference on Machine Learning. PMLR, 2023.
- A physics-aware deep learning model for energy localization in multiscale shock-to-detonation simulations of heterogeneous energetic materials. Propellants, Explosives, Pyrotechnics, 48(4):e202200268, 3 2023b. doi:10.1002/prep.202200268.
- Deep euler method: solving odes by approximating the local truncation error of the euler method, 2020.
- Hypersolvers: Toward fast continuous-depth models. In H. Larochelle, M. Ranzato, R. Hadsell, M.F. Balcan, and H. Lin, editors, Advances in Neural Information Processing Systems, volume 33, pages 21105–21117. Curran Associates, Inc., 2020. URL https://proceedings.neurips.cc/paper_files/paper/2020/file/f1686b4badcf28d33ed632036c7ab0b8-Paper.pdf.
- Fourier neural operator for parametric partial differential equations. In International Conference on Learning Representations, 2021. URL https://openreview.net/forum?id=c8P9NQVtmnO.
- Convolutional lstm network: a machine learning approach for precipitation nowcasting. In Proceedings of the 28th International Conference on Neural Information Processing Systems - Volume 1, NIPS’15, page 802–810, Cambridge, MA, USA, 2015. MIT Press.
- Multi-scale modeling of shock initiation of a pressed energetic material I: The effect of void shapes on energy localization. Journal of Applied Physics, 131(5):055906, 02 2022. ISSN 0021-8979. doi:10.1063/5.0068715. URL https://doi.org/10.1063/5.0068715.
- Meso-scale simulation of energetic materials. II. Establishing structure–property linkages using synthetic microstructures. Journal of Applied Physics, 131(5):055905, 02 2022. ISSN 0021-8979. doi:10.1063/5.0065298. URL https://doi.org/10.1063/5.0065298.
- Mesoscale simulation of reactive pressed energetic materials under shock loading. Journal of Applied Physics, 118:245905, 2015. ISSN 0021-8979. doi:10.1063/1.4938581. URL https://doi.org/10.1063/1.4938581.
- High-resolution simulations of cylindrical void collapse in energetic materials: Effect of primary and secondary collapse on initiation thresholds. Physical Review Fluids, 2, 2017. ISSN 2469990X. doi:10.1103/PhysRevFluids.2.043202.
- Three-dimensional simulations of void collapse in energetic materials. Physical Review Fluids, 3:33201, 2018. doi:10.1103/PhysRevFluids.3.033201. URL https://link.aps.org/doi/10.1103/PhysRevFluids.3.033201.
- Fourier neural operator for parametric partial differential equations. arXiv preprint arXiv:2010.08895, 2020.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Collections
Sign up for free to add this paper to one or more collections.