FO-PINNs: A First-Order formulation for Physics Informed Neural Networks (2210.14320v2)
Abstract: Physics-Informed Neural Networks (PINNs) are a class of deep learning neural networks that learn the response of a physical system without any simulation data, and only by incorporating the governing partial differential equations (PDEs) in their loss function. While PINNs are successfully used for solving forward and inverse problems, their accuracy decreases significantly for parameterized systems. PINNs also have a soft implementation of boundary conditions resulting in boundary conditions not being exactly imposed everywhere on the boundary. With these challenges at hand, we present first-order physics-informed neural networks (FO-PINNs). These are PINNs that are trained using a first-order formulation of the PDE loss function. We show that, compared to standard PINNs, FO-PINNs offer significantly higher accuracy in solving parameterized systems, and reduce time-per-iteration by removing the extra backpropagations needed to compute the second or higher-order derivatives. Additionally, FO-PINNs can enable exact imposition of boundary conditions using approximate distance functions, which pose challenges when applied on high-order PDEs. Through three examples, we demonstrate the advantages of FO-PINNs over standard PINNs in terms of accuracy and training speedup.
- “Automatic differentiation in machine learning: a survey” In Journal of Marchine Learning Research 18 Microtome Publishing, 2018, pp. 1–43
- “Approximate distance fields with non-vanishing gradients” In Graphical Models 66.3 Elsevier, 2004, pp. 133–159
- “Physics-informed neural networks (PINNs) for fluid mechanics: A review” In Acta Mechanica Sinica Springer, 2022, pp. 1–12
- “Physics-informed neural networks for inverse problems in nano-optics and metamaterials” In Optics express 28.8 Optical Society of America, 2020, pp. 11618–11633
- “Scientific machine learning through physics–informed neural networks: Where we are and what’s next” In Journal of Scientific Computing 92.3 Springer, 2022, pp. 88
- “Multiscale meshgraphnets” In arXiv preprint arXiv:2210.00612, 2022
- Stefania Fresca, Luca Dede and Andrea Manzoni “A comprehensive deep learning-based approach to reduced order modeling of nonlinear time-dependent parametrized PDEs” In Journal of Scientific Computing 87.2 Springer, 2021, pp. 1–36
- Han Gao, Luning Sun and Jian-Xun Wang “PhyGeoNet: Physics-informed geometry-adaptive convolutional neural networks for solving parameterized steady-state PDEs on irregular domain” In Journal of Computational Physics 428 Elsevier, 2021, pp. 110079
- Han Gao, Matthew J. Zahr and Jian-Xun Wang “Physics-informed graph neural Galerkin networks: A unified framework for solving PDE-governed forward and inverse problems” In Computer Methods in Applied Mechanics and Engineering 390, 2022, pp. 114502 DOI: https://doi.org/10.1016/j.cma.2021.114502
- “Modeling the dynamics of PDE systems with physics-constrained deep auto-regressive networks” In Journal of Computational Physics 403 Elsevier, 2020, pp. 109056
- “GNN-based physics solver for time-independent PDEs” In arXiv preprint arXiv:2303.15681, 2023
- “NVIDIA SimNet™: An AI-accelerated multi-physics simulation framework” In International Conference on Computational Science, 2021, pp. 447–461 Springer
- “Surrogate modeling of parameterized multi-dimensional premixed combustion with physics-informed neural networks for rapid exploration of design space” In Combustion and Flame 258 Elsevier, 2023, pp. 113094
- Zichao Long, Yiping Lu and Bin Dong “PDE-Net 2.0: Learning PDEs from data with a numeric-symbolic hybrid deep network” In Journal of Computational Physics 399 Elsevier, 2019, pp. 108925
- Qin Lou, Xuhui Meng and George Em Karniadakis “Physics-informed neural networks for solving forward and inverse flow problems via the Boltzmann-BGK formulation” In Journal of Computational Physics 447, 2021, pp. 110676 DOI: https://doi.org/10.1016/j.jcp.2021.110676
- Khang A Luong, Thang Le-Duc and Jaehong Lee “Deep reduced-order least-square method—A parallel neural network structure for solving beam problems” In Thin-Walled Structures 191 Elsevier, 2023, pp. 111044
- “A novel sequential method to train physics informed neural networks for Allen Cahn and Cahn Hilliard equations” In Computer Methods in Applied Mechanics and Engineering 390 Elsevier, 2022, pp. 114474
- “Mixed precision training” In arXiv preprint arXiv:1710.03740, 2017
- Mohammad Amin Nabian, Rini Jasmine Gladstone and Hadi Meidani “Efficient training of physics-informed neural networks via importance sampling” In Computer-Aided Civil and Infrastructure Engineering 36.8, 2021, pp. 962–977 DOI: https://doi.org/10.1111/mice.12685
- “Learning mesh-based simulation with graph networks” In arXiv preprint arXiv:2010.03409, 2020
- Maziar Raissi, Paris Perdikaris and George E Karniadakis “Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations” In Journal of Computational physics 378 Elsevier, 2019, pp. 686–707
- “Deep neural networks motivated by partial differential equations” In Journal of Mathematical Imaging and Vision 62.3 Springer, 2020, pp. 352–364
- “Exact imposition of boundary conditions with distance functions in physics-informed deep neural networks” In Computer Methods in Applied Mechanics and Engineering 389, 2022, pp. 114333 DOI: https://doi.org/10.1016/j.cma.2021.114333
- “Physics-based Deep Learning” WWW, 2021 URL: https://physicsbaseddeeplearning.org
- Liu Yang, Xuhui Meng and George Em Karniadakis “B-PINNs: Bayesian physics-informed neural networks for forward and inverse PDE problems with noisy data” In Journal of Computational Physics 425 Elsevier, 2021, pp. 109913
- Rini J. Gladstone (1 paper)
- Mohammad A. Nabian (1 paper)
- N. Sukumar (25 papers)
- Ankit Srivastava (40 papers)
- Hadi Meidani (31 papers)