Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
119 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

FO-PINNs: A First-Order formulation for Physics Informed Neural Networks (2210.14320v2)

Published 25 Oct 2022 in cs.LG, cs.NA, and math.NA

Abstract: Physics-Informed Neural Networks (PINNs) are a class of deep learning neural networks that learn the response of a physical system without any simulation data, and only by incorporating the governing partial differential equations (PDEs) in their loss function. While PINNs are successfully used for solving forward and inverse problems, their accuracy decreases significantly for parameterized systems. PINNs also have a soft implementation of boundary conditions resulting in boundary conditions not being exactly imposed everywhere on the boundary. With these challenges at hand, we present first-order physics-informed neural networks (FO-PINNs). These are PINNs that are trained using a first-order formulation of the PDE loss function. We show that, compared to standard PINNs, FO-PINNs offer significantly higher accuracy in solving parameterized systems, and reduce time-per-iteration by removing the extra backpropagations needed to compute the second or higher-order derivatives. Additionally, FO-PINNs can enable exact imposition of boundary conditions using approximate distance functions, which pose challenges when applied on high-order PDEs. Through three examples, we demonstrate the advantages of FO-PINNs over standard PINNs in terms of accuracy and training speedup.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (25)
  1. “Automatic differentiation in machine learning: a survey” In Journal of Marchine Learning Research 18 Microtome Publishing, 2018, pp. 1–43
  2. “Approximate distance fields with non-vanishing gradients” In Graphical Models 66.3 Elsevier, 2004, pp. 133–159
  3. “Physics-informed neural networks (PINNs) for fluid mechanics: A review” In Acta Mechanica Sinica Springer, 2022, pp. 1–12
  4. “Physics-informed neural networks for inverse problems in nano-optics and metamaterials” In Optics express 28.8 Optical Society of America, 2020, pp. 11618–11633
  5. “Scientific machine learning through physics–informed neural networks: Where we are and what’s next” In Journal of Scientific Computing 92.3 Springer, 2022, pp. 88
  6. “Multiscale meshgraphnets” In arXiv preprint arXiv:2210.00612, 2022
  7. Stefania Fresca, Luca Dede and Andrea Manzoni “A comprehensive deep learning-based approach to reduced order modeling of nonlinear time-dependent parametrized PDEs” In Journal of Scientific Computing 87.2 Springer, 2021, pp. 1–36
  8. Han Gao, Luning Sun and Jian-Xun Wang “PhyGeoNet: Physics-informed geometry-adaptive convolutional neural networks for solving parameterized steady-state PDEs on irregular domain” In Journal of Computational Physics 428 Elsevier, 2021, pp. 110079
  9. Han Gao, Matthew J. Zahr and Jian-Xun Wang “Physics-informed graph neural Galerkin networks: A unified framework for solving PDE-governed forward and inverse problems” In Computer Methods in Applied Mechanics and Engineering 390, 2022, pp. 114502 DOI: https://doi.org/10.1016/j.cma.2021.114502
  10. “Modeling the dynamics of PDE systems with physics-constrained deep auto-regressive networks” In Journal of Computational Physics 403 Elsevier, 2020, pp. 109056
  11. “GNN-based physics solver for time-independent PDEs” In arXiv preprint arXiv:2303.15681, 2023
  12. “NVIDIA SimNet™: An AI-accelerated multi-physics simulation framework” In International Conference on Computational Science, 2021, pp. 447–461 Springer
  13. “Surrogate modeling of parameterized multi-dimensional premixed combustion with physics-informed neural networks for rapid exploration of design space” In Combustion and Flame 258 Elsevier, 2023, pp. 113094
  14. Zichao Long, Yiping Lu and Bin Dong “PDE-Net 2.0: Learning PDEs from data with a numeric-symbolic hybrid deep network” In Journal of Computational Physics 399 Elsevier, 2019, pp. 108925
  15. Qin Lou, Xuhui Meng and George Em Karniadakis “Physics-informed neural networks for solving forward and inverse flow problems via the Boltzmann-BGK formulation” In Journal of Computational Physics 447, 2021, pp. 110676 DOI: https://doi.org/10.1016/j.jcp.2021.110676
  16. Khang A Luong, Thang Le-Duc and Jaehong Lee “Deep reduced-order least-square method—A parallel neural network structure for solving beam problems” In Thin-Walled Structures 191 Elsevier, 2023, pp. 111044
  17. “A novel sequential method to train physics informed neural networks for Allen Cahn and Cahn Hilliard equations” In Computer Methods in Applied Mechanics and Engineering 390 Elsevier, 2022, pp. 114474
  18. “Mixed precision training” In arXiv preprint arXiv:1710.03740, 2017
  19. Mohammad Amin Nabian, Rini Jasmine Gladstone and Hadi Meidani “Efficient training of physics-informed neural networks via importance sampling” In Computer-Aided Civil and Infrastructure Engineering 36.8, 2021, pp. 962–977 DOI: https://doi.org/10.1111/mice.12685
  20. “Learning mesh-based simulation with graph networks” In arXiv preprint arXiv:2010.03409, 2020
  21. Maziar Raissi, Paris Perdikaris and George E Karniadakis “Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations” In Journal of Computational physics 378 Elsevier, 2019, pp. 686–707
  22. “Deep neural networks motivated by partial differential equations” In Journal of Mathematical Imaging and Vision 62.3 Springer, 2020, pp. 352–364
  23. “Exact imposition of boundary conditions with distance functions in physics-informed deep neural networks” In Computer Methods in Applied Mechanics and Engineering 389, 2022, pp. 114333 DOI: https://doi.org/10.1016/j.cma.2021.114333
  24. “Physics-based Deep Learning” WWW, 2021 URL: https://physicsbaseddeeplearning.org
  25. Liu Yang, Xuhui Meng and George Em Karniadakis “B-PINNs: Bayesian physics-informed neural networks for forward and inverse PDE problems with noisy data” In Journal of Computational Physics 425 Elsevier, 2021, pp. 109913
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (5)
  1. Rini J. Gladstone (1 paper)
  2. Mohammad A. Nabian (1 paper)
  3. N. Sukumar (25 papers)
  4. Ankit Srivastava (40 papers)
  5. Hadi Meidani (31 papers)

Summary

We haven't generated a summary for this paper yet.