Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
129 tokens/sec
GPT-4o
28 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Collocation-based Robust Variational Physics-Informed Neural Networks (CRVPINN) (2401.02300v3)

Published 4 Jan 2024 in cs.LG, cs.NA, and math.NA

Abstract: Physics-Informed Neural Networks (PINNs) have been successfully applied to solve Partial Differential Equations (PDEs). Their loss function is founded on a strong residual minimization scheme. Variational Physics-Informed Neural Networks (VPINNs) are their natural extension to weak variational settings. In this context, the recent work of Robust Variational Physics-Informed Neural Networks (RVPINNs) highlights the importance of conveniently translating the norms of the underlying continuum-level spaces to the discrete level. Otherwise, VPINNs might become unrobust, implying that residual minimization might be highly uncorrelated with a desired minimization of the error in the energy norm. However, applying this robustness to VPINNs typically entails dealing with the inverse of a Gram matrix, usually producing slow convergence speeds during training. In this work, we accelerate the implementation of RVPINN, establishing a LU factorization of sparse Gram matrix in a kind of point-collocation scheme with the same spirit as original PINNs. We call out method the Collocation-based Robust Variational Physics Informed Neural Networks (CRVPINN). We test our efficient CRVPINN algorithm on Laplace, advection-diffusion, and Stokes problems in two spatial dimensions.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (44)
  1. Integrating machine learning and multiscale modeling-perspectives, challenges, and opportunities in the biologica biomedical, and behavioral sciences. NPJ Digital Medicine, 2, 2019.
  2. Finite element interpolated neural networks for solving forward and inverse problems. Computer Methods in Applied Mechanics and Engineering, 418(A), 2024.
  3. Physics-informed neural networks (PINNs) for fluid mechanics: A review. Acta Mechanica Sinica, 37(12):1727–1738, 2021.
  4. Isogeometric residual minimization method (igrm) with direction splitting preconditioner for stationary advection-dominated diffusion problems. Computer Methods in Applied Mechanics and Engineering, 373:113214, 2021.
  5. A robust DPG method for convection-dominated diffusion problems II: Adjoint boundary conditions and mesh-dependent test norms. Computers & Mathematics with Applications, 67(4):771–795, 2014.
  6. Asymptotic optimality of the edge finite element approximation of the time-harmonic Maxwell’s equations. hal-04216433, September 2023.
  7. Physics-informed neural networks for inverse problems in nano-optics and metamaterials. Optics express, 28(8):11618–11633, 2020.
  8. Studies of refinement and continuity in isogeometric structural analysis. Computer Methods in Applied Mechanics and Engineering, 196(41):4160–4183, 2007.
  9. Adaptive finite element methods for parabolic problems i: A linear model problem. SIAM J. Num. Anal., 28(1):43–77, 1991.
  10. Hao Sun Fangzheng Sun, Yang Liu2. Physics-informed spline learning for nonlinear dynamics discovery. Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence (IJCAI-21), pages 2054–2061, 2021.
  11. Space–time least-squares finite elements for parabolic equations. Computers & Mathematics with Applications, 92:27–36, 2021.
  12. Modeling the dynamics of pde systems with physics-constrained deep auto-regressive networks. Journal of Computational Physics, 403, 2020.
  13. A survey on deep learning in big data. In 2017 IEEE international conference on computational science and engineering (CSE) and IEEE international conference on embedded and ubiquitous computing (EUC), volume 2, pages 173–180. IEEE, 2017.
  14. Accurate, efficient, and (iso)geometrically flexible collocation methods for phase-field models. Journal of Computational Physics, 262:153–171, 2014.
  15. Transfer learning enhanced physics informed neural network for phase-field modeling of fracture. Theoretical and applied fracture machanics, 106, 2020.
  16. A new class of massively parallel direction splitting for the incompressible navier–stokes equations. Computer Methods in Applied Mechanics and Engineering, 200(23):2083–2093, 2011.
  17. Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups. IEEE Signal processing magazine, 29(6):82–97, 2012.
  18. Variational onsager neural networks (vonns): A thermodynamics-based variational learning strategy for non-equilibrium pdes. Journal of the mechanics and physics of solids, 163, 2022.
  19. A universal pinns method for solving partial differential equations with a point source. Proceedings of the Fourteen International Joint Conference on Artificial Intelligence (IJCAI-22), pages 3839–3846, 2022.
  20. Adaptive activation functions accelerate convergence in deep and physics-informed neural networks. Journal of Computational Physics, 404, 2020.
  21. Physics-informed neural networks for quantum eigenvalue problems. In 2022 International Joint Conference on Neural Networks (IJCNN), pages 1–8, 2022.
  22. Variational physics-informed neural networks for solving partial differential equations. arXiv preprint arXiv:1912.00873, 2019.
  23. hp-VPINNs: Variational physics-informed neural networks with domain decomposition. Computer Methods in Applied Mechanics and Engineering, 374:113547, 2021.
  24. Dpm: A novel training method for physics-informed neural networks in extrapolation. Proceedings of the AAAI Conference on Artificial Intelligence, 35(9):8146–8154, 2021.
  25. Physics-informed neural networks for learning fluid flows with symmetry. Korean Journal of Chemical Engineering, 40(9):2119–2127, SEP 2023.
  26. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
  27. Machine learning in cardiovascular flows modeling: Predicting arterial blood pressure from non-invasive 4d flow mri data using physics-informed neural networks. Computer Methods in Applied Mechanics and Engineering, 358, 2020.
  28. Imagenet classification with deep convolutional neural networks. Communications of the ACM, 60(6):84–90, 2017.
  29. Reynolds averaged turbulence modelling using deep neural networks with embedded invariance. Journal of Fuild Mechanics, 807:155–166, 2016.
  30. A variational formulation of physics-informed neural network for the applications of homogeneous and heterogeneous material properties identification. International Journal of Applied Mechanics, 15(08), 2023.
  31. cv-pinn: Efficient learning of variational physics-informed neural network with domain decomposition. Extreme Mechanics Letter, 63, 2023.
  32. Physics-informed neural networks with hard constraints for inverse design. SIAM Journal on Scientific Computing, 43(6):B1105–B1132, 2021.
  33. Influence of activation functions on the convergence of physics-informed neural networks for 1d wave equation. In Jiří Mikyška, Clélia de Mulatier, Maciej Paszynski, Valeria V. Krzhizhanovskaya, Jack J. Dongarra, and Peter M.A. Sloot, editors, Computational Science – ICCS 2023, pages 74–88, Cham, 2023. Springer Nature Switzerland.
  34. Physics-informed neural networks for high-speed flows. Computer Methods in Applied Mechanics and Engineering, 360:112789, 2020.
  35. Estimates on the generalization error of physics-informed neural networks for approximating a class of inverse problems for PDEs. IMA Journal of Numerical Analysis, 42(2):981–1022, 2022.
  36. Physics-informed neural networks for minimising worst-case violations in dc optimal power flow. In 2021 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm), pages 419–424, 2021.
  37. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational physics, 378:686–707, 2019.
  38. Physics-informed neural networks (pinns) for wave propagation and full waveform inversions. Journal of Geophysical Research: Solid Earth, 127(5):e2021JB023120, 2022.
  39. Robust variational physics-informed neural networks. arXiv preprine: arXiv:2308.16910, 2023.
  40. Inf-sup conditions for finite-difference approximations of the stokes equations. The Journal of the Australian Mathematical Society. Series B. Applied Mathematics, 39(1):121–134, 1997.
  41. Surrogate modeling for fluid flows based on physics-constrained deep learning without simulation data. Computer Methods in Applied Mechanics and Engineering, 361, 2020.
  42. Surrogate modeling for fluid flows based on physics-constrained deep learning without simulation data. Computer Methods in Applied Mechanics and Engineering, 361:112732, 2020.
  43. Spline-pinn: Approaching pdes without data using fast, physics-informed hermite-spline cnns. Proceedings of the AAAI Conference on Artificial Intelligence, 36(8):8529–8538, 2022.
  44. Adversarial uncertainty quantification in physics-informed neural networks. Journal of Computational Physics, 394:136–152, 2019.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now