Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
139 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

FastVPINNs: Tensor-Driven Acceleration of VPINNs for Complex Geometries (2404.12063v1)

Published 18 Apr 2024 in cs.LG, cs.CE, cs.NA, cs.NE, and math.NA

Abstract: Variational Physics-Informed Neural Networks (VPINNs) utilize a variational loss function to solve partial differential equations, mirroring Finite Element Analysis techniques. Traditional hp-VPINNs, while effective for high-frequency problems, are computationally intensive and scale poorly with increasing element counts, limiting their use in complex geometries. This work introduces FastVPINNs, a tensor-based advancement that significantly reduces computational overhead and improves scalability. Using optimized tensor operations, FastVPINNs achieve a 100-fold reduction in the median training time per epoch compared to traditional hp-VPINNs. With proper choice of hyperparameters, FastVPINNs surpass conventional PINNs in both speed and accuracy, especially in problems with high-frequency solutions. Demonstrated effectiveness in solving inverse problems on complex domains underscores FastVPINNs' potential for widespread application in scientific and engineering challenges, opening new avenues for practical implementations in scientific machine learning.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (31)
  1. TensorFlow: Large-scale machine learning on heterogeneous systems, 2015. URL https://www.tensorflow.org/. Software available from tensorflow.org.
  2. Meshless physics-informed deep learning method for three-dimensional solid mechanics. International Journal for Numerical Methods in Engineering, 122(23):7182–7201, 2021.
  3. Workshop report on basic research needs for scientific machine learning: Core technologies for artificial intelligence. 2 2019. doi: 10.2172/1478744. URL https://www.osti.gov/biblio/1478744.
  4. deal. II—a general-purpose object-oriented finite element library. ACM Transactions on Mathematical Software (TOMS), 33(4):24–es, 2007.
  5. Physics-informed neural networks (PINNs) for fluid mechanics: A review. Acta Mechanica Sinica, 37(12):1727–1738, 2021.
  6. Towards understanding the spectral bias of deep learning, 2020.
  7. Scientific machine learning through physics–informed neural networks: Where we are and what’s next. Journal of Scientific Computing, 92(3):88, 2022.
  8. Physics-informed neural networks for solving Reynolds-averaged Navier–Stokes equations. Physics of Fluids, 34(7), 2022.
  9. S. Ganesan and M. Shah. SParSH-AMG: A library for hybrid CPU-GPU algebraic multigrid and preconditioned iterative methods. arXiv preprint arXiv:2007.00056, 2020.
  10. S. Ganesan and L. Tobiska. Finite elements: Theory and algorithms. Cambridge University Press, 2017.
  11. C. Geuzaine and J.-F. Remacle. Gmsh: A 3–D finite element mesh generator with built-in pre- and post-processing facilities. International Journal for Numerical Methods in Engineering, 79(11):1309–1331, 2009. doi: https://doi.org/10.1002/nme.2579. URL https://onlinelibrary.wiley.com/doi/abs/10.1002/nme.2579.
  12. A physics-informed deep learning framework for inversion and surrogate modeling in solid mechanics. Computer Methods in Applied Mechanics and Engineering, 379:113741, 2021.
  13. E. Kharazmi. hp-VPINNs: High-performance variational physics-informed neural networks, 2023. URL https://github.com/ehsankharazmi/hp-VPINNs. Accessed: 2023-12-01.
  14. Variational physics-informed neural networks for solving partial differential equations. arXiv preprint arXiv:1912.00873, 2019.
  15. hp-VPINNs: Variational physics-informed neural networks with domain decomposition. Computer Methods in Applied Mechanics and Engineering, 374:113547, 2021.
  16. R. Khodayi-Mehr and M. Zavlanos. Varnet: Variational neural networks for the solution of partial differential equations. In Learning for Dynamics and Control, pages 298–307. PMLR, 2020.
  17. D. P. Kingma and J. Ba. Adam: A method for stochastic optimization. CoRR, abs/1412.6980, 2014. URL https://api.semanticscholar.org/CorpusID:6628106.
  18. Artificial neural networks for solving ordinary and partial differential equations. IEEE Transactions on Neural Networks, 9(5):987–1000, 1998. doi: 10.1109/72.712178.
  19. C. Liu and H. Wu. cv-PINN: Efficient learning of variational physics-informed neural network with domain decomposition. Extreme Mechanics Letters, 63:102051, 2023. ISSN 2352-4316. doi: https://doi.org/10.1016/j.eml.2023.102051. URL https://www.sciencedirect.com/science/article/pii/S2352431623000974.
  20. DeepXDE: A deep learning library for solving differential equations. SIAM review, 63(1):208–228, 2021a.
  21. Physics-informed neural networks with hard constraints for inverse design. SIAM Journal on Scientific Computing, 43(6):B1105–B1132, 2021b.
  22. Physics-informed neural networks for high-speed flows. Computer Methods in Applied Mechanics and Engineering, 360:112789, 2020.
  23. NVIDIA. NVIDIA Modulus Documentation. https://docs.nvidia.com/deeplearning/modulus/modulus-sym/index.html, 2023. Accessed: 2023-03-10.
  24. NVIDIA Modulus. https://developer.nvidia.com/modulus. Last accessed Jan 01, 2024.
  25. Uncertainty quantification in scientific machine learning: Methods, metrics, and comparisons. Journal of Computational Physics, 477:111902, 2023.
  26. Effects of variational formulations on physics-informed neural network performance in solid mechanics. PAMM, page e202300222, 2023.
  27. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational physics, 378:686–707, 2019.
  28. HypoSVI: Hypocentre inversion with Stein variational inference and physics informed neural networks. Geophysical Journal International, 228(1):698–710, 08 2021. ISSN 0956-540X. doi: 10.1093/gji/ggab309. URL https://doi.org/10.1093/gji/ggab309.
  29. ParMooN—a modernized program package based on mapped finite elements. Computers & Mathematics with Applications, 74(1):74–88, 2017.
  30. M. Yang and J. T. Foster. hp-Variational Physics-Informed Neural Networks for Nonlinear Two-Phase Transport in Porous Media. Journal of Machine Learning for Modeling and Computing, 2(2), 2021.
  31. Analyses of internal structures and defects in materials using physics-informed neural networks. Science advances, 8(7):eabk0644, 2022.
Citations (3)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now