Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
153 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Integration of physics-informed operator learning and finite element method for parametric learning of partial differential equations (2401.02363v1)

Published 4 Jan 2024 in cs.LG and cs.CE

Abstract: We present a method that employs physics-informed deep learning techniques for parametrically solving partial differential equations. The focus is on the steady-state heat equations within heterogeneous solids exhibiting significant phase contrast. Similar equations manifest in diverse applications like chemical diffusion, electrostatics, and Darcy flow. The neural network aims to establish the link between the complex thermal conductivity profiles and temperature distributions, as well as heat flux components within the microstructure, under fixed boundary conditions. A distinctive aspect is our independence from classical solvers like finite element methods for data. A noteworthy contribution lies in our novel approach to defining the loss function, based on the discretized weak form of the governing equation. This not only reduces the required order of derivatives but also eliminates the need for automatic differentiation in the construction of loss terms, accepting potential numerical errors from the chosen discretization method. As a result, the loss function in this work is an algebraic equation that significantly enhances training efficiency. We benchmark our methodology against the standard finite element method, demonstrating accurate yet faster predictions using the trained neural network for temperature and flux profiles. We also show higher accuracy by using the proposed method compared to purely data-driven approaches for unforeseen scenarios.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (61)
  1. Tobias Weinzierl. The Pillars of Science, pages 3–9. Springer International Publishing, Cham, 2021.
  2. The concept of digital twin and digital shadow in manufacturing. Procedia CIRP, 101:81–84, 2021. 9th CIRP Conference on High Performance Cutting.
  3. Physics-guided, physics-informed, and physics-encoded neural networks in scientific computing, 2022.
  4. Eighty years of the finite element method: Birth, evolution, and future. Archives of Computational Methods in Engineering, 2022.
  5. A thermo-mechanical phase-field fracture model: Application to hot cracking simulations in additive manufacturing. Journal of the Mechanics and Physics of Solids, 172:105169, 2023.
  6. A cohesive phase-field fracture model for chemo-mechanical environments: Studies on degradation in battery materials. Theoretical and Applied Fracture Mechanics, 124:103758, 2023.
  7. Machine Learning in Computer Aided Engineering, pages 1–83. Springer International Publishing, Cham, 2023.
  8. Application of artificial neural networks for the prediction of interface mechanics: a study on grain boundary constitutive behavior. Advanced Modeling and Simulation in Engineering Sciences, 7:1–27, 2020.
  9. Multiscale modeling meets machine learning: What can we learn? Archives of Computational Methods in Engineering, 28:1017–1037, 2021.
  10. Lossless multi-scale constitutive elastic relations with artificial intelligence. npj Computational Materials, 8:1–12, 2022.
  11. A mixed formulation for physics-informed neural networks as a potential solver for engineering problems in heterogeneous domains: Comparison with finite element method. Computer Methods in Applied Mechanics and Engineering, 401:115616, 2022.
  12. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational Physics, 378:686–707, 2019.
  13. Theory-training deep neural networks for an alloy solidification benchmark problem. Computational Materials Science, 180:109687, 2020.
  14. Dgm: A deep learning algorithm for solving partial differential equations. Journal of Computational Physics, 375:1339–1364, 2018.
  15. Stefano Markidis. The old and the new: Can physics-informed deep-learning replace traditional linear solvers? Frontiers in Big Data, 4, 2021.
  16. Conservative physics-informed neural networks on discrete domains for conservation laws: Applications to forward and inverse problems. Computer Methods in Applied Mechanics and Engineering, 365:113028, 2020.
  17. Extended physics-informed neural networks (xpinns): A generalized space-time domain decomposition based deep learning framework for nonlinear partial differential equations. Communications in Computational Physics, 28(5):2002–2041, 2020.
  18. Finite basis physics-informed neural networks (fbpinns): a scalable domain decomposition approach for solving differential equations. Advances in Computational Mathematics, 2023.
  19. A physics-informed deep learning framework for inversion and surrogate modeling in solid mechanics. Computer Methods in Applied Mechanics and Engineering, 379:113741, 2021.
  20. On the eigenvector bias of fourier feature networks: From regression to solving multi-scale pdes with physics-informed neural networks. Computer Methods in Applied Mechanics and Engineering, 384:113938, 2021a.
  21. Self-adaptive physics-informed neural networks using a soft attention mechanism. arXiv preprint arXiv:2009.04544, 2020.
  22. The deep ritz method: A deep learning-based numerical algorithm for solving variational problems. Communications in Mathematics and Statistics, 6, 2018.
  23. An energy approach to the solution of partial differential equations in computational mechanics via machine learning: Concepts, implementation and applications. Computer Methods in Applied Mechanics and Engineering, 362:112790, 2020.
  24. The mixed deep energy method for resolving concentration features in finite strain hyperelasticity. Journal of Computational Physics, 451:110839, 2022.
  25. A comprehensive survey on transfer learning. Proceedings of the IEEE, 109:43–76, 2021.
  26. Transfer learning enhanced physics informed neural network for phase-field modeling of fracture. Theoretical and Applied Fracture Mechanics, 106:102447, 2020.
  27. Transfer learning based physics-informed neural networks for solving inverse problems in engineering structures under different loading scenarios. Computer Methods in Applied Mechanics and Engineering, 405:115852, 2023.
  28. Mixed formulation of physics-informed neural networks for thermo-mechanically coupled systems and heterogeneous domains. International Journal for Numerical Methods in Engineering, n/a(n/a):e7388.
  29. earning nonlinear operators via deeponet based on the universal approximation theorem of operators. Nature Machine Intelligence, 2021.
  30. Fourier neural operator for parametric partial differential equations, 2021.
  31. Physics-guided, physics-informed, and physics-encoded neural networks in scientific computing, 2023a.
  32. Comparison of neural fem and neural operator methods for applications in solid mechanics, 2023.
  33. Learning the solution operator of parametric partial differential equations with physics-informed deeponets. Science Advances, 7(40):eabi8605, 2021b.
  34. Data-driven and physics-informed deep learning operators for solution of heat conduction equation with parametric heat source. International Journal of Heat and Mass Transfer, 203:123809, 2023.
  35. Physics-constrained deep learning for high-dimensional surrogate modeling and uncertainty quantification without labeled data. Journal of Computational Physics, 394:56–81, 2019.
  36. Phygeonet: Physics-informed geometry-adaptive convolutional neural networks for solving parameterized steady-state pdes on irregular domain. Journal of Computational Physics, 428:110079, 2021.
  37. Physics-informed deep learning for digital materials. Theoretical and Applied Mechanics Letters, 11(1):100220, 2021.
  38. Phase-field deeponet: Physics-informed deep operator neural network for fast simulations of pattern formation governed by gradient flows of free-energy functionals. Computer Methods in Applied Mechanics and Engineering, 416:116299, 2023a.
  39. Learning in latent spaces improves the predictive accuracy of deep neural operators, 2023.
  40. Label-free learning of elliptic partial differential equation solvers with generalizability across boundary value problems. Computer Methods in Applied Mechanics and Engineering, 417:116214, 2023.
  41. Deep convolutional ritz method: parametric pde surrogates without labeled data. Applied Mathematics and Mechanics, 44(7):1151–1174, 2023.
  42. Phycrnet: Physics-informed convolutional-recurrent network for solving spatiotemporal pdes. Computer Methods in Applied Mechanics and Engineering, 389:114399, 2022.
  43. Physics-informed convolutional neural networks for temperature field prediction of heat source layout without labeled data. Engineering Applications of Artificial Intelligence, 117:105516, 2023.
  44. A physics-informed convolutional neural network for the simulation and prediction of two-phase darcy flows in heterogeneous porous media. Journal of Computational Physics, 477:111919, 2023.
  45. Learning physical models that can respect conservation laws. Physica D: Nonlinear Phenomena, 457:133952, January 2024.
  46. Solving the discretised neutron diffusion equations using neural networks. International Journal for Numerical Methods in Engineering, 124(21):4659–4686, 2023.
  47. A comprehensive and fair comparison of two neural operators (with practical extensions) based on fair data. Computer Methods in Applied Mechanics and Engineering, 393:114778, 2022.
  48. Revealing the predictive power of neural operators for strain evolution in digital composites. Journal of the Mechanics and Physics of Solids, 181:105444, 2023.
  49. Analysis of three-dimensional potential problems in non-homogeneous media with physics-informed deep collocation method using material transfer learning and sensitivity analysis. Engineering with Computers, 2022.
  50. A consistent framework for chemo-mechanical cohesive fracture and its application in solid-state batteries. Journal of the Mechanics and Physics of Solids, 157:104612, 2021.
  51. Physics-informed neural operator for learning partial differential equations, 2023b.
  52. Nonlocal kernel network (nkn): A stable and resolution-independent deep neural network. Journal of Computational Physics, 469:111536, 2022.
  53. Physics-Informed Deep Neural Operator Networks, pages 219–254. Springer International Publishing, Cham, 2023.
  54. Klaus-Jurgen Bathe. Finite Element Procedures. Prentice Hall, Englewood Cliffs, NJ, 1st edition, 1996.
  55. Thomas J. R. Hughes. The Finite Element Method: Linear Static and Dynamic Finite Element Analysis. Prentice Hall, Englewood Cliffs, NJ, 1st edition, 1987.
  56. Jürgen Schmidhuber. Deep learning in neural networks: An overview. Neural Networks, 61:85–117, 2015.
  57. Sciann: A keras/tensorflow wrapper for scientific computations and physics-informed deep learning using artificial neural networks. Computer Methods in Applied Mechanics and Engineering, 373:113552, 2021.
  58. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
  59. When and why pinns fail to train: A neural tangent kernel perspective. Journal of Computational Physics, 449:110768, 2022.
  60. Gradnorm: Gradient normalization for adaptive loss balancing in deep multitask networks. In International conference on machine learning, pages 794–803, 2018.
  61. On the order of derivation in the training of physics-informed neural networks: case studies for non-uniform beam structures. Acta Mechanica, 234, 2023b.
Citations (4)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets