Time integration schemes based on neural networks for solving partial differential equations on coarse grids (2310.10308v1)
Abstract: The accuracy of solving partial differential equations (PDEs) on coarse grids is greatly affected by the choice of discretization schemes. In this work, we propose to learn time integration schemes based on neural networks which satisfy three distinct sets of mathematical constraints, i.e., unconstrained, semi-constrained with the root condition, and fully-constrained with both root and consistency conditions. We focus on the learning of 3-step linear multistep methods, which we subsequently applied to solve three model PDEs, i.e., the one-dimensional heat equation, the one-dimensional wave equation, and the one-dimensional Burgers' equation. The results show that the prediction error of the learned fully-constrained scheme is close to that of the Runge-Kutta method and Adams-Bashforth method. Compared to the traditional methods, the learned unconstrained and semi-constrained schemes significantly reduce the prediction error on coarse grids. On a grid that is 4 times coarser than the reference grid, the mean square error shows a reduction of up to an order of magnitude for some of the heat equation cases, and a substantial improvement in phase prediction for the wave equation. On a 32 times coarser grid, the mean square error for the Burgers' equation can be reduced by up to 35% to 40%.
- Joseph Smagorinsky. General circulation experiments with the primitive equations: I. the basic experiment. Monthly Weather Review, 91(3):99–164, 1963.
- A dynamic subgrid-scale eddy viscosity model. Physics of Fluids A: Fluid Dynamics, 3(7):1760–1765, 1991.
- Implicit large eddy simulation, volume 10. Cambridge University Press Cambridge, 2007.
- JC Wyngaard. Toward numerical modeling in the “terra incognita”. Journal of the Atmospheric Sciences, 61(14):1816–1826, JUL 2004.
- The atmospheric boundary layer and the “gray zone” of turbulence: A critical review. Journal of Geophysical Research-Atmospheres, 125(13), JUL 16 2020.
- Physics informed deep learning (part i): Data-driven solutions of nonlinear partial differential equations. arXiv:1711.10561, 2017.
- Dgm: A deep learning algorithm for solving partial differential equations. Journal of Computational Physics, 375:1339–1364, DEC 15 2018.
- Deepxde: A deep learning library for solving differential equations. SIAM Review, 63(1):208–228, MAR 2021.
- On the eigenvector bias of fourier feature networks: From regression to solving multi-scale pdes with physics-informed neural networks. Computer Methods in Applied Mechanics and Engineering, 384, OCT 1 2021.
- Learning in modal space: Solving time-dependent stochastic pdes using physics-informed neural networks. arXiv:1905.01205v2, 2019.
- Phycrnet: Physics-informed convolutional-recurrent network for solving spatiotemporal pdes. Computer Methods in Applied Mechanics and Engineering, 389:114399, 2022.
- Physics-informed machine learning. Nature Reviews Physics, 3(6):422–440, JUN 2021.
- Scientific machine learning through physics-informed neural networks: Where we are and what’s next. Journal of Scientific Computing, 92(3), SEP 2022.
- Why and when can deep-but not shallow-networks avoid the curse of dimensionality: A review. International Journal of Automation and Computing, 14(5, SI):503–519, OCT 2017.
- Three ways to solve partial differential equations with neural networks — a review. GAMM-Mitteilungen, 44:e202100006, 2021.
- Physics informed deep learning (part ii): Data-driven discovery of nonlinear partial differential equations. arXiv:1711.10566, 2017.
- Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational Physics, 378:686–707, 2019.
- Solving the kolmogorov pde by means of deep learning. arXiv:1806.00421, 2018.
- Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equations. Communications in Mathematics and Statistics, 5(4):349–380, DEC 2017.
- Solving high-dimensional partial differential equations using deep learning. Proceedings of the National Academy of Sciences of the United States of America, 115(34):8505–8510, AUG 21 2018.
- Turbulence modeling in the age of data. Annual Review of Fluid Mechanics, 51:357–377, 2019.
- Machine learning methods for turbulence modeling in subsonic flows around airfoils. Physics of Fluids, 31(1):015105, 2019.
- Subgrid-scale model for large-eddy simulation of isotropic turbulent flows using an artificial neural network. Computers & Fluids, 195:104319, 2019.
- Artificial neural network-based subgrid-scale models for les of compressible turbulent channel flow. Theoretical and Applied Mechanics Letters, page 100399, 2022.
- Predictive large-eddy-simulation wall modeling via physics-informed neural networks. Physical Review Fluids, 4:034602, 2019.
- Wall model based on neural networks for les of turbulent flows over periodic hills. Physical Review Fluids, 6(5):054610, 2021.
- Ensemble kalman method for learning turbulence models from indirect observation data. Journal of Fluid Mechanics, 949, SEP 29 2022.
- Combining direct and indirect sparse data for learning generalizable turbulence models. Journal of Computational Physics, 489, SEP 15 2023.
- A data-driven physics-informed finite-volume scheme for nonclassical undercompressive shocks. Journal of Computational Physics, 437:110324, 2021.
- A neural network enhanced weighted essentially non-oscillatory method for nonlinear degenerate parabolic equations. Physics of Fluids, 34(2):026604, 2022.
- Learning data-driven discretizations for partial differential equations. Proceedings of the National Academy of Sciences, 116(31):15344–15349, 2019.
- Solving ordinary differential equations. 1, Nonstiff problems. Springer-Verlag, 1993.
- Applications of the theory of matrices. Courier Corporation, 2005.
- Linear and nonlinear programming, volume 2. Springer, 1984.
- Computational fluid mechanics and heat transfer. Taylor & Francis, 2016.
- Fundamentals of computational fluid dynamics, volume 246. Springer, 2001.