2000 character limit reached
pETNNs: Partial Evolutionary Tensor Neural Networks for Solving Time-dependent Partial Differential Equations (2403.06084v2)
Published 10 Mar 2024 in math.NA, cs.NA, and physics.comp-ph
Abstract: We present partial evolutionary tensor neural networks (pETNNs), a novel framework for solving time-dependent partial differential equations with high accuracy and capable of handling high-dimensional problems. Our architecture incorporates tensor neural networks and evolutional parametric approximation. A posterior error bounded is proposed to support the extrapolation capabilities. In the numerical implementations, we adopt a partial update strategy to achieve a significant reduction in computational cost while maintaining precision and robustness. Notably, as a low-rank approximation method of complex dynamical systems, the pETNNs enhance the accuracy of evolutional deep neural networks and empowers computational abilities to address high-dimensional problems. Numerical experiments demonstrate the superior performance of the pETNNs in solving time-dependent complex equations, including the incompressible Navier-Stokes equations, high-dimensional heat equations, highdimensional transport equations, and dispersive equations of higher-order derivatives.
- Evolution of nonlinear reduced-order solutions for pdes with conserved quantities. SIAM Journal on Scientific Computing, 44(1):A176–A197, 2022.
- Randomized sparse neural galerkin schemes for solving evolution equations with deep networks. In A. Oh, T. Neumann, A. Globerson, K. Saenko, M. Hardt, and S. Levine, editors, Advances in Neural Information Processing Systems, volume 36, pages 4097–4114. Curran Associates, Inc., 2023.
- Neural galerkin schemes with active learning for high-dimensional evolution equations. Journal of Computational Physics, 496:112588, 2024.
- Philippe G. Ciarlet. The Finite Element Method for Elliptic Problems. Classics in Applied Mathematics. Society for Industrial and Applied Mathematics, Philadelphia, PA, classics in applied mathematics edition, 2002.
- George Cybenko. Approximation by superpositions of a sigmoidal function. Mathematics of Control, Signals and Systems, 2:303–314, 1989.
- Neural-network-based approximations for solving partial differential equations. Communications in Numerical Methods in Engineering, 10(3):195–201, 1994.
- Evolutional deep neural network. Physical Review E, 104:045303, Oct 2021.
- The deep ritz method: A deep learning-based numerical algorithm for solving variational problems. Communications in Mathematics and Statistics, 6:1–12, 2018.
- Failure-informed adaptive sampling for pinns. SIAM Journal on Scientific Computing, 45(4):A1971–A1994, 2023.
- Multilayer feedforward networks are universal approximators. Neural Networks, 2:359–366, 1989.
- Adaptive activation functions accelerate convergence in deep and physics-informed neural networks. Journal of Computational Physics, 404:109136, 2020.
- Positional embeddings for solving pdes with evolutional deep neural networks. arXiv e-prints, page arXiv: 2308.03461, 2023.
- Artificial neural networks for solving ordinary and partial differential equations. IEEE Transactions on Neural Networks, 9(5):987–1000, 1998.
- Randall J. LeVeque. Finite Difference Methods for Ordinary and Partial Differential Equations: Steady-State and Time-Dependent Problems. Society for Industrial and Applied Mathematics, Philadelphia, PA, 2007.
- Solving high dimensional partial differential equations using tensor type discretization and optimization process. arXiv e-prints, page arXiv:2211.16548, 2022.
- PDE-Net 2.0: Learning PDEs from data with a numeric-symbolic hybrid deep network. Journal of Computational Physics, 399:108925, 2019.
- PDE-Net: Learning PDEs from data. In International Conference on Machine Learning, pages 3208–3216, 2018.
- Deepxde: A deep learning library for solving differential equations. SIAM Review, 63(1):208–228, 2021.
- Achieving high accuracy with pinns via energy natural gradients. arXiv e-prints, page arXiv: 2302.13163, 2023.
- Experience report of physics-informed neural networks in fluid simulations: pitfalls and frustration. In Meghann Agarwal, Chris Calloway, Dillon Niederhut, and David Shupe, editors, Proceedings of the 21st Python in Science Conference, pages 28 – 36, 2022.
- Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational Physics, 378:686–707, 2019.
- Spectral Methods: Algorithms, Analysis and Applications, volume 41 of Springer Series in Computational Mathematics. Springer, Berlin, Heidelberg, 2011.
- Dgm: A deep learning algorithm for solving partial differential equations. Journal of Computational Physics, 375:1339–1364, 2018.
- Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains. Advances in Neural Information Processing Systems 33, pages 7537–7547, June 2020.
- Is l2superscript𝑙2l^{2}italic_l start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT physics informed loss always suitable for training physics informed neural network? In S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh, editors, Advances in Neural Information Processing Systems, volume 35, pages 8278–8290. Curran Associates, Inc., 2022.
- Tensor neural network and its numerical integration. arXiv e-prints, page arXiv: 2207.02754, 2023.
- Solving high dimensional partial differential equations using tensor neural network and a posteriori error estimators. arXiv e-prints, page arXiv:2311.02732, 2023.
- Revealing excited states of rotational bose-einstein condensates. The Innovation, 5(1), 2024.
- Transition pathways connecting crystals and quasicrystals. Proceedings of the National Academy of Sciences, 118(49):e2106230118, 2021.
- Construction of a pathway map on a complicated energy landscape. Phys. Rev. Lett., 124:090601, Mar 2020.
Collections
Sign up for free to add this paper to one or more collections.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.