Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
194 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Better Neural PDE Solvers Through Data-Free Mesh Movers (2312.05583v2)

Published 9 Dec 2023 in cs.LG, cs.AI, cs.NA, and math.NA

Abstract: Recently, neural networks have been extensively employed to solve partial differential equations (PDEs) in physical system modeling. While major studies focus on learning system evolution on predefined static mesh discretizations, some methods utilize reinforcement learning or supervised learning techniques to create adaptive and dynamic meshes, due to the dynamic nature of these systems. However, these approaches face two primary challenges: (1) the need for expensive optimal mesh data, and (2) the change of the solution space's degree of freedom and topology during mesh refinement. To address these challenges, this paper proposes a neural PDE solver with a neural mesh adapter. To begin with, we introduce a novel data-free neural mesh adaptor, called Data-free Mesh Mover (DMM), with two main innovations. Firstly, it is an operator that maps the solution to adaptive meshes and is trained using the Monge-Amp`ere equation without optimal mesh data. Secondly, it dynamically changes the mesh by moving existing nodes rather than adding or deleting nodes and edges. Theoretical analysis shows that meshes generated by DMM have the lowest interpolation error bound. Based on DMM, to efficiently and accurately model dynamic systems, we develop a moving mesh based neural PDE solver (MM-PDE) that embeds the moving mesh with a two-branch architecture and a learnable interpolation framework to preserve information within the data. Empirical experiments demonstrate that our method generates suitable meshes and considerably enhances accuracy when modeling widely considered PDE systems. The code can be found at: https://github.com/Peiyannn/MM-PDE.git.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (33)
  1. Graph element networks: adaptive, structured computation and memory, 2019.
  2. Ted Belytschko and M Tabbara. H-adaptive finite element methods for dynamic problems, with emphasis on localization. International Journal for Numerical Methods in Engineering, 36(24):4245–4265, 1993.
  3. An h-adaptive method in the generalized finite differences. Computer Methods in Applied Mechanics and Engineering, 192(5):735–759, 2003. ISSN 0045-7825. doi: https://doi.org/10.1016/S0045-7825(02)00594-7. URL https://www.sciencedirect.com/science/article/pii/S0045782502005947.
  4. Message passing neural pde solvers. arXiv preprint arXiv:2202.03376, 2022.
  5. Chris J Budd and JF Williams. Parabolic monge–ampère methods for blow-up problems in several spatial dimensions. Journal of Physics A: Mathematical and General, 39(19):5425, 2006.
  6. Monge–ampére based moving mesh methods for numerical weather prediction, with applications to the eady problem. Journal of Computational Physics, 236:247–270, 2013.
  7. An efficient dynamically adaptive mesh for potentially singular solutions. Journal of Computational Physics, 172(2):609–639, 2001.
  8. Philippe G Ciarlet. The finite element method for elliptic problems. SIAM, 2002.
  9. Multi-scale hydro-morphodynamic modelling using mesh movement methods. GEM-International Journal on Geomathematics, 13(1):2, 2022.
  10. Mitigating propagation failures in physics-informed neural networks using retain-resample-release (r3) sampling, 2023.
  11. A review on deep reinforcement learning for fluid mechanics. Computers & Fluids, 225:104973, 2021.
  12. An r-adaptive mesh optimization algorithm based on interpolation error bounds. Technical report, Sandia National Lab.(SNL-NM), Albuquerque, NM (United States), 2007.
  13. Learning to control pdes with differentiable physics, 2020.
  14. Adaptive moving mesh methods, volume 174. Springer Science & Business Media, 2010.
  15. Fourier neural operator for parametric partial differential equations. arXiv preprint arXiv:2010.08895, 2020.
  16. Fourier neural operator with learned deformations for pdes on general geometries, 2022.
  17. Learning nonlinear operators via deeponet based on the universal approximation theorem of operators. Nature machine intelligence, 3(3):218–229, 2021.
  18. Optimal-transport–based mesh adaptivity on the plane and sphere using finite elements. SIAM Journal on Scientific Computing, 40(2):A1121–A1148, 2018.
  19. An analysis of springback in sheet metal bending using finite element method (fem). Journal of Materials Processing Technology, 186(1):120–124, 2007. ISSN 0924-0136. doi: https://doi.org/10.1016/j.jmatprotec.2006.12.026. URL https://www.sciencedirect.com/science/article/pii/S0924013606011666.
  20. Automatic differentiation in pytorch. 2017.
  21. Learning mesh-based simulation with graph networks. arXiv preprint arXiv:2010.03409, 2020.
  22. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational physics, 378:686–707, 2019.
  23. Physr: Physics-informed deep super-resolution for spatiotemporal data. Journal of Computational Physics, 492:112438, 2023. ISSN 0021-9991. doi: https://doi.org/10.1016/j.jcp.2023.112438. URL https://www.sciencedirect.com/science/article/pii/S0021999123005338.
  24. Weather forecasting using gpu-based large-eddy simulations. Bulletin of the American Meteorological Society, 96(5):715–723, 2015.
  25. Construction of arbitrary order finite element degree-of-freedom maps on polygonal and polyhedral cell meshes. ACM Transactions on Mathematical Software, 48(2):18:1–18:23, 2022. doi: 10.1145/3524456.
  26. M2n: mesh movement networks for pde solvers. Advances in Neural Information Processing Systems, 35:7199–7210, 2022.
  27. Adaptive mesh methods for one-and two-dimensional hyperbolic conservation laws. SIAM Journal on Numerical Analysis, 41(2):487–515, 2003.
  28. R-adaptive and h-adaptive mesh optimisation based on error assessment. In 13th ACME conference: Department of Civil and Structural Engineering, University of Sheffield, 2005.
  29. Mesh adaptation on the sphere using optimal transport and the numerical solution of a monge–ampère type equation. Journal of Computational Physics, 308:102–123, 2016.
  30. Alan M Winslow. Numerical solution of the quasilinear poisson equation in a nonuniform triangle mesh. Journal of computational physics, 1(2):149–172, 1966.
  31. Learning controllable adaptive simulation for multi-resolution physics. arXiv preprint arXiv:2305.01122, 2023.
  32. Reinforcement learning for adaptive mesh refinement. In International Conference on Artificial Intelligence and Statistics, pp.  5997–6014. PMLR, 2023.
  33. Bing Yu et al. The deep ritz method: a deep learning-based numerical algorithm for solving variational problems. Communications in Mathematics and Statistics, 6(1):1–12, 2018.
Citations (3)

Summary

We haven't generated a summary for this paper yet.

Github Logo Streamline Icon: https://streamlinehq.com