Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
153 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Accelerating PDE Data Generation via Differential Operator Action in Solution Space (2402.05957v2)

Published 4 Feb 2024 in cs.LG

Abstract: Recent advancements in data-driven approaches, such as Neural Operator (NO), have demonstrated their effectiveness in reducing the solving time of Partial Differential Equations (PDEs). However, one major challenge faced by these approaches is the requirement for a large amount of high-precision training data, which needs significant computational costs during the generation process. To address this challenge, we propose a novel PDE dataset generation algorithm, namely Differential Operator Action in Solution space (DiffOAS), which speeds up the data generation process and enhances the precision of the generated data simultaneously. Specifically, DiffOAS obtains a few basic PDE solutions and then combines them to get solutions. It applies differential operators on these solutions, a process we call 'operator action', to efficiently generate precise PDE data points. Theoretical analysis shows that the time complexity of DiffOAS method is one order lower than the existing generation method. Experimental results show that DiffOAS accelerates the generation of large-scale datasets with 10,000 instances by 300 times. Even with just 5% of the generation time, NO trained on the data generated by DiffOAS exhibits comparable performance to that using the existing generation method, which highlights the efficiency of DiffOAS.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (32)
  1. Clifford neural layers for pde modeling. arXiv preprint arXiv:2209.04934, 2022.
  2. Solving time-dependent pdes with the ultraspherical spectral method, 2023.
  3. Evans, L. C. Partial differential equations, volume 19. American Mathematical Society, 2022.
  4. Matrix computations. JHU press, 2013.
  5. Physics-informed machine learning: A survey on problems, methods and applications. arXiv preprint arXiv:2211.08064, 2022.
  6. Methods of conjugate gradients for solving linear systems. Journal of research of the National Bureau of Standards, 49(6):409–436, 1952.
  7. Learning neural pde solvers with convergence guarantees. arXiv preprint arXiv:1906.01200, 2019.
  8. Hughes, T. J. The finite element method: linear static and dynamic finite element analysis. Courier Corporation, 2012.
  9. Johnson, C. Numerical solution of partial differential equations by the finite element method. Courier Corporation, 2012.
  10. A deep conjugate direction method for iteratively solving linear systems. In International Conference on Machine Learning, pp.  15720–15736. PMLR, 2023.
  11. Neural operator: Learning maps between function spaces. arXiv preprint arXiv:2108.08481, 2021.
  12. LeVeque, R. J. Finite volume methods for hyperbolic problems, volume 31. Cambridge university press, 2002.
  13. Learning preconditioner for conjugate gradient pde solvers. arXiv preprint arXiv:2305.16432, 2023.
  14. Fourier neural operator for parametric partial differential equations. arXiv preprint arXiv:2010.08895, 2020.
  15. Krylov subspace methods: principles and analysis. Numerical Mathematics and Scie, 2013.
  16. Ino: Invariant neural operators for learning complex physical systems with momentum conservation. In International Conference on Artificial Intelligence and Statistics, pp.  6822–6838. PMLR, 2023.
  17. Deeponet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators. arXiv preprint arXiv:1910.03193, 2019.
  18. A comprehensive and fair comparison of two neural operators (with practical extensions) based on fair data. Computer Methods in Applied Mechanics and Engineering, 393:114778, 2022.
  19. Mauri, R. Dispersion, convection, and reaction in porous media. Physics of Fluids A: Fluid Dynamics, 3(5):743–756, 1991.
  20. Numerical solution of partial differential equations: an introduction. Cambridge university press, 2005.
  21. Solution of sparse indefinite systems of linear equations. SIAM journal on numerical analysis, 12(4):617–629, 1975.
  22. A review of diffusion and dispersion in porous media. Society of Petroleum Engineers Journal, 3(01):70–84, 1963.
  23. Solving nonlinear odes with the ultraspherical spectral method. arXiv preprint arXiv:2306.17688, 2023.
  24. U-no: U-shaped neural operators. arXiv preprint arXiv:2204.11127, 2022.
  25. Gmres: A generalized minimal residual algorithm for solving nonsymmetric linear systems. SIAM Journal on scientific and statistical computing, 7(3):856–869, 1986.
  26. Strikwerda, J. C. Finite difference schemes and partial differential equations. SIAM, 2004.
  27. SciPy 1.0: Fundamental Algorithms for Scientific Computing in Python. Nature Methods, 17:261–272, 2020. doi: 10.1038/s41592-019-0686-2.
  28. Accelerating data generation for neural operators via krylov subspace recycling. arXiv preprint arXiv:2401.09516, 2024.
  29. Data-driven projection method in fluid simulation. Computer Animation and Virtual Worlds, 27(3-4):415–424, 2016.
  30. Introduction to partial differential equations with applications. Courier Corporation, 1986.
  31. A hybrid iterative numerical transferable solver (hints) for pdes based on deep operator network and relaxation methods. arXiv preprint arXiv:2208.13273, 2022.
  32. Artificial intelligence for science in quantum, atomistic, and continuum systems. arXiv preprint arXiv:2307.08423, 2023.

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com