Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
144 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Learning WENO for entropy stable schemes to solve conservation laws (2403.14848v2)

Published 21 Mar 2024 in math.NA, cs.LG, and cs.NA

Abstract: Entropy conditions play a crucial role in the extraction of a physically relevant solution for systems of conservation laws, thus motivating the construction of entropy stable schemes that satisfy a discrete analogue of such conditions. TeCNO schemes (Fjordholm et al. 2012) form a class of arbitrary high-order entropy stable finite difference solvers, which require specialized reconstruction algorithms satisfying the sign property at each cell interface. Third-order weighted essentially non-oscillatory (WENO) schemes called SP-WENO (Fjordholm and Ray, 2016) and SP-WENOc (Ray, 2018) have been designed to satisfy the sign property. However, these WENO algorithms can perform poorly near shocks, with the numerical solutions exhibiting large spurious oscillations. In the present work, we propose a variant of the SP-WENO, termed as Deep Sign-Preserving WENO (DSP-WENO), where a neural network is trained to learn the WENO weighting strategy. The sign property and third-order accuracy are strongly imposed in the algorithm, which constrains the WENO weight selection region to a convex polygon. Thereafter, a neural network is trained to select the WENO weights from this convex region with the goal of improving the shock-capturing capabilities without sacrificing the rate of convergence in smooth regions. The proposed synergistic approach retains the mathematical framework of the TeCNO scheme while integrating deep learning to remedy the computational issues of the WENO-based reconstruction. We present several numerical experiments to demonstrate the significant improvement with DSP-WENO over the existing variants of WENO satisfying the sign property.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (58)
  1. Rémi Abgrall and Maria Han Veiga “Neural Network-Based Limiter with Transfer Learning” In Communications on Applied Mathematics and Computation 5.2, 2023, pp. 532–572 DOI: 10.1007/s42967-020-00087-1
  2. Andrea Beck, David Flad and Claus-Dieter Munz “Deep neural networks for data-driven LES closure models” In Journal of Computational Physics 398, 2019, pp. 108910 DOI: https://doi.org/10.1016/j.jcp.2019.108910
  3. “A neural network based shock detection and localization approach for discontinuous Galerkin methods” In Journal of Computational Physics 423, 2020, pp. 109824 DOI: https://doi.org/10.1016/j.jcp.2020.109824
  4. Oscar P. Bruno, Jan S. Hesthaven and Daniel V. Leibovici “FC-based shock-dynamics solver with neural-network localized artificial-viscosity assignment” In Journal of Computational Physics: X 15, 2022, pp. 100110 DOI: https://doi.org/10.1016/j.jcpx.2022.100110
  5. Praveen Chandrashekar “Kinetic energy preserving and entropy stable finite volume schemes for compressible Euler and Navier-Stokes equations” In Communications in Computational Physics 14.5 Cambridge University Press, 2013, pp. 1252–1286
  6. Xiaohan Cheng “A fourth order entropy stable scheme for hyperbolic conservation laws” In Entropy 21.5 MDPI, 2019, pp. 508
  7. “A third-order entropy stable scheme for hyperbolic conservation laws” In Journal of Hyperbolic Differential Equations 13.01 World Scientific, 2016, pp. 129–145
  8. Elisabetta Chiodaroli, Camillo De Lellis and Ondřej Kreml “Global Ill-Posedness of the Isentropic System of Gas Dynamics” In Communications on Pure and Applied Mathematics 68.7, 2015, pp. 1157–1190 DOI: https://doi.org/10.1002/cpa.21537
  9. “Scientific Machine Learning Through Physics–Informed Neural Networks: Where we are and What’s Next” In Journal of Scientific Computing 92.3, 2022, pp. 88 DOI: 10.1007/s10915-022-01939-z
  10. Constantine M Dafermos and Constantine M Dafermos “Hyperbolic conservation laws in continuum physics” Springer, 2005
  11. “Conditional score-based generative models for solving physics-based inverse problems” In NeurIPS 2023 Workshop on Deep Learning and Inverse Problems, 2023
  12. Tim De Ryck, Siddhartha Mishra and Deep Ray “On the approximation of rough functions with deep neural networks” In SeMA Journal 79.3, 2022, pp. 399–440 DOI: 10.1007/s40324-022-00299-w
  13. Niccolo Discacciati, Jan S Hesthaven and Deep Ray “Controlling oscillations in high-order discontinuous Galerkin schemes using artificial viscosity tuned by neural networks” In Journal of Computational Physics 409 Elsevier, 2020, pp. 109304
  14. Ulrik S Fjordholm, Siddhartha Mishra and Eitan Tadmor “Arbitrarily high-order accurate entropy stable essentially nonoscillatory schemes for systems of conservation laws” In SIAM Journal on Numerical Analysis 50.2 SIAM, 2012, pp. 544–573
  15. Ulrik S Fjordholm, Siddhartha Mishra and Eitan Tadmor “ENO reconstruction and ENO interpolation are stable” In Foundations of Computational Mathematics 13 Springer, 2013, pp. 139–159
  16. Ulrik S Fjordholm and Deep Ray “A sign preserving WENO reconstruction method” In Journal of Scientific Computing 68 Springer, 2016, pp. 42–63
  17. “Solving Bayesian Inverse Problems via Variational Autoencoders” In Proceedings of the 2nd Mathematical and Scientific Machine Learning Conference 145, Proceedings of Machine Learning Research PMLR, 2022, pp. 386–425 URL: https://proceedings.mlr.press/v145/goh22a.html
  18. Sigal Gottlieb, Chi-Wang Shu and Eitan Tadmor “Strong stability-preserving high-order time discretization methods” In SIAM review 43.1 SIAM, 2001, pp. 89–112
  19. Ayoub Gouasmi, Scott M. Murman and Karthik Duraisamy “Entropy Conservative Schemes and the Receding Flow Problem” In Journal of Scientific Computing 78.2, 2019, pp. 971–994 DOI: 10.1007/s10915-018-0793-8
  20. Amiram Harten “On the symmetric form of systems of conservation laws with entropy” In Journal of Computational Physics 49.1, 1983, pp. 151–164 DOI: https://doi.org/10.1016/0021-9991(83)90118-3
  21. Daniel Zhengyu Huang, Nicholas H. Nelsen and Margaret Trautner “An operator learning perspective on parameter-to-observable maps”, 2024 arXiv:2402.06031 [cs.LG]
  22. Farzad Ismail and Philip L. Roe “Affordable, entropy-consistent Euler flux functions II: Entropy production at shocks” In Journal of Computational Physics 228.15, 2009, pp. 5410–5436 DOI: https://doi.org/10.1016/j.jcp.2009.04.021
  23. “Efficient Implementation of Weighted ENO Schemes” In Journal of Computational Physics 126.1, 1996, pp. 202–228 DOI: https://doi.org/10.1006/jcph.1996.0130
  24. “Universal Approximation with Deep Narrow Networks” In Proceedings of Thirty Third Conference on Learning Theory 125, Proceedings of Machine Learning Research PMLR, 2020, pp. 2306–2327 URL: https://proceedings.mlr.press/v125/kidger20a.html
  25. Diederik P Kingma and Jimmy Ba “Adam: A method for stochastic optimization” In arXiv preprint arXiv:1412.6980, 2014
  26. Tatiana Kossaczká, Matthias Ehrhardt and Michael Günther “Enhanced fifth order WENO shock-capturing schemes with deep learning” In Results in Applied Mathematics 12 Elsevier, 2021, pp. 100201
  27. S.N. Kružkov “First order quasilinear equations in several independent variables” In Mathematics of the USSR-Sbornik 10.2, 1970, pp. 217 DOI: 10.1070/SM1970v010n02ABEH002156
  28. “Solution of two-dimensional Riemann problems for gas dynamics without Riemann problem solvers” In Numerical Methods for Partial Differential Equations: An International Journal 18.5 Wiley Online Library, 2002, pp. 584–608
  29. Peter D Lax “Weak solutions of nonlinear hyperbolic equations and their numerical computation” In Communications on pure and applied mathematics 7.1 Wiley Online Library, 1954, pp. 159–193
  30. Philippe G Lefloch, Jean-Marc Mercier and Christian Rohde “Fully discrete, entropy conservative schemes of arbitrary order” In SIAM Journal on Numerical Analysis 40.5 SIAM, 2002, pp. 1968–1992
  31. “On Admissibility Criteria for Weak Solutions of the Euler Equations” In Archive for Rational Mechanics and Analysis 195.1, 2010, pp. 225–260 DOI: 10.1007/s00205-008-0201-x
  32. Yue Li, Lin Fu and Nikolaus A Adams “A six-point neuron-based ENO (NENO6) scheme for compressible fluid dynamics” In arXiv preprint arXiv:2207.08500, 2022
  33. “Fourier Neural Operator for Parametric Partial Differential Equations” arXiv, https://arxiv.org/abs/2010.08895, 2020 DOI: 10.48550/ARXIV.2010.08895
  34. “Robust euler codes” In 13th computational fluid dynamics conference, 1997, pp. 2098
  35. “Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators” In Nature Machine Intelligence 3.3, 2021, pp. 218–229 DOI: 10.1038/s42256-021-00302-5
  36. “Iterative surrogate model optimization (ISMO): An active learning algorithm for PDE constrained optimization with deep neural networks” In Computer Methods in Applied Mechanics and Engineering 374 Elsevier, 2021, pp. 113575
  37. Kjetil O. Lye, Siddhartha Mishra and Deep Ray “Deep learning observables in computational fluid dynamics” In Journal of Computational Physics 410, 2020, pp. 109339 DOI: https://doi.org/10.1016/j.jcp.2020.109339
  38. Romit Maulik, Omer San and Jamey D. Jacob “Spatiotemporally dynamic implicit large eddy simulation using machine learning classifiers” In Physica D: Nonlinear Phenomena 406, 2020, pp. 132409 DOI: https://doi.org/10.1016/j.physd.2020.132409
  39. Prashant Kumar Pandey and Ritesh Kumar Dubey “Sign stable arbitrary high order reconstructions for constructing non-oscillatory entropy stable schemes” In Applied Mathematics and Computation 454 Elsevier, 2023, pp. 128099
  40. “Variationally mimetic operator networks” In Computer Methods in Applied Mechanics and Engineering 419, 2024, pp. 116536 DOI: https://doi.org/10.1016/j.cma.2023.116536
  41. Dhruv V Patel, Deep Ray and Assad A Oberai “Solution of physics-based Bayesian inverse problems with deep generative priors” In Computer Methods in Applied Mechanics and Engineering 400 Elsevier, 2022, pp. 115428
  42. Allan Pinkus “Approximation theory of the MLP model in neural networks” In Acta Numerica 8 Cambridge University Press, 1999, pp. 143–195 DOI: 10.1017/S0962492900002919
  43. M. Raissi, P. Perdikaris and G.E. Karniadakis “Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations” In Journal of Computational Physics 378, 2019, pp. 686–707 DOI: https://doi.org/10.1016/j.jcp.2018.10.045
  44. Deep Ray “A Third-Order Entropy Stable Scheme for the Compressible Euler Equations” In Theory, Numerics and Applications of Hyperbolic Problems II: Aachen, Germany, August 2016, 2018, pp. 503–515 Springer
  45. Deep Ray and Jan S Hesthaven “An artificial neural network as a troubled-cell indicator” In Journal of computational physics 367 Elsevier, 2018, pp. 166–191
  46. Deep Ray and Jan S Hesthaven “Detecting troubled-cells on two-dimensional unstructured grids using a neural network” In Journal of Computational Physics 397 Elsevier, 2019, pp. 108845
  47. “Solution of physics-based inverse problems using conditional generative adversarial networks with full gradient penalty” A Special Issue in Honor of the Lifetime Achievements of T. J. R. Hughes In Computer Methods in Applied Mechanics and Engineering 417, 2023, pp. 116338 DOI: https://doi.org/10.1016/j.cma.2023.116338
  48. “A numerical study of the convergence properties of ENO schemes” In Journal of Scientific Computing 5 Springer, 1990, pp. 151–167
  49. Lukas Schwander, Deep Ray and Jan S. Hesthaven “Controlling oscillations in spectral methods by local artificial viscosity governed by neural networks” In Journal of Computational Physics 431, 2021, pp. 110144 DOI: https://doi.org/10.1016/j.jcp.2021.110144
  50. “Efficient implementation of essentially non-oscillatory shock-capturing schemes, II” In Journal of Computational Physics 83.1 Elsevier, 1989, pp. 32–78
  51. Anand Pratap Singh and Karthik Duraisamy “Using field inversion to quantify functional errors in turbulence closures” In Physics of Fluids 28.4, 2016, pp. 045110 DOI: 10.1063/1.4947045
  52. “Enhancement of shock-capturing methods via machine learning” In Theoretical and Computational Fluid Dynamics 34.4, 2020, pp. 483–496 DOI: 10.1007/s00162-020-00531-1
  53. Eitan Tadmor “Entropy stability theory for difference approximations of nonlinear conservation laws and related time-dependent problems” In Acta Numerica 12 Cambridge University Press, 2003, pp. 451–512
  54. Eleuterio F Toro “Riemann solvers and numerical methods for fluid dynamics: a practical introduction” Springer Science & Business Media, 2013
  55. Andrew R. Winters and Gregor J. Gassner “Affordable, entropy conserving and entropy stable flux functions for the ideal MHD equations” In Journal of Computational Physics 304, 2016, pp. 72–108 DOI: https://doi.org/10.1016/j.jcp.2015.09.055
  56. Liu Yang, Dongkun Zhang and George Em Karniadakis “Physics-Informed Generative Adversarial Networks for Stochastic Differential Equations” In SIAM Journal on Scientific Computing 42.1, 2020, pp. A292–A317 DOI: 10.1137/18M1225409
  57. “The phase diagram of approximation rates for deep neural networks” arXiv, https://arxiv.org/abs/1906.09477, 2019 DOI: 10.48550/ARXIV.1906.09477
  58. “A data-driven high order sub-cell artificial viscosity for the discontinuous Galerkin spectral element method” In Journal of Computational Physics 441, 2021, pp. 110475 DOI: https://doi.org/10.1016/j.jcp.2021.110475
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets