Towards Exascale CFD Simulations Using the Discontinuous Galerkin Solver FLEXI
Abstract: Modern high-order discretizations bear considerable potential for the exascale era due to their high fidelity and the high, local computational load that allows for computational efficiency in massively parallel simulations. To this end, the discontinuous Galerkin (DG) framework FLEXI was selected to demonstrate exascale readiness within the Center of Excellence for Exascale CFD (CEEC) by simulating shock buffet on a three-dimensional wing segment at transsonic flight conditions. This paper summarizes the recent progress made to enable the simulation of this challenging exascale problem. For this, it is first demonstrated that FLEXI scales excellently to over 500 000 CPU cores on HAWK at the HLRS. To tackle the considerable resolution requirements near the wall, a novel wall model is proposed that takes compressibility effects into account and yields decent results for the simulation of a NACA 64A-110 airfoil. To address the shocks in the domain, a finite-volume-based shock capturing method was implemented in FLEXI, which is validated here using the simulation of a linear compressor cascade at supersonic flow conditions, where the method is demonstrated to yield efficient, robust and accurate results. Lastly, we present the TensorFlow-Fortran-Binding (TFFB) as an easy-to-use library to deploy trained machine learning models in Fortran solvers such as FLEXI.
- TensorFlow: Large-scale machine learning on heterogeneous systems, 2015. Software available from tensorflow.org.
- A neural network based shock detection and localization approach for discontinuous Galerkin methods. Journal of Computational Physics, 423:109824, 2020.
- Numerical and experimental investigation of a NACA 64A-110 airfoil in transsonic flow regime. Submitted to AIAA Journal, 2023.
- Residual estimation for grid modification in wall-modeled large eddy simulation using unstructured high-order methods. Computers & Fluids, 254, 2023.
- G. Gassner and D. A. Kopriva. Comparison of the Gauss and Gauss-Lobatto discontinuous Galerkin Spectral Element Method for wave propagation problems. SIAM Journal on Scientific Computing, 33(5):2560–2579, 2011.
- A provably entropy stable subcell shock capturing approach for high order split form DG for the compressible Euler equations. Journal of Computational Physics, 426:109935, 2021.
- FLEXI: A high order discontinuous Galerkin framework for hyperbolic–parabolic conservation laws. Computers & Mathematics with Applications, 81:186–219, 2021.
- Deep reinforcement learning for turbulence modeling in large eddy simulations. International Journal of Heat and Fluid Flow, 99:109094, 2023.
- Relexi—A scalable open source reinforcement learning framework for high-performance computing. Software Impacts, 14:100422, 2022.
- Deep reinforcement learning for computational fluid dynamics on HPC systems. Journal of Computational Science, 65:101884, 2022.
- Pruning and quantization for deep neural network acceleration: A survey. Neurocomputing, 461:370–403, 2021.
- Deploying deep learning in OpenFOAM with TensorFlow. In AIAA Scitech 2021 Forum, page 1485, 2021.
- R. D. Moore and L. Reid. Performance of single-stage axial-flow transonic compressor with rotor and stator aspect ratios of 1.63 and 1.78, respectively, and with design pressure ratio of 1.82. Technical report, NASA-TP-1338, 1978.
- A Fortran-Keras deep learning bridge for scientific computing. Scientific Programming, 2020:1–13, 2020.
- P.-O. Persson and J. Peraire. Sub-cell shock capturing for discontinuous Galerkin methods. In Proc. of the 44th AIAA Aerospace Sciences Meeting and Exhibit, 2006.
- CFD vision 2030 study: A path to revolutionary computational aerosciences. Technical report, NASA Langley Research Center; Hampton, VA, United States, 2014.
- J. Smagorinsky. General circulation experiments with the primitive equations: I. the basic experiment. Monthly weather review, 91(3):99–164, 1963.
- M. Sonntag and C.-D. Munz. Efficient parallelization of a shock capturing for discontinuous Galerkin methods using finite volume sub-cells. Journal of Scientific Computing, 70(3):1262–1289, 2017.
- D. B. Spalding. A single formula for the law of the wall. Journal of Applied mechanics, 28(3):455–458, 1961.
- E. R. Van Driest. Turbulent boundary layer in compressible fluids. J. Aero. Sci., 18:145–160, 1951.
- F. M. White. Viscous fluid flow. McGraw-Hill series in mechanical engineering. McGraw-Hill, Boston, Mass., 3. ed. edition, 2006.
Paper Prompts
Sign up for free to create and run prompts on this paper.