Accelerating multigrid solver with generative super-resolution (2403.07936v1)
Abstract: The geometric multigrid algorithm is an efficient numerical method for solving a variety of elliptic partial differential equations (PDEs). The method damps errors at progressively finer grid scales, resulting in faster convergence compared to iterative methods such as Gauss-Seidel. The prolongation or coarse-to-fine interpolation operator within the multigrid algorithm, lends itself to a data-driven treatment with deep learning super-resolution, commonly used to increase the resolution of images. We (i) propose the integration of a super-resolution generative adversarial network (GAN) model with the multigrid algorithm as the prolongation operator and (ii) show that the GAN-interpolation can improve the convergence properties of multigrid in comparison to cubic spline interpolation on a class of multiscale PDEs typically solved in fluid mechanics and engineering simulations. We also highlight the importance of characterizing hybrid (machine learning/traditional) algorithm parameters.
- Review of deep convolution neural network in image classification. In 2017 International Conference on Radar, Antenna, Microwave, Electronics, and Telecommunications (ICRAMET), pages 26–31. IEEE, 2017.
- D. Birla. URL https://github.com/deepak112/Keras-SRGAN.
- Generative adversarial networks: An overview. IEEE Signal Processing Magazine, 35(1):53–65, 2018.
- Super-resolution reconstruction of turbulent velocity fields using a generative adversarial network-based artificial intelligence framework. Physics of Fluids, 31(12), 2019.
- Advances and challenges in super-resolution. International Journal of Imaging Systems and Technology, 14(2):47–57, 2004.
- Generative adverserial nets. Adv. Neural Procs. Sys., 27:2672 – 2680, 2014.
- A comprehensive survey and analysis of generative models in machine learning. Computer Science Review, 38:100285, 2020.
- Learning to predict the cosmological structure formation. Proceedings of the National Academy of Sciences, 116(28):13825–13832, 2019.
- Multigrid solver with super-resolved interpolation. arXiv preprint arXiv:2105.01739, 2021.
- A survey on generative adversarial networks: Variants, applications, and training. ACM Computing Surveys (CSUR), 54(8):1–49, 2021.
- Unsupervised deep learning for super-resolution reconstruction of turbulence. Journal of Fluid Mechanics, 910:A29, 2021.
- Normalizing flows: An introduction and review of current methods. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020.
- Y. LeCun and G. Hinton. Deep learning. Nature, 521:436 – 444, 2015.
- Photo-realistic single image super-resolution using a generative adversarial network. pages 4681–4690, 2017.
- Multigrid-augmented deep learning for the helmholtz equation: Better scalability with compact implicit layers. arXiv preprint arXiv:2306.17486, 2023.
- A neural network multigrid solver for the navier-stokes equations. Journal of Computational Physics, page 110983, 2022.
- S. Markidis. The old and the new: Can physics-informed deep-learning replace traditional linear solvers? Frontiers in big Data, page 92, 2021.
- Deep learning–based text classification: A comprehensive review. ACM Computing Surveys (CSUR), 54(3):1–40, 2021.
- Super-resolution image reconstruction: a technical overview. IEEE signal processing magazine, 20(3):21–36, 2003.
- Nanophotonic particle simulation and inverse design using artificial neural networks. Science advances, 4(6):eaar4206, 2018.
- Interpreting neural network models of residual scalar flux. Journal of Fluid Mechanics, 907:A23, 2021.
- L. Quartapelle. Numerical solution of the incompressible Navier-Stokes equations, volume 113. Birkhäuser, 2013.
- Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational Physics, 378:686–707, 2019.
- Discretizationnet: A machine-learning based solver for navier-stokes equations using finite volume discretization. arXiv preprint arXiv:2005.08357, 2020.
- Learning to simulate complex physics with graph networks. In International Conference on Machine Learning, pages 8459–8468. PMLR, 2020.
- G. S. Sidharth. A multiscale subgrid decomposition. AIAA Scitech 2020 Forum, page 0820, 2020.
- Multigrid. 2001.
- Scipy 1.0: fundamental algorithms for scientific computing in python. Nature methods, 17(3):261–272, 2020.
- Towards physics-informed deep learning for turbulent flow prediction. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pages 1457–1466, 2020.
- Machine-learning solver for modified diffusion equations. Physical Review E, 98(5):053304, 2018.
- Deep learning for single image super-resolution: A brief review. IEEE Transactions on Multimedia, 21(12):3106–3121, 2019.
- High-fidelity reconstruction of turbulent flow from spatially limited data using enhanced super-resolution generative adversarial network. Physics of Fluids, 33(12), 2021.
- A hybrid iterative numerical transferable solver (hints) for pdes based on deep operator network and relaxation methods. arXiv preprint arXiv:2208.13273, 2022.