Inpainting Computational Fluid Dynamics with Deep Learning
Abstract: Fluid data completion is a research problem with high potential benefit for both experimental and computational fluid dynamics. An effective fluid data completion method reduces the required number of sensors in a fluid dynamics experiment, and allows a coarser and more adaptive mesh for a Computational Fluid Dynamics (CFD) simulation. However, the ill-posed nature of the fluid data completion problem makes it prohibitively difficult to obtain a theoretical solution and presents high numerical uncertainty and instability for a data-driven approach (e.g., a neural network model). To address these challenges, we leverage recent advancements in computer vision, employing the vector quantization technique to map both complete and incomplete fluid data spaces onto discrete-valued lower-dimensional representations via a two-stage learning procedure. We demonstrated the effectiveness of our approach on Kolmogorov flow data (Reynolds number: 1000) occluded by masks of different size and arrangement. Experimental results show that our proposed model consistently outperforms benchmark models under different occlusion settings in terms of point-wise reconstruction accuracy as well as turbulent energy spectrum and vorticity distribution.
- Yousif, M. Z.; Yu, L.; Lim, H.-C. High-fidelity reconstruction of turbulent flow from spatially limited data using enhanced super-resolution generative adversarial network. Physics of Fluids 2021, 33
- Fu, C.; Helwig, J.; Ji, S. Semi-Supervised Learning for High-Fidelity Fluid Flow Reconstruction. The Second Learning on Graphs Conference. 2023
- Zhu, J.-Y.; Park, T.; Isola, P.; Efros, A. A. Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks. 2020
- Goodfellow, I. J.; Pouget-Abadie, J.; Mirza, M.; Xu, B.; Warde-Farley, D.; Ozair, S.; Courville, A.; Bengio, Y. Generative Adversarial Networks. 2014
- Karras, T.; Laine, S.; Aila, T. A Style-Based Generator Architecture for Generative Adversarial Networks. 2019
- Li, Z.; Farimani, A. B. Learning Lagrangian fluid dynamics with graph neural networks. 2020,
- Hemmasian, A.; Farimani, A. B. Multi-scale Time-stepping of Partial Differential Equations with Transformers. arXiv preprint arXiv:2311.02225 2023,
- Lorsung, C.; Farimani, A. B. PICL: Physics Informed Contrastive Learning for Partial Differential Equations. arXiv preprint arXiv:2401.16327 2024,
- Lorsung, C.; Li, Z.; Barati Farimani, A. Physics Informed Token Transformer for Solving Partial Differential Equations. Machine Learning: Science and Technology 2024,
- Fukami, K.; Fukagata, K.; Taira, K. Machine-learning-based spatio-temporal super resolution reconstruction of turbulent flows. Journal of Fluid Mechanics 2021, 909
- Kim, H.; Kim, J.; Won, S.; Lee, C. Unsupervised deep learning for super-resolution reconstruction of turbulence. Journal of Fluid Mechanics 2021, 910
- de Avila Belbute-Peres, F.; Economon, T. D.; Kolter, J. Z. Combining Differentiable PDE Solvers and Graph Neural Networks for Fluid Flow Prediction. 2020
- Li, Z.; Li, T.; Farimani, A. B. TPU-GAN: Learning temporal coherence from dynamic point cloud sequences. International Conference on Learning Representations. 2021
- Sun, Z.; Yang, Y.; Yoo, S. A Neural PDE Solver with Temporal Stencil Modeling. 2023
- Li, Z.; Zheng, H.; Kovachki, N.; Jin, D.; Chen, H.; Liu, B.; Azizzadenesheli, K.; Anandkumar, A. Physics-Informed Neural Operator for Learning Partial Differential Equations. 2021; https://arxiv.org/abs/2111.03794
- Li, Z.; Meidani, K.; Farimani, A. B. Transformer for Partial Differential Equations’ Operator Learning. arXiv preprint arXiv:2205.13671 2022,
- Brandstetter, J.; Worrall, D.; Welling, M. Message Passing Neural PDE Solvers. 2022; https://arxiv.org/abs/2202.03376
- Pfaff, T.; Fortunato, M.; Sanchez-Gonzalez, A.; Battaglia, P. W. Learning Mesh-Based Simulation with Graph Networks. 2021
- Pathak, D.; Krähenbühl, P.; Donahue, J.; Darrell, T.; Efros, A. A. Context Encoders: Feature Learning by Inpainting. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2016; pp 2536–2544
- Song, S.; Yu, F.; Zeng, A.; Chang, A. X.; Savva, M.; Funkhouser, T. Semantic Scene Completion from a Single Depth Image. 2016
- Yu, J.; Lin, Z.; Yang, J.; Shen, X.; Lu, X.; Huang, T. S. Generative Image Inpainting With Contextual Attention. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2018
- Buzzicotti, M.; Bonaccorso, F.; Leoni, P. C. D.; Biferale, L. Reconstruction of turbulent data with deep generative models for semantic inpainting from TURB-Rot database. Physical Review Fluids 2021, 6
- Foucher, S.; Tang, J.; da Costa de Azevedo, V.; Kim, B.; Gross, M.; Solenthaler, B. Physics-Aware Flow Data Completion Using Neural Inpainting. 2020; https://openreview.net/forum?id=BylldxBYwH
- Ronneberger, O.; Fischer, P.; Brox, T. U-Net: Convolutional Networks for Biomedical Image Segmentation. 2015
- Li, J.; Wang, N.; Zhang, L.; Du, B.; Tao, D. Recurrent feature reasoning for image inpainting. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 2020; pp 7760–7768
- Yang, F.; Yang, H.; Fu, J.; Lu, H.; Guo, B. Learning texture transformer network for image super-resolution. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 2020; pp 5791–5800
- Song, Y.; Yang, C.; Shen, Y.; Wang, P.; Huang, Q.; Kuo, C.-C. J. Spg-net: Segmentation prediction and guidance network for image inpainting. arXiv preprint arXiv:1805.03356 2018,
- van den Oord, A.; Vinyals, O.; Kavukcuoglu, K. Neural Discrete Representation Learning. 2018
- Kingma, D. P.; Welling, M. Auto-Encoding Variational Bayes. 2022
- Razavi, A.; van den Oord, A.; Vinyals, O. Generating Diverse High-Fidelity Images with VQ-VAE-2. 2019
- Li, Z.; Kovachki, N. B.; Azizzadenesheli, K.; Bhattacharya, K.; Stuart, A.; Anandkumar, A.; others Fourier Neural Operator for Parametric Partial Differential Equations. International Conference on Learning Representations. 2020
- Li, Z.; Shu, D.; Barati Farimani, A. Scalable transformer for pde surrogate modeling. Advances in Neural Information Processing Systems 2024, 36
- Li, Z.; Patil, S.; Shu, D.; Farimani, A. B. Latent Neural PDE Solver for Time-dependent Systems. NeurIPS 2023 AI for Science Workshop. 2023
- Patil, S.; Li, Z.; Barati Farimani, A. Hyena neural operator for partial differential equations. APL Machine Learning 2023, 1
- Esser, P.; Rombach, R.; Ommer, B. Taming Transformers for High-Resolution Image Synthesis. 2021
- Van Den Oord, A.; Vinyals, O.; others Neural discrete representation learning. Advances in neural information processing systems 2017, 30
- Simonyan, K.; Zisserman, A. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 2014,
- Paszke, A. et al. PyTorch: An Imperative Style, High-Performance Deep Learning Library. 2019; https://arxiv.org/abs/1912.01703
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.