Papers
Topics
Authors
Recent
Search
2000 character limit reached

Inpainting Computational Fluid Dynamics with Deep Learning

Published 27 Feb 2024 in cs.LG and physics.flu-dyn | (2402.17185v1)

Abstract: Fluid data completion is a research problem with high potential benefit for both experimental and computational fluid dynamics. An effective fluid data completion method reduces the required number of sensors in a fluid dynamics experiment, and allows a coarser and more adaptive mesh for a Computational Fluid Dynamics (CFD) simulation. However, the ill-posed nature of the fluid data completion problem makes it prohibitively difficult to obtain a theoretical solution and presents high numerical uncertainty and instability for a data-driven approach (e.g., a neural network model). To address these challenges, we leverage recent advancements in computer vision, employing the vector quantization technique to map both complete and incomplete fluid data spaces onto discrete-valued lower-dimensional representations via a two-stage learning procedure. We demonstrated the effectiveness of our approach on Kolmogorov flow data (Reynolds number: 1000) occluded by masks of different size and arrangement. Experimental results show that our proposed model consistently outperforms benchmark models under different occlusion settings in terms of point-wise reconstruction accuracy as well as turbulent energy spectrum and vorticity distribution.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (38)
  1. Yousif, M. Z.; Yu, L.; Lim, H.-C. High-fidelity reconstruction of turbulent flow from spatially limited data using enhanced super-resolution generative adversarial network. Physics of Fluids 2021, 33
  2. Fu, C.; Helwig, J.; Ji, S. Semi-Supervised Learning for High-Fidelity Fluid Flow Reconstruction. The Second Learning on Graphs Conference. 2023
  3. Zhu, J.-Y.; Park, T.; Isola, P.; Efros, A. A. Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks. 2020
  4. Goodfellow, I. J.; Pouget-Abadie, J.; Mirza, M.; Xu, B.; Warde-Farley, D.; Ozair, S.; Courville, A.; Bengio, Y. Generative Adversarial Networks. 2014
  5. Karras, T.; Laine, S.; Aila, T. A Style-Based Generator Architecture for Generative Adversarial Networks. 2019
  6. Li, Z.; Farimani, A. B. Learning Lagrangian fluid dynamics with graph neural networks. 2020,
  7. Hemmasian, A.; Farimani, A. B. Multi-scale Time-stepping of Partial Differential Equations with Transformers. arXiv preprint arXiv:2311.02225 2023,
  8. Lorsung, C.; Farimani, A. B. PICL: Physics Informed Contrastive Learning for Partial Differential Equations. arXiv preprint arXiv:2401.16327 2024,
  9. Lorsung, C.; Li, Z.; Barati Farimani, A. Physics Informed Token Transformer for Solving Partial Differential Equations. Machine Learning: Science and Technology 2024,
  10. Fukami, K.; Fukagata, K.; Taira, K. Machine-learning-based spatio-temporal super resolution reconstruction of turbulent flows. Journal of Fluid Mechanics 2021, 909
  11. Kim, H.; Kim, J.; Won, S.; Lee, C. Unsupervised deep learning for super-resolution reconstruction of turbulence. Journal of Fluid Mechanics 2021, 910
  12. de Avila Belbute-Peres, F.; Economon, T. D.; Kolter, J. Z. Combining Differentiable PDE Solvers and Graph Neural Networks for Fluid Flow Prediction. 2020
  13. Li, Z.; Li, T.; Farimani, A. B. TPU-GAN: Learning temporal coherence from dynamic point cloud sequences. International Conference on Learning Representations. 2021
  14. Sun, Z.; Yang, Y.; Yoo, S. A Neural PDE Solver with Temporal Stencil Modeling. 2023
  15. Li, Z.; Zheng, H.; Kovachki, N.; Jin, D.; Chen, H.; Liu, B.; Azizzadenesheli, K.; Anandkumar, A. Physics-Informed Neural Operator for Learning Partial Differential Equations. 2021; https://arxiv.org/abs/2111.03794
  16. Li, Z.; Meidani, K.; Farimani, A. B. Transformer for Partial Differential Equations’ Operator Learning. arXiv preprint arXiv:2205.13671 2022,
  17. Brandstetter, J.; Worrall, D.; Welling, M. Message Passing Neural PDE Solvers. 2022; https://arxiv.org/abs/2202.03376
  18. Pfaff, T.; Fortunato, M.; Sanchez-Gonzalez, A.; Battaglia, P. W. Learning Mesh-Based Simulation with Graph Networks. 2021
  19. Pathak, D.; Krähenbühl, P.; Donahue, J.; Darrell, T.; Efros, A. A. Context Encoders: Feature Learning by Inpainting. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2016; pp 2536–2544
  20. Song, S.; Yu, F.; Zeng, A.; Chang, A. X.; Savva, M.; Funkhouser, T. Semantic Scene Completion from a Single Depth Image. 2016
  21. Yu, J.; Lin, Z.; Yang, J.; Shen, X.; Lu, X.; Huang, T. S. Generative Image Inpainting With Contextual Attention. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2018
  22. Buzzicotti, M.; Bonaccorso, F.; Leoni, P. C. D.; Biferale, L. Reconstruction of turbulent data with deep generative models for semantic inpainting from TURB-Rot database. Physical Review Fluids 2021, 6
  23. Foucher, S.; Tang, J.; da Costa de Azevedo, V.; Kim, B.; Gross, M.; Solenthaler, B. Physics-Aware Flow Data Completion Using Neural Inpainting. 2020; https://openreview.net/forum?id=BylldxBYwH
  24. Ronneberger, O.; Fischer, P.; Brox, T. U-Net: Convolutional Networks for Biomedical Image Segmentation. 2015
  25. Li, J.; Wang, N.; Zhang, L.; Du, B.; Tao, D. Recurrent feature reasoning for image inpainting. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 2020; pp 7760–7768
  26. Yang, F.; Yang, H.; Fu, J.; Lu, H.; Guo, B. Learning texture transformer network for image super-resolution. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 2020; pp 5791–5800
  27. Song, Y.; Yang, C.; Shen, Y.; Wang, P.; Huang, Q.; Kuo, C.-C. J. Spg-net: Segmentation prediction and guidance network for image inpainting. arXiv preprint arXiv:1805.03356 2018,
  28. van den Oord, A.; Vinyals, O.; Kavukcuoglu, K. Neural Discrete Representation Learning. 2018
  29. Kingma, D. P.; Welling, M. Auto-Encoding Variational Bayes. 2022
  30. Razavi, A.; van den Oord, A.; Vinyals, O. Generating Diverse High-Fidelity Images with VQ-VAE-2. 2019
  31. Li, Z.; Kovachki, N. B.; Azizzadenesheli, K.; Bhattacharya, K.; Stuart, A.; Anandkumar, A.; others Fourier Neural Operator for Parametric Partial Differential Equations. International Conference on Learning Representations. 2020
  32. Li, Z.; Shu, D.; Barati Farimani, A. Scalable transformer for pde surrogate modeling. Advances in Neural Information Processing Systems 2024, 36
  33. Li, Z.; Patil, S.; Shu, D.; Farimani, A. B. Latent Neural PDE Solver for Time-dependent Systems. NeurIPS 2023 AI for Science Workshop. 2023
  34. Patil, S.; Li, Z.; Barati Farimani, A. Hyena neural operator for partial differential equations. APL Machine Learning 2023, 1
  35. Esser, P.; Rombach, R.; Ommer, B. Taming Transformers for High-Resolution Image Synthesis. 2021
  36. Van Den Oord, A.; Vinyals, O.; others Neural discrete representation learning. Advances in neural information processing systems 2017, 30
  37. Simonyan, K.; Zisserman, A. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 2014,
  38. Paszke, A. et al. PyTorch: An Imperative Style, High-Performance Deep Learning Library. 2019; https://arxiv.org/abs/1912.01703

Summary

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.