Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
129 tokens/sec
GPT-4o
28 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Physics-guided Full Waveform Inversion using Encoder-Solver Convolutional Neural Networks (2405.17696v1)

Published 27 May 2024 in cs.LG and physics.comp-ph

Abstract: Full Waveform Inversion (FWI) is an inverse problem for estimating the wave velocity distribution in a given domain, based on observed data on the boundaries. The inversion is computationally demanding because we are required to solve multiple forward problems, either in time or frequency domains, to simulate data that are then iteratively fitted to the observed data. We consider FWI in the frequency domain, where the Helmholtz equation is used as a forward model, and its repeated solution is the main computational bottleneck of the inversion process. To ease this cost, we integrate a learning process of an encoder-solver preconditioner that is based on convolutional neural networks (CNNs). The encoder-solver is trained to effectively precondition the discretized Helmholtz operator given velocity medium parameters. Then, by re-training the CNN between the iterations of the optimization process, the encoder-solver is adapted to the iteratively evolving velocity medium as part of the inversion. Without retraining, the performance of the solver deteriorates as the medium changes. Using our light retraining procedures, we obtain the forward simulations effectively throughout the process. We demonstrate our approach to solving FWI problems using 2D geophysical models with high-frequency data.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (60)
  1. Deep recurrent architectures for seismic tomography. In 81st EAGE Conference and Exhibition 2019, pages 1–5. European Association of Geoscientists & Engineers, 2019.
  2. Wavefield solutions from machine learned functions that approximately satisfy the wave equation. In EAGE 2020 annual conference & exhibition online, pages 1–5. European Association of Geoscientists & Engineers, 2020.
  3. 3-d salt and overthrust models: Soc. Expl. Geophy, 1997.
  4. Deep-learning tomography. The Leading Edge, 37(1):58–66, 2018.
  5. Randomized algorithms for estimating the trace of an implicit symmetric positive semi-definite matrix. Journal of the ACM (JACM), 58(2):1–34, 2011.
  6. Multigrid-augmented deep learning preconditioners for the Helmholtz equation. SIAM Journal on Scientific Computing, 0:S127–S151, 2022.
  7. Robust full waveform inversion: A source wavelet manipulation perspective. SIAM Journal on Scientific Computing, 45(6):B753–B775, 2023.
  8. Strong solutions for pde-based tomography by unsupervised learning. SIAM Journal on Imaging Sciences, 14(1):128–155, 2021.
  9. Automatic differentiation in machine learning: a survey. Journal of machine learning research, 18(153):1–43, 2018.
  10. Marmousi, model and data. In EAEG workshop-practical aspects of seismic data inversion, pages cp–108. European Association of Geoscientists & Engineers, 1990.
  11. Full waveform inversion using extended and simultaneous sources. SIAM Journal on Scientific Computing, 2021.
  12. An improved two-grid preconditioner for the solution of three-dimensional helmholtz problems in heterogeneous media. Numerical Linear Algebra with Applications, 20(4):663–688, 2013.
  13. Self-supervised, active learning seismic full waveform inversion. Geophysics, 89(2):1–93, 2023.
  14. Efficient inversion of multiple-scattering model for optical diffraction tomography. Optics express, 25:21786–21800, 2017.
  15. Absorbing boundary conditions for numerical simulation of waves. Proceedings of the National Academy of Sciences, 74(5):1765–1766, 1977.
  16. Radiation boundary conditions for acoustic and elastic wave calculations. Communications on pure and applied mathematics, 32(3):313–357, 1979.
  17. A novel multigrid based preconditioner for heterogeneous helmholtz problems. SIAM Journal on Scientific Computing, 27(4):1471–1492, 2006.
  18. Simplifying full waveform inversion via domain-independent self-supervised learning. arXiv preprint arXiv:2305.13314, 2023.
  19. JFB: Jacobian-free backpropagation for implicit networks. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 36, pages 6648–6656, 2022.
  20. Encoder–decoder architecture for 3d seismic inversion. Sensors, 23(1):61, 2022.
  21. Deep compressed learning for 3d seismic inversion. In SEG International Exposition and Annual Meeting, pages SEG–2023. SEG, 2023.
  22. Preconditioned all-at-once methods for large, sparse parameter estimation problems. Inverse Problems, 17(6):1847, 2001.
  23. An effective method for parameter estimation with pde constraints with multiple right-hand sides. SIAM Journal on Optimization, 22(3):739–757, 2012.
  24. Unsupervised learning of full-waveform inversion: Connecting cnn and partial differential equation in a loop. arXiv preprint arXiv:2110.07584, 2021.
  25. Perceptual losses for real-time style transfer and super-resolution. European Conference on Computer Vision, pages 694–711, 2016.
  26. Geophysical inversion versus machine learning in inverse problems. The Leading Edge, 37(12):894–901, 2018.
  27. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
  28. Imagenet classification with deep convolutional neural networks. Communications of the ACM, 60(6):84–90, 2017.
  29. Full-waveform inversion imaging of the human brain. NPJ digital medicine, pages 1–12, 2020.
  30. Deep learning. nature, 521(7553):436–444, 2015.
  31. Multigrid-augmented deep learning preconditioners for the helmholtz equation using compact implicit layers, 2024.
  32. Deep-learning inversion of seismic data. IEEE Transactions on Geoscience and Remote Sensing, 58(3):2135–2149, 2020.
  33. Full-waveform inversion with extrapolated low-frequency data. Geophysics, 81(6):R339–R348, 2016.
  34. Deep magnetic resonance image reconstruction: Inverse problems meet neural networks. IEEE Signal Processing Magazine, 37(1):141–151, 2020.
  35. Simultaneous-shot inversion for pde-constrained optimization problems with missing data. Inverse Problems, 35(2):025003, 2018.
  36. Using deep neural networks for inverse problems in imaging: beyond analytical methods. IEEE Signal Processing Magazine, 35(1):20–36, 2018.
  37. Full waveform inversion and the truncated newton method. SIAM review, 59(1):153–195, 2017.
  38. Deep pre-trained fwi: where supervised learning meets the physics-informed neural networks. Geophysical Journal International, 235(1):119–134, 2023.
  39. Deep learning for low-frequency extrapolation from multioffset seismic data. Geophysics, 84(6):R989–R1001, 2019.
  40. Automatic velocity analysis using convolutional neural network and transfer learning. Geophysics, 85(1):V33–V43, 2020.
  41. R Gerhard Pratt. Seismic waveform inversion in the frequency domain, part 1: Theory and verification in a physical scale model. Geophysics, 64(3):888–901, 1999.
  42. Gauss–newton and full newton methods in frequency–space seismic waveform inversion. Geophysical journal international, 133(2):341–362, 1998.
  43. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational Physics, 378:686–707, 2019.
  44. Physics-informed neural networks (pinns) for wave propagation and full waveform inversions. Journal of Geophysical Research: Solid Earth, 127(5):e2021JB023120, 2022.
  45. Alan Richardson. Seismic full-waveform inversion using deep learning tools and techniques. arXiv preprint arXiv:1801.07232, 2018.
  46. Nonlinear total variation based noise removal algorithms. Physica D: nonlinear phenomena, 60(1-4):259–268, 1992.
  47. Ultrasonic computed tomography based on full-waveform inversion for bone quantitative imaging. Physics in Medicine & Biology, 62, 2017.
  48. Embedding deep learning in inverse scattering problems. IEEE Transactions on Computational Imaging, 6:46–56, 2019.
  49. Solving the frequency-domain acoustic vti wave equation using physics-informed neural networks. Geophysical Journal International, 225(2):846–859, 2021.
  50. A versatile framework to solve the helmholtz equation using physics-informed neural networks. Geophysical Journal International, 228(3):1750–1762, 2022.
  51. A helmholtz equation solver using unsupervised learning: Application to transcranial ultrasound. Journal of computational physics, 441:110430, 2021.
  52. Extrapolated full-waveform inversion with deep learning. Geophysics, 85(3):R275–R288, 2020.
  53. Implicit seismic full waveform inversion with deep neural representation. Journal of Geophysical Research: Solid Earth, 128(3):e2022JB025964, 2023.
  54. Going deeper with convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1–9, 2015.
  55. Mesh-free eulerian physics-informed neural networks. arXiv preprint arXiv:2206.01545, 2022.
  56. Full waveform inversion guided by travel time tomography. SIAM Journal on Scientific Computing, 39(5):S587–S609, 2017.
  57. An overview of full-waveform inversion in exploration geophysics. Geophysics, 74(6):WCC1–WCC26, 2009.
  58. Eikonal solution using physics-informed neural networks. In EAGE 2020 annual conference & exhibition online, pages 1–5. European Association of Geoscientists & Engineers, 2020.
  59. Seismic waveform inversion with source manipulation. In 82nd EAGE Annual Conference & Exhibition, pages 1–5. European Association of Geoscientists & Engineers, 2021.
  60. InversionNet: An efficient and accurate data-driven full waveform inversion. IEEE Transactions on Computational Imaging, 6:419–433, 2019.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets