Experimental Validation of Ultrasound Beamforming with End-to-End Deep Learning for Single Plane Wave Imaging (2404.14188v1)
Abstract: Ultrafast ultrasound imaging insonifies a medium with one or a combination of a few plane waves at different beam-steered angles instead of many focused waves. It can achieve much higher frame rates, but often at the cost of reduced image quality. Deep learning approaches have been proposed to mitigate this disadvantage, in particular for single plane wave imaging. Predominantly, image-to-image post-processing networks or fully learned data-to-image neural networks are used. Both construct their mapping purely data-driven and require expressive networks and large amounts of training data to perform well. In contrast, we consider data-to-image networks which incorporate a conventional image formation techniques as differentiable layers in the network architecture. This allows for end-to-end training with small amounts of training data. In this work, using f-k migration as an image formation layer is evaluated in-depth with experimental data. We acquired a data collection designed for benchmarking data-driven plane wave imaging approaches using a realistic breast mimicking phantom and an ultrasound calibration phantom. The evaluation considers global and local image similarity measures and contrast, resolution and lesion detectability analysis. The results show that the proposed network architecture is capable of improving the image quality of single plane wave images on all evaluation metrics. Furthermore, these image quality improvements can be achieved with surprisingly little amounts of training data.
- B. Luijten, R. Cohen, F. J. de Bruijn, H. A. W. Schmeitz, M. Mischi, Y. C. Eldar, and R. J. G. van Sloun, “Adaptive ultrasound beamforming using deep learning,” IEEE transactions on medical imaging, vol. 39, no. 12, pp. 3967–3978, 2020.
- G. S. Alberti, H. Ammari, F. Romero, and T. Wintz, “Mathematical analysis of ultrafast ultrasound imaging,” SIAM journal on applied mathematics, vol. 77, no. 1, pp. 1–25, 2017.
- M. Tanter and M. Fink, “Ultrafast imaging in biomedical ultrasound,” IEEE transactions on ultrasonics, ferroelectrics, and frequency control, vol. 61, no. 1, pp. 102–119, 2014.
- J. Bercoff, M. Tanter, and M. Fink, “Supersonic shear imaging: a new technique for soft tissue elasticity mapping,” IEEE transactions on ultrasonics, ferroelectrics, and frequency control, vol. 51, no. 4, pp. 396–409, 2004.
- C. Errico, J. Pierre, S. Pezet, Y. Desailly, Z. Lenkei, O. Couture, and M. Tanter, “Ultrafast ultrasound localization microscopy for deep super-resolution vascular imaging,” Nature (London), vol. 527, no. 7579, pp. 499–502, 2015.
- G. Montaldo, M. Tanter, J. Bercoff, N. Benech, and M. Fink, “Coherent plane-wave compounding for very high frame rate ultrasonography and transient elastography,” IEEE transactions on ultrasonics, ferroelectrics, and frequency control, vol. 56, no. 3, pp. 489–506, 2009.
- K. Kim, S. Park, J. Kim, S.-B. Park, and M. Bae, “A fast minimum variance beamforming method using principal component analysis,” IEEE transactions on ultrasonics, ferroelectrics, and frequency control, vol. 61, no. 6, pp. 930–945, 2014.
- J. Zhang, Q. He, Y. Xiao, H. Zheng, C. Wang, and J. Luo, “Ultrasound image reconstruction from plane wave radio-frequency data by self-supervised deep neural network,” Medical image analysis, vol. 70, pp. 102 018–102 018, 2021.
- J. Cruza, J. Camacho, and C. Fritsch, “Plane-wave phase-coherence imaging for nde,” NDT & E international : independent nondestructive testing and evaluation, vol. 87, pp. 31–37, 2017.
- R. J. G. van Sloun, R. Cohen, and Y. C. Eldar, “Deep learning in ultrasound imaging,” Proceedings of the IEEE, vol. 108, no. 1, pp. 11–29, 2020.
- A. A. Nair, T. D. Tran, A. Reiter, and M. A. Lediju Bell, “A deep learning based alternative to beamforming ultrasound images,” in 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2018, pp. 3359–3363.
- H. Strohm, S. Rothlübbers, K. Eickel, and M. Günther, “Deep learning-based reconstruction of ultrasound images from raw channel data,” International journal for computer assisted radiology and surgery, vol. 15, no. 9, pp. 1487–1490, 2020.
- M. Gasse, F. Millioz, E. Roux, D. Garcia, H. Liebgott, and D. Friboulet, “High-quality plane wave compounding using convolutional neural networks,” IEEE transactions on ultrasonics, ferroelectrics, and frequency control, vol. 64, no. 10, pp. 1637–1639, 2017.
- A. Wiacek, E. Gonzalez, and M. A. L. Bell, “Coherenet: A deep learning architecture for ultrasound spatial correlation estimation and coherence-based beamforming,” IEEE transactions on ultrasonics, ferroelectrics, and frequency control, vol. 67, no. 12, pp. 2574–2583, 2020.
- C. Yang, Y. Jiao, T. Jiang, Y. Xu, and Y. Cui, “A united sign coherence factor beamformer for coherent plane-wave compounding with improved contrast,” Applied sciences, vol. 10, no. 7, pp. 2250–, 2020.
- D. Hyun, A. Wiacek, S. Goudarzi, S. Rothlubbers, A. Asif, K. Eickel, Y. C. Eldar, J. Huang, M. Mischi, H. Rivaz, D. Sinden, R. J. G. van Sloun, H. Strohm, and M. A. L. Bell, “Deep learning for ultrasound image formation: Cubdl evaluation framework and open datasets,” IEEE transactions on ultrasonics, ferroelectrics, and frequency control, vol. 68, no. 12, pp. 3466–3483, 2021.
- G. Pilikos, C. L. de Korte, T. van Leeuwen, and F. Lucka, “Single plane-wave imaging using physics-based deep learning,” in 2021 IEEE International Ultrasonics Symposium (IUS). IEEE, sep 2021. [Online]. Available: https://doi.org/10.1109%2Fius52206.2021.9593589
- R. A. Schoop, “Ultrasound Plane Wave Raw Data 75 Angles - Breast Phantom and Calibration Phantom Dataset,” Jun. 2023. [Online]. Available: https://doi.org/10.5281/zenodo.7986407
- G. F. Margrave. (2003) Numerical methods of exploration seismology. [Online]. Available: https://www.crewes.org/ResearchLinks/FreeSoftware/NumMeth.pdf
- D. Garcia, L. L. Tarnec, S. Muth, E. Montagnon, J. Porée, and G. Cloutier, “Stolt’s f-k migration for plane wave ultrasound imaging,” IEEE transactions on ultrasonics, ferroelectrics, and frequency control, vol. 60, no. 9, pp. 1853–1867, 2013.
- A. Paszke, S. Gross, F. Massa, A. Lerer, J. Bradbury, G. Chanan, T. Killeen, Z. Lin, N. Gimelshein, L. Antiga, A. Desmaison, A. Kopf, E. Yang, Z. DeVito, M. Raison, A. Tejani, S. Chilamkurthy, B. Steiner, L. Fang, J. Bai, and S. Chintala, “Pytorch: An imperative style, high-performance deep learning library,” in Advances in Neural Information Processing Systems 32. Curran Associates, Inc., 2019, pp. 8024–8035. [Online]. Available: http://papers.neurips.cc/paper/9015-pytorch-an-imperative-style-high-performance-deep-learning-library.pdf
- S. Qiao, H. Wang, C. Liu, W. Shen, and A. Yuille, “Micro-batch training with batch-channel normalization and weight standardization,” 2019.
- Y. Wu and K. He, “Group normalization,” International journal of computer vision, vol. 128, no. 3, pp. 742–755, 2019.
- A. Rodriguez-Molares, O. M. H. Rindal, J. D’hooge, S.-E. Masoy, A. Austeng, M. A. Lediju Bell, and H. Torp, “The generalized contrast-to-noise ratio: A formal definition for lesion detectability,” IEEE transactions on ultrasonics, ferroelectrics, and frequency control, vol. 67, no. 4, pp. 745–759, 2020.
- A. A. Nair, K. N. Washington, T. D. Tran, A. Reiter, and M. A. L. Bell, “Deep learning to obtain simultaneous image and segmentation outputs from a single input of raw ultrasound channel data,” IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, 2020.
- E. Dahan and I. Cohen, “Deep-learning-based multitask ultrasound beamforming,” Information (Basel), vol. 14, no. 10, pp. 582–, 2023.
- D. C. Lepcha, B. Goyal, A. Dogra, and V. Goyal, “Image super-resolution: A comprehensive review, recent trends, challenges and applications,” Information Fusion, vol. 91, pp. 230–260, 2023. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S1566253522001762
- H. Zhao, O. Gallo, I. Frosio, and J. Kautz, “Loss functions for image restoration with neural networks,” IEEE Transactions on Computational Imaging, vol. 3, no. 1, pp. 47–57, 2017.
- Y. Blau and T. Michaeli, “The perception-distortion tradeoff,” in 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018, pp. 6228–6237.
- Ryan A. L. Schoop (1 paper)
- Gijs Hendriks (1 paper)
- Tristan van Leeuwen (43 papers)
- Chris L. de Korte (4 papers)
- Felix Lucka (35 papers)