Automatic 3D Multi-modal Ultrasound Segmentation of Human Placenta using Fusion Strategies and Deep Learning (2401.09638v1)
Abstract: Purpose: Ultrasound is the most commonly used medical imaging modality for diagnosis and screening in clinical practice. Due to its safety profile, noninvasive nature and portability, ultrasound is the primary imaging modality for fetal assessment in pregnancy. Current ultrasound processing methods are either manual or semi-automatic and are therefore laborious, time-consuming and prone to errors, and automation would go a long way in addressing these challenges. Automated identification of placental changes at earlier gestation could facilitate potential therapies for conditions such as fetal growth restriction and pre-eclampsia that are currently detected only at late gestational age, potentially preventing perinatal morbidity and mortality. Methods: We propose an automatic three-dimensional multi-modal (B-mode and power Doppler) ultrasound segmentation of the human placenta using deep learning combined with different fusion strategies.We collected data containing Bmode and power Doppler ultrasound scans for 400 studies. Results: We evaluated different fusion strategies and state-of-the-art image segmentation networks for placenta segmentation based on standard overlap- and boundary-based metrics. We found that multimodal information in the form of B-mode and power Doppler scans outperform any single modality. Furthermore, we found that B-mode and power Doppler input scans fused at the data level provide the best results with a mean Dice Similarity Coefficient (DSC) of 0.849. Conclusion: We conclude that the multi-modal approach of combining B-mode and power Doppler scans is effective in segmenting the placenta from 3D ultrasound scans in a fully automated manner and is robust to quality variation of the datasets.
- Placental dysfunction underlies increased risk of fetal growth restriction and stillbirth in advanced maternal age women. Scientific Reports, 7(1):9677, Aug 2017. ISSN 2045-2322. 10.1038/s41598-017-09814-w.
- The human placenta project: its time for the real time. American Journal of Obstetrics & Gynecology, 213(4):S3–S5, Oct 2015. ISSN 0002-9378. 10.1016/j.ajog.2015.08.037.
- Placental flattening via volumetric parameterization. In Medical Image Computing and Computer Assisted Intervention – MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13–17, 2019, Proceedings, Part IV, page 39–47, Berlin, Heidelberg, 2019. Springer-Verlag. ISBN 978-3-030-32250-2. 10.1007/978-3-030-32251-9_5.
- Automatic 3d ultrasound segmentation of the first trimester placenta using deep learning. In 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017), pages 279–282, 2017. 10.1109/ISBI.2017.7950519.
- Automatic segmentation of human placenta images with u-net. IEEE Access, 7:180083–180092, 2019. 10.1109/ACCESS.2019.2958133.
- Deep learning strategies for ultrasound in pregnancy. EMJ Reproductive Health, Aug 2020. DOI/10.33590/emjreprohealth/20-00100.
- U-net: Convolutional networks for biomedical image segmentation. In Nassir Navab, Joachim Hornegger, William M. Wells, and Alejandro F. Frangi, editors, Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015, pages 234–241, Cham, 2015. Springer International Publishing. ISBN 978-3-319-24574-4.
- Unet++: A nested u-net architecture for medical image segmentation. In Danail Stoyanov, Zeike Taylor, Gustavo Carneiro, Tanveer Syeda-Mahmood, Anne Martel, Lena Maier-Hein, João Manuel R.S. Tavares, Andrew Bradley, João Paulo Papa, Vasileios Belagiannis, Jacinto C. Nascimento, Zhi Lu, Sailesh Conjeti, Mehdi Moradi, Hayit Greenspan, and Anant Madabhushi, editors, Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support, pages 3–11, Cham, 2018. Springer International Publishing. ISBN 978-3-030-00889-5.
- Multimodal deep learning for biomedical data fusion: a review. Briefings in Bioinformatics, 23(2), 01 2022. ISSN 1477-4054. 10.1093/bib/bbab569. bbab569.
- A review on data fusion of multidimensional medical and biomedical data. Molecules, 27(21), 2022. ISSN 1420-3049. 10.3390/molecules27217448. URL https://www.mdpi.com/1420-3049/27/21/7448.
- Placenta segmentation in ultrasound imaging: Addressing sources of uncertainty and limited field-of-view. Medical Image Analysis, 83:102639, 2023. ISSN 1361-8415. https://doi.org/10.1016/j.media.2022.102639.
- Perinatal, Preterm, and Paediatric Image Analysis, PIPPI Workshop, MICCAI 2016, Lecture Notes in Computer Science, 2016. Springer.
- 3-d ultrasound segmentation of the placenta using the random walker algorithm: Reliability and agreement. Ultrasound in Medicine and Biology, 41(12):3182–3193, Dec 2015. ISSN 0301-5629. 10.1016/j.ultrasmedbio.2015.07.021.
- Fully automated, real-time 3d ultrasound segmentation to estimate first trimester placental volume using deep learning. JCI Insight, 3(11), 6 2018. 10.1172/jci.insight.120178.
- Fully automated 3-d ultrasound segmentation of the placenta, amniotic fluid, and fetus for early pregnancy assessment. IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, 68(6):2038–2047, 2021. 10.1109/TUFFC.2021.3052143.
- Combining deep learning and multi-atlas label fusion for automated placenta segmentation from 3dus. In Andrew Melbourne, Roxane Licandro, Matthew DiFranco, Paolo Rota, Melanie Gau, Martin Kampel, Rosalind Aughwane, Pim Moeskops, Ernst Schwartz, Emma Robinson, and Antonios Makropoulos, editors, Data Driven Treatment Response Assessment and Preterm, Perinatal, and Paediatric Image Analysis, pages 138–148, Cham, 2018. Springer International Publishing. ISBN 978-3-030-00807-9.
- Automated placenta segmentation with a convolutional neural network weighted by acoustic shadow detection. In 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pages 6718–6723, 2019. 10.1109/EMBC.2019.8857448.
- Towards automated semantic segmentation in prenatal volumetric ultrasound. IEEE Transactions on Medical Imaging, 38(1):180–193, 2019. 10.1109/TMI.2018.2858779.
- Minimally interactive placenta segmentation from three-dimensional ultrasound images. Journal of Medical Imaging, 7(1):1 – 14, 2020. 10.1117/1.JMI.7.1.014004.
- Automatic segmentation of the placenta and its peripheral vasculature in volumetric ultrasound for ttts fetal surgery. In 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019), pages 772–775, 2019. 10.1109/ISBI.2019.8759296.