A Generalized Surface Loss for Reducing the Hausdorff Distance in Medical Imaging Segmentation (2302.03868v3)
Abstract: Within medical imaging segmentation, the Dice coefficient and Hausdorff-based metrics are standard measures of success for deep learning models. However, modern loss functions for medical image segmentation often only consider the Dice coefficient or similar region-based metrics during training. As a result, segmentation architectures trained over such loss functions run the risk of achieving high accuracy for the Dice coefficient but low accuracy for Hausdorff-based metrics. Low accuracy on Hausdorff-based metrics can be problematic for applications such as tumor segmentation, where such benchmarks are crucial. For example, high Dice scores accompanied by significant Hausdorff errors could indicate that the predictions fail to detect small tumors. We propose the Generalized Surface Loss function, a novel loss function to minimize Hausdorff-based metrics with more desirable numerical properties than current methods and with weighting terms for class imbalance. Our loss function outperforms other losses when tested on the LiTS and BraTS datasets using the state-of-the-art nnUNet architecture. These results suggest we can improve medical imaging segmentation accuracy with our novel loss function.
- A novel focal tversky loss function with improved attention u-net for lesion segmentation. In 2019 IEEE 16th international symposium on biomedical imaging (ISBI 2019), pages 683–687. IEEE, 2019.
- Identification of kernels in a convolutional neural network: connections between the level set equation and deep learning for image segmentation. In Medical Imaging 2020: Image Processing, volume 11313, page 1131317. International Society for Optics and Photonics, 2020.
- The medical segmentation decathlon. Nature communications, 13(1):4128, 2022.
- Advancing pancreas segmentation in multi-protocol mri volumes using hausdorff-sine loss function. In Machine Learning in Medical Imaging: 10th International Workshop, MLMI 2019, Held in Conjunction with MICCAI 2019, Shenzhen, China, October 13, 2019, Proceedings 10, pages 27–35. Springer, 2019.
- Advancing the cancer genome atlas glioma mri collections with expert segmentation labels and radiomic features. Scientific Data, 4(1):170117, 2017.
- Identifying the best machine learning algorithms for brain tumor segmentation, progression assessment, and overall survival prediction in the brats challenge. arXiv preprint arXiv:1811.02629, 2018.
- Image segmentation, registration and characterization in r with simpleitk. Journal of statistical software, 86, 2018.
- Optimizing the dice score and jaccard index for medical image segmentation: Theory and practice. In Medical Image Computing and Computer Assisted Intervention–MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13–17, 2019, Proceedings, Part II 22, pages 92–100. Springer, 2019.
- The liver tumor segmentation benchmark (LiTS). arXiv preprint arXiv:1901.04056, 2019.
- Data augmentation and loss normalization for deep noise suppression. In International Conference on Speech and Computer, pages 79–86. Springer, 2020.
- Monai: An open-source framework for deep learning in healthcare. arXiv preprint arXiv:2211.02701, 2022.
- Pocketnet: A smaller neural network for medical image analysis. IEEE Transactions on Medical Imaging, 42(4):1172–1184, 2022.
- 3d u-net: learning dense volumetric segmentation from sparse annotation. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2016: 19th International Conference, Athens, Greece, October 17-21, 2016, Proceedings, Part II 19, pages 424–432. Springer, 2016.
- Robust rician noise estimation for mr images. Medical image analysis, 14(4):483–493, 2010.
- Generalized overlap measures for evaluation and validation in medical image analysis. IEEE transactions on medical imaging, 25(11):1451–1461, 2006.
- Lee R Dice. Measures of the amount of ecologic association between species. Ecology, 26(3):297–302, 1945.
- A review on ct image noise and its denoising. Biomedical Signal Processing and Control, 42:73–88, 2018.
- Fully automated brain resection cavity delineation for radiation target volume definition in glioblastoma patients using deep learning. Radiation Oncology, 15:1–10, 5 2020.
- The state of the art in kidney and kidney tumor segmentation in contrast-enhanced ct imaging: Results of the kits19 challenge. Medical image analysis, 67:101821, 2021.
- nnu-net: a self-configuring method for deep learning-based biomedical image segmentation. Nature Methods 2020 18:2, 18:203–211, 12 2020.
- nnu-net for brain tumor segmentation. In Alessandro Crimi and Spyridon Bakas, editors, Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries, pages 118–132, Cham, 2021. Springer International Publishing.
- Shruti Jadon. A survey of loss functions for semantic segmentation. In 2020 IEEE conference on computational intelligence in bioinformatics and computational biology (CIBCB), pages 1–7. IEEE, 2020.
- Reducing the hausdorff distance in medical image segmentation with convolutional neural networks. IEEE Transactions on Medical Imaging, 39(2):499–513, 2020.
- Boundary loss for highly unbalanced segmentation. Medical image analysis, 67:101851, 2021.
- Pytorch distributed: Experiences on accelerating data parallel training. arXiv preprint arXiv:2006.15704, 2020.
- Focal loss for dense object detection. In Proceedings of the IEEE international conference on computer vision, pages 2980–2988, 2017.
- Do we really need dice? the hidden region-size biases of segmentation losses. Medical Image Analysis, page 103015, 2023.
- The design of simpleitk. Frontiers in neuroinformatics, 7:45, 2013.
- Loss odyssey in medical image segmentation. Medical Image Analysis, 71:102035, 2021.
- Normalized loss functions for deep learning with noisy labels. In International conference on machine learning, pages 6543–6553. PMLR, 2020.
- A linear time algorithm for computing exact euclidean distance transforms of binary images in arbitrary dimensions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(2):265–270, 2003.
- Reduce noise in computed tomography image using adaptive gaussian filter. arXiv preprint arXiv:1902.05985, 2019.
- The multimodal brain tumor image segmentation benchmark (brats). IEEE Transactions on Medical Imaging, 34(10):1993–2024, 2015.
- V-net: Fully convolutional neural networks for volumetric medical image segmentation. In 2016 Fourth International Conference on 3D Vision (3DV), pages 565–571, 2016.
- Hausdorff distance based 3d quantification of brain tumor evolution from mri images. In 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pages 5597–5600, 2007.
- Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems, 32, 2019.
- U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18, pages 234–241. Springer, 2015.
- Tversky loss function for image segmentation using 3d fully convolutional deep networks. In International workshop on machine learning in medical imaging, pages 379–387. Springer, 2017.
- Automated medical image segmentation techniques. Journal of medical physics, 35(1):3, 2010.
- On estimation of bias field in mri images. In 2015 IEEE International Conference on Computer Graphics, Vision and Information Security (CGVIS), pages 269–274. IEEE, 2015.
- Generalised dice overlap as a deep learning loss function for highly unbalanced segmentations. In Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support: Third International Workshop, DLMIA 2017, and 7th International Workshop, ML-CDS 2017, Held in Conjunction with MICCAI 2017, Québec City, QC, Canada, September 14, Proceedings 3, pages 240–248. Springer, 2017.
- Loss weightings for improving imbalanced brain structure segmentation using fully convolutional networks. In Healthcare, volume 9, page 938. MDPI, 2021.
- Combo loss: Handling input and output imbalance in multi-organ segmentation. Computerized Medical Imaging and Graphics, 75:24–33, 2019.
- Metrics for evaluating 3d medical image segmentation: analysis, selection, and tool. BMC medical imaging, 15(1):1–28, 2015.
- Evaluation of an automatic segmentation algorithm for definition of head and neck organs at risk. Radiation Oncology, 9(1):1–12, 2014.
- 3d segmentation with exponential logarithmic loss for highly unbalanced object sizes. In Medical Image Computing and Computer Assisted Intervention–MICCAI 2018: 21st International Conference, Granada, Spain, September 16-20, 2018, Proceedings, Part III 11, pages 612–619. Springer, 2018.
- Simpleitk image-analysis notebooks: a collaborative environment for education and reproducible research. Journal of digital imaging, 31(3):290–303, 2018.
- Segmentation of coronary arteries images using spatio-temporal feature fusion network with combo loss. Cardiovascular Engineering and Technology, pages 1–12, 2022.
- Anatomynet: deep learning for fast and fully automated whole-volume segmentation of head and neck anatomy. Medical physics, 46(2):576–589, 2019.
- Adrian Celaya (11 papers)
- Beatrice Riviere (30 papers)
- David Fuentes (21 papers)