Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
157 tokens/sec
GPT-4o
43 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Uncertainty-aware Evidential Fusion-based Learning for Semi-supervised Medical Image Segmentation (2404.06177v2)

Published 9 Apr 2024 in cs.CV and cs.AI

Abstract: Although the existing uncertainty-based semi-supervised medical segmentation methods have achieved excellent performance, they usually only consider a single uncertainty evaluation, which often fails to solve the problem related to credibility completely. Therefore, based on the framework of evidential deep learning, this paper integrates the evidential predictive results in the cross-region of mixed and original samples to reallocate the confidence degree and uncertainty measure of each voxel, which is realized by emphasizing uncertain information of probability assignments fusion rule of traditional evidence theory. Furthermore, we design a voxel-level asymptotic learning strategy by introducing information entropy to combine with the fused uncertainty measure to estimate voxel prediction more precisely. The model will gradually pay attention to the prediction results with high uncertainty in the learning process, to learn the features that are difficult to master. The experimental results on LA, Pancreas-CT, ACDC and TBAD datasets demonstrate the superior performance of our proposed method in comparison with the existing state of the arts.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (53)
  1. Artificial intelligence with multi-functional machine learning platform development for better healthcare and precision medicine. Database 2020 (2020), baaa010.
  2. Deep evidential regression. Advances in Neural Information Processing Systems 33 (2020), 14927–14937.
  3. Pseudo-Labeling and Confirmation Bias in Deep Semi-Supervised Learning. In 2020 International Joint Conference on Neural Networks, IJCNN 2020, Glasgow, United Kingdom, July 19-24, 2020. IEEE, 1–8. https://doi.org/10.1109/IJCNN48605.2020.9207304
  4. Bidirectional Copy-Paste for Semi-Supervised Medical Image Segmentation. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023, Vancouver, BC, Canada, June 17-24, 2023. IEEE, 11514–11524. https://doi.org/10.1109/CVPR52729.2023.01108
  5. Bidirectional Copy-Paste for Semi-Supervised Medical Image Segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 11514–11524.
  6. Hritam Basak and Zhaozheng Yin. 2023. Pseudo-Label Guided Contrastive Learning for Semi-Supervised Medical Image Segmentation. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023, Vancouver, BC, Canada, June 17-24, 2023. IEEE, 19786–19797. https://doi.org/10.1109/CVPR52729.2023.01895
  7. Curriculum learning. In Proceedings of the 26th annual international conference on machine learning. 41–48.
  8. Deep learning techniques for automatic MRI cardiac multi-structures segmentation and diagnosis: is the problem solved? IEEE transactions on medical imaging 37, 11 (2018), 2514–2525.
  9. MixMatch: A Holistic Approach to Semi-Supervised Learning. In Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, December 8-14, 2019, Vancouver, BC, Canada, Hanna M. Wallach, Hugo Larochelle, Alina Beygelzimer, Florence d’Alché-Buc, Emily B. Fox, and Roman Garnett (Eds.). 5050–5060. https://proceedings.neurips.cc/paper/2019/hash/1cd138d0499a68f4bb72bee04bbec2d7-Abstract.html
  10. Fully automatic segmentation of type B aortic dissection from CTA images enabled by deep learning. European journal of radiology 121 (2019), 108713.
  11. Curriculum Labeling: Revisiting Pseudo-Labeling for Semi-Supervised Learning. In Thirty-Fifth AAAI Conference on Artificial Intelligence, AAAI 2021, Thirty-Third Conference on Innovative Applications of Artificial Intelligence, IAAI 2021, The Eleventh Symposium on Educational Advances in Artificial Intelligence, EAAI 2021, Virtual Event, February 2-9, 2021. AAAI Press, 6912–6920. https://doi.org/10.1609/aaai.v35i8.16852
  12. Arthur P. Dempster. 2008. Upper and Lower Probabilities Induced by a Multivalued Mapping. In Classic Works of the Dempster-Shafer Theory of Belief Functions, Ronald R. Yager and Liping Liu (Eds.). Studies in Fuzziness and Soft Computing, Vol. 219. Springer, 57–72. https://doi.org/10.1007/978-3-540-44792-4_3
  13. Uncertainty Estimation by Fisher Information-Based Evidential Deep Learning. In Proceedings of the 40th International Conference on Machine Learning (Honolulu, Hawaii, USA) (ICML’23). JMLR.org, Article 300, 21 pages.
  14. Unpaired multi-modal segmentation via knowledge distillation. IEEE transactions on medical imaging 39, 7 (2020), 2415–2425.
  15. UCC: Uncertainty guided Cross-head Co-training for Semi-Supervised Semantic Segmentation. CoRR abs/2205.10334 (2022). https://doi.org/10.48550/arXiv.2205.10334 arXiv:2205.10334
  16. Uncertainty-guided voxel-level supervised contrastive learning for semi-supervised medical image segmentation. International Journal of Neural Systems 32, 04 (2022), 2250016.
  17. ClassFormer: Exploring Class-Aware Dependency with Transformer for Medical Image Segmentation. In Thirty-Seventh AAAI Conference on Artificial Intelligence, AAAI 2023, Thirty-Fifth Conference on Innovative Applications of Artificial Intelligence, IAAI 2023, Thirteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2023, Washington, DC, USA, February 7-14, 2023, Brian Williams, Yiling Chen, and Jennifer Neville (Eds.). AAAI Press, 917–925. https://doi.org/10.1609/AAAI.V37I1.25171
  18. Fair Federated Medical Image Segmentation via Client Contribution Estimation. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023, Vancouver, BC, Canada, June 17-24, 2023. IEEE, 16302–16311. https://doi.org/10.1109/CVPR52729.2023.01564
  19. Audun Jøsang. 2002. Subjective evidential reasoning. In Proceedings of the International Conference on Information Processing and Management of Uncertainty (IPMU2002). Citeseer.
  20. Audun Jøsang. 2016. Subjective Logic - A Formalism for Reasoning Under Uncertainty. Springer. https://doi.org/10.1007/978-3-319-42337-1
  21. An evidential support accumulation model of subjective probability. Cognitive Psychology 46, 2 (2003), 152–197.
  22. Semantic segmentation with generative models: Semi-supervised learning and strong out-of-domain generalization. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 8300–8311.
  23. Shape-Aware Semi-supervised 3D Semantic Segmentation for Medical Images. In Medical Image Computing and Computer Assisted Intervention - MICCAI 2020 - 23rd International Conference, Lima, Peru, October 4-8, 2020, Proceedings, Part I (Lecture Notes in Computer Science, Vol. 12261), Anne L. Martel, Purang Abolmaesumi, Danail Stoyanov, Diana Mateus, Maria A. Zuluaga, S. Kevin Zhou, Daniel Racoceanu, and Leo Joskowicz (Eds.). Springer, 552–561. https://doi.org/10.1007/978-3-030-59710-8_54
  24. H-DenseUNet: hybrid densely connected UNet for liver and tumor segmentation from CT volumes. IEEE transactions on medical imaging 37, 12 (2018), 2663–2674.
  25. UPCoL: Uncertainty-Informed Prototype Consistency Learning for Semi-supervised Medical Image Segmentation. In International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 662–672.
  26. Semi-supervised Medical Image Segmentation through Dual-task Consistency. In Thirty-Fifth AAAI Conference on Artificial Intelligence, AAAI 2021, Thirty-Third Conference on Innovative Applications of Artificial Intelligence, IAAI 2021, The Eleventh Symposium on Educational Advances in Artificial Intelligence, EAAI 2021, Virtual Event, February 2-9, 2021. AAAI Press, 8801–8809. https://doi.org/10.1609/aaai.v35i10.17066
  27. Efficient Semi-supervised Gross Target Volume of Nasopharyngeal Carcinoma Segmentation via Uncertainty Rectified Pyramid Consistency. In Medical Image Computing and Computer Assisted Intervention - MICCAI 2021 - 24th International Conference, Strasbourg, France, September 27 - October 1, 2021, Proceedings, Part II (Lecture Notes in Computer Science, Vol. 12902), Marleen de Bruijne, Philippe C. Cattin, Stéphane Cotin, Nicolas Padoy, Stefanie Speidel, Yefeng Zheng, and Caroline Essert (Eds.). Springer, 318–329. https://doi.org/10.1007/978-3-030-87196-3_30
  28. V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation. In Fourth International Conference on 3D Vision, 3DV 2016, Stanford, CA, USA, October 25-28, 2016. IEEE Computer Society, 565–571. https://doi.org/10.1109/3DV.2016.79
  29. Reabal Najjar. 2023. Redefining Radiology: A Review of Artificial Intelligence Integration in Medical Imaging. Diagnostics 13, 17 (2023), 2760.
  30. Uncertainty-guided dual-views for semi-supervised volumetric medical image segmentation. Nature Machine Intelligence (2023), 1–15.
  31. In Defense of Pseudo-Labeling: An Uncertainty-Aware Pseudo-label Selection Framework for Semi-Supervised Learning. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021. OpenReview.net. https://openreview.net/forum?id=-ODN6SbiUU
  32. Deeporgan: Multi-level deep convolutional networks for automated pancreas segmentation. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part I 18. Springer, 556–564.
  33. Evidential Deep Learning to Quantify Classification Uncertainty. In Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, NeurIPS 2018, December 3-8, 2018, Montréal, Canada, Samy Bengio, Hanna M. Wallach, Hugo Larochelle, Kristen Grauman, Nicolò Cesa-Bianchi, and Roman Garnett (Eds.). 3183–3193. https://proceedings.neurips.cc/paper/2018/hash/a981f2b708044d6fb4a71a1463242520-Abstract.html
  34. Glenn Shafer. 2016. A Mathematical Theory of Evidence turns 40. Int. J. Approx. Reason. 79 (2016), 7–25. https://doi.org/10.1016/j.ijar.2016.07.009
  35. Claude E. Shannon. 1948. A mathematical theory of communication. Bell Syst. Tech. J. 27, 3 (1948), 379–423. https://doi.org/10.1002/J.1538-7305.1948.TB01338.X
  36. Inconsistency-Aware Uncertainty Estimation for Semi-Supervised Medical Image Segmentation. IEEE Trans. Medical Imaging 41, 3 (2022), 608–620. https://doi.org/10.1109/TMI.2021.3117888
  37. SDC-UDA: Volumetric Unsupervised Domain Adaptation Framework for Slice-Direction Continuous Cross-Modality Medical Image Segmentation. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023, Vancouver, BC, Canada, June 17-24, 2023. IEEE, 7412–7421. https://doi.org/10.1109/CVPR52729.2023.00716
  38. Antti Tarvainen and Harri Valpola. 2017. Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results. Advances in neural information processing systems 30 (2017).
  39. Haonan Wang and Xiaomeng Li. 2023. Towards Generic Semi-Supervised Framework for Volumetric Medical Image Segmentation. In Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 - 16, 2023, Alice Oh, Tristan Naumann, Amir Globerson, Kate Saenko, Moritz Hardt, and Sergey Levine (Eds.). http://papers.nips.cc/paper_files/paper/2023/hash/05dc08730e32441edff52b0fa6caab5f-Abstract-Conference.html
  40. Semi-supervised medical image segmentation via a tripled-uncertainty guided mean teacher model with contrastive learning. Medical Image Analysis 79 (2022), 102447.
  41. Semi-Supervised Learning by Augmented Distribution Alignment. In 2019 IEEE/CVF International Conference on Computer Vision, ICCV 2019, Seoul, Korea (South), October 27 - November 2, 2019. IEEE, 1466–1475. https://doi.org/10.1109/ICCV.2019.00155
  42. Fuping Wu and Xiahai Zhuang. 2023. Minimizing Estimated Risks on Unlabeled Data: A New Formulation for Semi-Supervised Medical Image Segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 45, 5 (2023), 6021–6036. https://doi.org/10.1109/TPAMI.2022.3215186
  43. Exploring Smoothness and Class-Separation for Semi-supervised Medical Image Segmentation. In Medical Image Computing and Computer Assisted Intervention - MICCAI 2022 - 25th International Conference, Singapore, September 18-22, 2022, Proceedings, Part V (Lecture Notes in Computer Science, Vol. 13435), Linwei Wang, Qi Dou, P. Thomas Fletcher, Stefanie Speidel, and Shuo Li (Eds.). Springer, 34–43. https://doi.org/10.1007/978-3-031-16443-9_4
  44. Semi-supervised Left Atrium Segmentation with Mutual Consistency Training. In Medical Image Computing and Computer Assisted Intervention - MICCAI 2021 - 24th International Conference, Strasbourg, France, September 27 - October 1, 2021, Proceedings, Part II (Lecture Notes in Computer Science, Vol. 12902), Marleen de Bruijne, Philippe C. Cattin, Stéphane Cotin, Nicolas Padoy, Stefanie Speidel, Yefeng Zheng, and Caroline Essert (Eds.). Springer, 297–306. https://doi.org/10.1007/978-3-030-87196-3_28
  45. Uncertainty-aware multi-view co-training for semi-supervised medical image segmentation and domain adaptation. Medical Image Anal. 65 (2020), 101766. https://doi.org/10.1016/j.media.2020.101766
  46. FUSSNet: Fusing Two Sources of Uncertainty for Semi-supervised Medical Image Segmentation. In International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 481–491.
  47. Dirichlet-based Uncertainty Calibration for Active Domain Adaptation. In The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023. OpenReview.net. https://openreview.net/pdf?id=4WM4cy42B81
  48. A global benchmark of algorithms for segmenting the left atrium from late gadolinium-enhanced cardiac magnetic resonance imaging. Medical image analysis 67 (2021), 101832.
  49. Enhancing pseudo label quality for semi-supervised domain-generalized medical image segmentation. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 36. 3099–3107.
  50. ImageTBAD: A 3D computed tomography angiography image dataset for automatic segmentation of type-B aortic dissection. Frontiers in Physiology 12 (2021), 732711.
  51. Uncertainty-Aware Self-ensembling Model for Semi-supervised 3D Left Atrium Segmentation. In Medical Image Computing and Computer Assisted Intervention - MICCAI 2019 - 22nd International Conference, Shenzhen, China, October 13-17, 2019, Proceedings, Part II (Lecture Notes in Computer Science, Vol. 11765), Dinggang Shen, Tianming Liu, Terry M. Peters, Lawrence H. Staib, Caroline Essert, Sean Zhou, Pew-Thian Yap, and Ali R. Khan (Eds.). Springer, 605–613. https://doi.org/10.1007/978-3-030-32245-8_67
  52. 3D graph anatomy geometry-integrated network for pancreatic mass segmentation, diagnosis, and quantitative patient management. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 13743–13752.
  53. A Savage-style Utility Theory for Belief Functions. In Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, IJCAI 2018, July 13-19, 2018, Stockholm, Sweden, Jérôme Lang (Ed.). ijcai.org, 5135–5141. https://doi.org/10.24963/IJCAI.2018/712

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets