Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
126 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

An Evidential-enhanced Tri-Branch Consistency Learning Method for Semi-supervised Medical Image Segmentation (2404.07032v1)

Published 10 Apr 2024 in cs.CV

Abstract: Semi-supervised segmentation presents a promising approach for large-scale medical image analysis, effectively reducing annotation burdens while achieving comparable performance. This methodology holds substantial potential for streamlining the segmentation process and enhancing its feasibility within clinical settings for translational investigations. While cross-supervised training, based on distinct co-training sub-networks, has become a prevalent paradigm for this task, addressing critical issues such as predication disagreement and label-noise suppression requires further attention and progress in cross-supervised training. In this paper, we introduce an Evidential Tri-Branch Consistency learning framework (ETC-Net) for semi-supervised medical image segmentation. ETC-Net employs three branches: an evidential conservative branch, an evidential progressive branch, and an evidential fusion branch. The first two branches exhibit complementary characteristics, allowing them to address prediction diversity and enhance training stability. We also integrate uncertainty estimation from the evidential learning into cross-supervised training, mitigating the negative impact of erroneous supervision signals. Additionally, the evidential fusion branch capitalizes on the complementary attributes of the first two branches and leverages an evidence-based Dempster-Shafer fusion strategy, supervised by more reliable and accurate pseudo-labels of unlabeled data. Extensive experiments conducted on LA, Pancreas-CT, and ACDC datasets demonstrate that ETC-Net surpasses other state-of-the-art methods for semi-supervised segmentation. The code will be made available in the near future at https://github.com/Medsemiseg.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (45)
  1. J. Wang, C. Zhong, C. Feng, Y. Zhang, J. Sun, and Y. Yokota, “Disentangled representation for cross-domain medical image segmentation,” IEEE Transactions on Instrumentation and Measurement, vol. 72, pp. 1–15, 2022.
  2. A. Lin, B. Chen, J. Xu, Z. Zhang, G. Lu, and D. Zhang, “Ds-transunet: Dual swin transformer u-net for medical image segmentation,” IEEE Transactions on Instrumentation and Measurement, vol. 71, pp. 1–15, 2022.
  3. N. Painchaud, Y. Skandarani, Judge, and et al, “Cardiac segmentation with strong anatomical guarantees,” IEEE Transactions on Medical IFmaging, vol. 39, no. 11, pp. 3703–3713, 2020.
  4. Y. Xu, K. Feng, X. Yan, X. Sheng, B. Sun, Z. Liu, and R. Yan, “Cross-modal fusion convolutional neural networks with online soft label training strategy for mechanical fault diagnosis,” IEEE Transactions on Industrial Informatics, 2023.
  5. R. Zhao, R. Yan, Z. Chen, K. Mao, P. Wang, and R. X. Gao, “Deep learning and its applications to machine health monitoring,” Mechanical Systems and Signal Processing, vol. 115, pp. 213–237, 2019.
  6. S. Feng and et al, “Cpfnet: Context pyramid fusion network for medical image segmentation,” IEEE Transactions on Medical Imaging, vol. 39, no. 10, pp. 3008–3018, 2020.
  7. V. Cheplygina and et al, “Not-so-supervised: a survey of semi-supervised, multi-instance, and transfer learning in medical image analysis,” Medical Image Analysis, vol. 54, pp. 280–296, 2019.
  8. A. Tarvainen and H. Valpola, “Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results,” Advances in Neural Information Processing Systems, vol. 30, 2017.
  9. X. Luo, W. Liao, J. Chen, T. Song, G. Wang, S. Zhang, and et al, “Efficient semi-supervised gross target volume of nasopharyngeal carcinoma segmentation via uncertainty rectified pyramid consistency,” in MICCAI.   Springer, 2021, pp. 318–329.
  10. Y. Ouali, C. Hudelot, and M. Tami, “Semi-supervised semantic segmentation with cross-consistency training,” in CVPR, 2020, pp. 12 674–12 684.
  11. L. Yang, W. Zhuo, L. Qi, Y. Shi, and Y. Gao, “St++: Make self-training work better for semi-supervised semantic segmentation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 4268–4277.
  12. E. Arazo, D. Ortego, P. Albert, N. E. O’Connor, and K. McGuinness, “Pseudo-labeling and confirmation bias in deep semi-supervised learning,” in International Joint Conference on Neural Networks.   IEEE, 2020, pp. 1–8.
  13. Y. Wang, B. Xiao, X. Bi, W. Li, and X. Gao, “Mcf: Mutual correction framework for semi-supervised medical image segmentation,” in CVPR, 2023, pp. 15 651–15 660.
  14. X. Chen, Y. Yuan, G. Zeng, and J. Wang, “Semi-supervised semantic segmentation with cross pseudo supervision,” in CVPR, 2021, pp. 2613–2622.
  15. Y. Wu, Z. Ge, D. Zhang, M. Xu, L. Zhang, Y. Xia, and J. Cai, “Mutual consistency learning for semi-supervised medical image segmentation,” Medical Image Analysis, vol. 81, p. 102530, 2022.
  16. Y. Shi, J. Zhang, and et al, “Inconsistency-aware uncertainty estimation for semi-supervised medical image segmentation,” IEEE Transactions on Medical Imaging, vol. 41, no. 3, pp. 608–620, 2021.
  17. L. Yu, S. Wang, X. Li, C.-W. Fu, and P.-A. Heng, “Uncertainty-aware self-ensembling model for semi-supervised 3d left atrium segmentation,” in MICCAI.   Springer, 2019, pp. 605–613.
  18. Y. Li, J. Chen, X. Xie, K. Ma, and Y. Zheng, “Self-loop uncertainty: A novel pseudo-label for semi-supervised medical image segmentation,” in MICCAI.   Springer, 2020, pp. 614–623.
  19. R. He, J. Yang, and X. Qi, “Re-distributing biased pseudo labels for semi-supervised semantic segmentation: A baseline investigation,” in ICCV, 2021, pp. 6930–6940.
  20. Y. Zou, Z. Zhang, H. Zhang, C.-L. Li, X. Bian, J.-B. Huang, and T. Pfister, “Pseudoseg: Designing pseudo labels for semantic segmentation,” in International Conference on Learning Representations, 2020.
  21. S. Mittal and et al, “Semi-supervised semantic segmentation with high-and low-level consistency,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 43, no. 4, pp. 1369–1379, 2019.
  22. S. Li, C. Zhang, and X. He, “Shape-aware semi-supervised 3d semantic segmentation for medical images,” in MICCAI.   Springer, 2020, pp. 552–561.
  23. Y. Wang, Y. Zhang, J. Tian, C. Zhong, Z. Shi, Y. Zhang, and Z. He, “Double-uncertainty weighted method for semi-supervised learning,” in MICCAI.   Springer, 2020, pp. 542–551.
  24. X. Li, L. Yu, H. Chen, C.-W. Fu, L. Xing, and P.-A. Heng, “Transformation-consistent self-ensembling model for semisupervised medical image segmentation,” IEEE Transactions on Neural Networks and Learning Systems, vol. 32, no. 2, pp. 523–534, 2020.
  25. X. Lai, Z. Tian, L. Jiang, S. Liu, H. Zhao, L. Wang, and J. Jia, “Semi-supervised semantic segmentation with directional context-aware consistency,” in CVPR, 2021, pp. 1205–1214.
  26. J. Fan, B. Gao, H. Jin, and L. Jiang, “Ucc: Uncertainty guided cross-head co-training for semi-supervised semantic segmentation,” in CVPR, 2022, pp. 9947–9956.
  27. B. Li, Z. Han, H. Li, H. Fu, and C. Zhang, “Trustworthy long-tailed classification,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 6970–6979.
  28. A. P. Dempster, “A generalization of bayesian inference,” Journal of the Royal Statistical Society: Series B (Methodological), vol. 30, no. 2, pp. 205–232, 1968.
  29. T. Denoeux, “A neural network classifier based on dempster-shafer theory,” IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans, vol. 30, no. 2, pp. 131–150, 2000.
  30. L. Huang and et al, “Belief function-based semi-supervised learning for brain tumor segmentation,” in IEEE 18th International Symposium on Biomedical Imaging.   IEEE, 2021, pp. 160–164.
  31. L. Huang, S. Ruan, and T. Denœux, “Semi-supervised multiple evidence fusion for brain tumor segmentation,” Neurocomputing, 2023.
  32. L. Huang, T. Denoeux, P. Vera, and S. Ruan, “Evidence fusion with contextual discounting for multi-modality medical image segmentation,” in MICCAI.   Springer, 2022, pp. 401–411.
  33. Z. Diao, H. Jiang, X.-H. Han, Y.-D. Yao, and T. Shi, “Efnet: evidence fusion network for tumor segmentation from pet-ct volumes,” Physics in Medicine & Biology, vol. 66, no. 20, p. 205005, 2021.
  34. A. Kendall and Y. Gal, “What uncertainties do we need in bayesian deep learning for computer vision?” Advances in Neural Information Processing Systems, vol. 30, 2017.
  35. F. Xie and et al, “Melanoma classification on dermoscopy images using a neural network ensemble model,” IEEE Transactions on Medical Imaging, vol. 36, no. 3, pp. 849–858, 2016.
  36. Z. Tong, P. Xu, and T. Denoeux, “Evidential fully convolutional network for semantic segmentation,” Applied Intelligence, vol. 51, pp. 6376–6399, 2021.
  37. M. Sensoy, L. Kaplan, and M. Kandemir, “Evidential deep learning to quantify classification uncertainty,” Advances in Neural Information Processing Systems, vol. 31, 2018.
  38. K. Zou, X. Yuan, X. Shen, M. Wang, and H. Fu, “Tbrats: Trusted brain tumor segmentation,” in MICCAI.   Springer, 2022, pp. 503–513.
  39. H. Li, Y. Nan, J. Del Ser, and G. Yang, “Region-based evidential deep learning to quantify uncertainty and improve robustness of brain tumor segmentation,” Neural Computing and Applications, pp. 1–15, 2022.
  40. Z. Zhang and M. Sabuncu, “Generalized cross entropy loss for training deep neural networks with noisy labels,” Advances in neural information processing systems, vol. 31, 2018.
  41. Z. Xiong and et al, “A global benchmark of algorithms for segmenting the left atrium from late gadolinium-enhanced cardiac magnetic resonance imaging,” Medical Image Analysis, vol. 67, p. 101832, 2021.
  42. K. Clark, B. Vendt, and et al, “The cancer imaging archive (tcia): maintaining and operating a public information repository,” Journal of Digital Imaging, vol. 26, no. 6, pp. 1045–1057, 2013.
  43. O. Bernard and et al, “Deep learning techniques for automatic mri cardiac multi-structures segmentation and diagnosis: is the problem solved?” IEEE Transactions on Medical Imaging, vol. 37, no. 11, pp. 2514–2525, 2018.
  44. X. Luo, G. Wang, and et al, “Semi-supervised medical image segmentation through dual-task consistency,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, no. 10, 2021, pp. 8801–8809.
  45. T. Lei, D. Zhang, X. Du, X. Wang, Y. Wan, and A. K. Nandi, “Semi-supervised medical image segmentation using adversarial consistency learning and dynamic convolution network,” IEEE Transactions on Medical Imaging, vol. 42, no. 5, pp. 1265–1277, 2023.
Citations (3)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com