Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
97 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Uncertainty-driven and Adversarial Calibration Learning for Epicardial Adipose Tissue Segmentation (2402.14349v2)

Published 22 Feb 2024 in eess.IV, cs.CV, and cs.LG

Abstract: Epicardial adipose tissue (EAT) is a type of visceral fat that can secrete large amounts of adipokines to affect the myocardium and coronary arteries. EAT volume and density can be used as independent risk markers measurement of volume by noninvasive magnetic resonance images is the best method of assessing EAT. However, segmenting EAT is challenging due to the low contrast between EAT and pericardial effusion and the presence of motion artifacts. we propose a novel feature latent space multilevel supervision network (SPDNet) with uncertainty-driven and adversarial calibration learning to enhance segmentation for more accurate EAT volume estimation. The network first addresses the blurring of EAT edges due to the medical images in the open medical environments with low quality or out-of-distribution by modeling the uncertainty as a Gaussian distribution in the feature latent space, which using its Bayesian estimation as a regularization constraint to optimize SwinUNETR. Second, an adversarial training strategy is introduced to calibrate the segmentation feature map and consider the multi-scale feature differences between the uncertainty-guided predictive segmentation and the ground truth segmentation, synthesizing the multi-scale adversarial loss directly improves the ability to discriminate the similarity between organizations. Experiments on both the cardiac public MRI dataset (ACDC) and the real-world clinical cohort EAT dataset show that the proposed network outperforms mainstream models, validating that uncertainty-driven and adversarial calibration learning can be used to provide additional information for modeling multi-scale ambiguities.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (28)
  1. Epicardial adipose tissue: anatomic, biomolecular and clinical relationships with the heart. Nature clinical practice Cardiovascular medicine, 2(10):536–543, 2005.
  2. Milton Packer. Epicardial adipose tissue may mediate deleterious effects of obesity and inflammation on the myocardium. Journal of the American College of Cardiology, 71(20):2360–2372, 2018.
  3. Detecting human coronary inflammation by imaging perivascular fat. Science translational medicine, 9(398):eaal2658, 2017.
  4. Gianluca Iacobellis. Epicardial adipose tissue in contemporary cardiology. Nature reviews cardiology, 19(9):593–606, 2022.
  5. Epicardial fat in heart failure patients with mid-range and preserved ejection fraction. European journal of heart failure, 20(11):1559–1566, 2018.
  6. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929, 2020.
  7. U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18, pages 234–241. Springer, 2015.
  8. Tc-net: A joint learning framework based on cnn and vision transformer for multi-lesion medical images segmentation. Computers in Biology and Medicine, 161:106967, 2023.
  9. Hippocampus substructure segmentation using morphological vision transformer learning. arXiv preprint arXiv:2306.08723, 2023.
  10. Convwin-unet: Unet-like hierarchical vision transformer combined with convolution for medical image segmentation. Mathematical Biosciences and Engineering, 20(1):128–144, 2023.
  11. A probabilistic u-net for segmentation of ambiguous images. Advances in neural information processing systems, 31, 2018.
  12. A review of uncertainty quantification in deep learning: Techniques, applications and challenges. Information fusion, 76:243–297, 2021.
  13. Trusted multi-view classification with dynamic evidential fusion. IEEE transactions on pattern analysis and machine intelligence, 45(2):2551–2566, 2022.
  14. Ambiguous medical image segmentation using diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 11536–11546, 2023.
  15. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114, 2013.
  16. Phiseg: Capturing uncertainty in medical image segmentation. In Medical Image Computing and Computer Assisted Intervention–MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13–17, 2019, Proceedings, Part II 22, pages 119–127. Springer, 2019.
  17. Generative adversarial nets. Advances in neural information processing systems, 27, 2014.
  18. Pca: Semi-supervised segmentation with patch confidence adversarial training. arXiv preprint arXiv:2207.11683, 2022.
  19. Adversarial learning for semi-supervised semantic segmentation. arXiv preprint arXiv:1802.07934, 2018.
  20. Adaptive adversarial neural networks for the analysis of lossy and domain-shifted datasets of medical images. Nature biomedical engineering, 5(6):571–585, 2021.
  21. Segan: Adversarial network with multi-scale l 1 loss for medical image segmentation. Neuroinformatics, 16:383–392, 2018.
  22. Deep learning techniques for automatic mri cardiac multi-structures segmentation and diagnosis: is the problem solved? IEEE transactions on medical imaging, 37(11):2514–2525, 2018.
  23. Self-supervised pre-training of swin transformers for 3d medical image analysis. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 20730–20740, 2022.
  24. Swin transformer: Hierarchical vision transformer using shifted windows. In Proceedings of the IEEE/CVF international conference on computer vision, pages 10012–10022, 2021.
  25. The fully convolutional transformer for medical image segmentation. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 3660–3669, 2023.
  26. nnformer: Interleaved transformer for volumetric segmentation. arXiv preprint arXiv:2109.03201, 2021.
  27. Swin-unet: Unet-like pure transformer for medical image segmentation. In European conference on computer vision, pages 205–218. Springer, 2022.
  28. Transunet: Transformers make strong encoders for medical image segmentation. arXiv preprint arXiv:2102.04306, 2021.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (8)
  1. Kai Zhao (160 papers)
  2. Zhiming Liu (26 papers)
  3. Jiaqi Liu (103 papers)
  4. Jingbiao Zhou (1 paper)
  5. Bihong Liao (1 paper)
  6. Huifang Tang (2 papers)
  7. Qiuyu Wang (19 papers)
  8. Chunquan Li (2 papers)

Summary

We haven't generated a summary for this paper yet.