Dr-SAM: An End-to-End Framework for Vascular Segmentation, Diameter Estimation, and Anomaly Detection on Angiography Images (2404.17029v1)
Abstract: Recent advancements in AI have significantly transformed medical imaging, particularly in angiography, by enhancing diagnostic precision and patient care. However existing works are limited in analyzing the aorta and iliac arteries, above all for vascular anomaly detection and characterization. To close this gap, we propose Dr-SAM, a comprehensive multi-stage framework for vessel segmentation, diameter estimation, and anomaly analysis aiming to examine the peripheral vessels through angiography images. For segmentation we introduce a customized positive/negative point selection mechanism applied on top of the Segment Anything Model (SAM), specifically for medical (Angiography) images. Then we propose a morphological approach to determine the vessel diameters followed by our histogram-driven anomaly detection approach. Moreover, we introduce a new benchmark dataset for the comprehensive analysis of peripheral vessel angiography images which we hope can boost the upcoming research in this direction leading to enhanced diagnostic precision and ultimately better health outcomes for individuals facing vascular issues.
- Adobe Systems Incorporated. Adobe Photoshop, Year of Version. Software available from Adobe Systems Incorporated.
- Harry Blum. A transformation for extracting new descriptors of shape. In Models for the Perception of Speech and Visual Form, pages 362–380. MIT Press, Cambridge, Massachusetts, 1967.
- Encoder-decoder with atrous separable convolution for semantic image segmentation. In ECCV, 2018.
- Sam-med2d, 2023.
- Sam-u: Multi-box prompts triggered uncertainty estimation for reliable sam in medical image. arXiv:2307.04973, 1, 2023.
- A novel segmentation algorithm for digital subtraction angiography images: First experimental results. In Advances in Visual Computing, pages 612–623, Berlin, Heidelberg, 2008. Springer Berlin Heidelberg.
- Plantcv v2: Image analysis software for high-throughput plant phenotyping. PeerJ, 5:e4088, 2017.
- Paul Jaccard. Distribution de la flore alpine dans le bassin des dranses et dans quelques régions voisines. Bulletin de la Société Vaudoise des Sciences Naturelles, 37:241–272, 1901.
- Angionet: a convolutional neural network for vessel segmentation in x-ray angiography. Scientific Reports, 11(1), 2021.
- Segment anything. arXiv:2304.02643, 2023.
- Digital subtraction angiography image segmentation based on multiscale hessian matrix applied to medical diagnosis and clinical nursing of coronary stenting patients. Journal of Radiation Research and Applied Sciences, 16(3):100603, 2023.
- Segment anything in medical images. Nature Communications, 15:1–9, 2024.
- Automatic stenosis recognition from coronary angiography using convolutional neural networks. Computer Methods and Programs in Biomedicine, 198:105819, 2021.
- Deep learning-based detection of functionally significant stenosis in coronary ct angiography. Front Cardiovasc Med., 9:964355, 2022.
- An accurate and efficient neural network for octa vessel segmentation and a new dataset. arXiv:2309.09483, 1, 2023.
- Learnable ophthalmology sam. arXiv:2304.13425, 1, 2023.
- U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention (MICCAI), pages 234–241. Springer, 2015. (available on arXiv:1505.04597 [cs.CV]).
- Distance functions on digital pictures. Pattern Recognition, 1(1):33–61, 1969.
- Vascular Stenosis: An Introduction, pages 781–868. Springer Berlin Heidelberg, Berlin, Heidelberg, 2015.
- Sam-octa: A fine-tuning strategy for applying foundation model to octa image segmentation tasks. arXiv:2309.11758, 1, 2023a.
- Sam-med3d, 2023b.
- One-prompt to segment all medical images. arXiv:2305.10300, 3, 2023.
- An unsupervised image segmentation algorithm for coronary angiography. BioData Mining, 15(27), 2022.