SAM-OCTA: A Fine-Tuning Strategy for Applying Foundation Model to OCTA Image Segmentation Tasks (2309.11758v1)
Abstract: In the analysis of optical coherence tomography angiography (OCTA) images, the operation of segmenting specific targets is necessary. Existing methods typically train on supervised datasets with limited samples (approximately a few hundred), which can lead to overfitting. To address this, the low-rank adaptation technique is adopted for foundation model fine-tuning and proposed corresponding prompt point generation strategies to process various segmentation tasks on OCTA datasets. This method is named SAM-OCTA and has been experimented on the publicly available OCTA-500 dataset. While achieving state-of-the-art performance metrics, this method accomplishes local vessel segmentation as well as effective artery-vein segmentation, which was not well-solved in previous works. The code is available at: https://github.com/ShellRedia/SAM-OCTA.
- “A deep learning-based quality assessment and segmentation system with a large-scale benchmark dataset for optical coherence tomographic angiography image,” arXiv preprint arXiv:2107.10476, 2021.
- “Foveal avascular zone segmentation of octa images using deep learning approach with unsupervised vessel segmentation,” in ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2021, pp. 1200–1204.
- “Rps-net: An effective retinal image projection segmentation network for retinal vessels and foveal avascular zone based on octa data,” Medical Physics, vol. 49, no. 6, pp. 3830–3844, 2022.
- “A comprehensive survey on segment anything model for vision and beyond,” arXiv preprint arXiv:2305.08196, 2023.
- “Segment anything,” arXiv preprint arXiv:2304.02643, 2023.
- “How segment anything model (sam) boost medical image segmentation?,” arXiv preprint arXiv:2305.03678, 2023.
- “An image is worth 16x16 words: Transformers for image recognition at scale,” arXiv preprint arXiv:2010.11929, 2020.
- “Tcu-net: Transformer embedded in convolutional u-shaped network for retinal vessel segmentation,” Sensors, vol. 23, no. 10, pp. 4897, 2023.
- “Oct2former: A retinal oct-angiography vessel segmentation transformer,” Computer Methods and Programs in Biomedicine, vol. 233, pp. 107454, 2023.
- “Strunet: Perceptual and low-rank regularized transformer for medical image denoising,” Medical Physics, 2023.
- “Db-unet: Mlp based dual branch unet for accurate vessel segmentation in octa images,” in ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2023, pp. 1–5.
- “Image projection network: 3d to 2d image segmentation in octa images,” IEEE Transactions on Medical Imaging, vol. 39, no. 11, pp. 3343–3354, 2020.
- “Ovs-net: An effective feature extraction network for optical coherence tomography angiography vessel segmentation,” Computer Animation and Virtual Worlds, vol. 33, no. 3-4, pp. e2096, 2022.
- “Retinal octa image segmentation based on global contrastive learning,” Sensors, vol. 22, no. 24, pp. 9847, 2022.
- “Customized segment anything model for medical image segmentation,” arXiv preprint arXiv:2304.13785, 2023.
- “Medical sam adapter: Adapting segment anything model for medical image segmentation,” arXiv preprint arXiv:2304.12620, 2023.
- “Lora: Low-rank adaptation of large language models,” arXiv preprint arXiv:2106.09685, 2021.
- “Ipn-v2 and octa-500: Methodology and dataset for retinal image segmentation,” arXiv preprint arXiv:2012.07261, 2020.
- “Albumentations: Fast and flexible image augmentations,” Information, vol. 11, no. 2, 2020.
- “cldice-a novel topology-preserving loss function for tubular structure segmentation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 16560–16569.
- “Joint-seg: Treat foveal avascular zone and retinal vessel segmentation in octa images as a joint task,” IEEE Transactions on Instrumentation and Measurement, vol. 71, pp. 1–13, 2022.
- “Av-casnet: Fully automatic arteriole-venule segmentation and differentiation in oct angiography,” IEEE Transactions on Medical Imaging, vol. 42, no. 2, pp. 481–492, 2022.