SAM-OCTA: A Fine-Tuning Strategy for Applying Foundation Model to OCTA Image Segmentation Tasks
Abstract: In the analysis of optical coherence tomography angiography (OCTA) images, the operation of segmenting specific targets is necessary. Existing methods typically train on supervised datasets with limited samples (approximately a few hundred), which can lead to overfitting. To address this, the low-rank adaptation technique is adopted for foundation model fine-tuning and proposed corresponding prompt point generation strategies to process various segmentation tasks on OCTA datasets. This method is named SAM-OCTA and has been experimented on the publicly available OCTA-500 dataset. While achieving state-of-the-art performance metrics, this method accomplishes local vessel segmentation as well as effective artery-vein segmentation, which was not well-solved in previous works. The code is available at: https://github.com/ShellRedia/SAM-OCTA.
- “A deep learning-based quality assessment and segmentation system with a large-scale benchmark dataset for optical coherence tomographic angiography image,” arXiv preprint arXiv:2107.10476, 2021.
- “Foveal avascular zone segmentation of octa images using deep learning approach with unsupervised vessel segmentation,” in ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2021, pp. 1200–1204.
- “Rps-net: An effective retinal image projection segmentation network for retinal vessels and foveal avascular zone based on octa data,” Medical Physics, vol. 49, no. 6, pp. 3830–3844, 2022.
- “A comprehensive survey on segment anything model for vision and beyond,” arXiv preprint arXiv:2305.08196, 2023.
- “Segment anything,” arXiv preprint arXiv:2304.02643, 2023.
- “How segment anything model (sam) boost medical image segmentation?,” arXiv preprint arXiv:2305.03678, 2023.
- “An image is worth 16x16 words: Transformers for image recognition at scale,” arXiv preprint arXiv:2010.11929, 2020.
- “Tcu-net: Transformer embedded in convolutional u-shaped network for retinal vessel segmentation,” Sensors, vol. 23, no. 10, pp. 4897, 2023.
- “Oct2former: A retinal oct-angiography vessel segmentation transformer,” Computer Methods and Programs in Biomedicine, vol. 233, pp. 107454, 2023.
- “Strunet: Perceptual and low-rank regularized transformer for medical image denoising,” Medical Physics, 2023.
- “Db-unet: Mlp based dual branch unet for accurate vessel segmentation in octa images,” in ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2023, pp. 1–5.
- “Image projection network: 3d to 2d image segmentation in octa images,” IEEE Transactions on Medical Imaging, vol. 39, no. 11, pp. 3343–3354, 2020.
- “Ovs-net: An effective feature extraction network for optical coherence tomography angiography vessel segmentation,” Computer Animation and Virtual Worlds, vol. 33, no. 3-4, pp. e2096, 2022.
- “Retinal octa image segmentation based on global contrastive learning,” Sensors, vol. 22, no. 24, pp. 9847, 2022.
- “Customized segment anything model for medical image segmentation,” arXiv preprint arXiv:2304.13785, 2023.
- “Medical sam adapter: Adapting segment anything model for medical image segmentation,” arXiv preprint arXiv:2304.12620, 2023.
- “Lora: Low-rank adaptation of large language models,” arXiv preprint arXiv:2106.09685, 2021.
- “Ipn-v2 and octa-500: Methodology and dataset for retinal image segmentation,” arXiv preprint arXiv:2012.07261, 2020.
- “Albumentations: Fast and flexible image augmentations,” Information, vol. 11, no. 2, 2020.
- “cldice-a novel topology-preserving loss function for tubular structure segmentation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 16560–16569.
- “Joint-seg: Treat foveal avascular zone and retinal vessel segmentation in octa images as a joint task,” IEEE Transactions on Instrumentation and Measurement, vol. 71, pp. 1–13, 2022.
- “Av-casnet: Fully automatic arteriole-venule segmentation and differentiation in oct angiography,” IEEE Transactions on Medical Imaging, vol. 42, no. 2, pp. 481–492, 2022.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.