Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
173 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Snake with Shifted Window: Learning to Adapt Vessel Pattern for OCTA Segmentation (2404.18096v1)

Published 28 Apr 2024 in eess.IV and cs.CV

Abstract: Segmenting specific targets or structures in optical coherence tomography angiography (OCTA) images is fundamental for conducting further pathological studies. The retinal vascular layers are rich and intricate, and such vascular with complex shapes can be captured by the widely-studied OCTA images. In this paper, we thus study how to use OCTA images with projection vascular layers to segment retinal structures. To this end, we propose the SSW-OCTA model, which integrates the advantages of deformable convolutions suited for tubular structures and the swin-transformer for global feature extraction, adapting to the characteristics of OCTA modality images. Our model underwent testing and comparison on the OCTA-500 dataset, achieving state-of-the-art performance. The code is available at: https://github.com/ShellRedia/Snake-SWin-OCTA.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (30)
  1. M. Abtahi, D. Le, J. I. Lim, and X. Yao, “Mf-av-net: an open-source deep learning network with multimodal fusion options for artery-vein segmentation in oct angiography,” Biomedical Optics Express, vol. 13, no. 9, pp. 4870–4888, 2022.
  2. A. Buslaev, V. I. Iglovikov, E. Khvedchenya, A. Parinov, M. Druzhinin, and A. A. Kalinin, “Albumentations: Fast and flexible image augmentations,” Information, vol. 11, no. 2, 2020. [Online]. Available: https://www.mdpi.com/2078-2489/11/2/125
  3. M. J. Cardoso, W. Li, R. Brown, N. Ma, E. Kerfoot, Y. Wang, B. Murrey, A. Myronenko, C. Zhao, D. Yang et al., “Monai: An open-source framework for deep learning in healthcare,” arXiv preprint arXiv:2211.02701, 2022.
  4. A. Hatamizadeh, V. Nath, Y. Tang, D. Yang, H. R. Roth, and D. Xu, “Swin unetr: Swin transformers for semantic segmentation of brain tumors in mri images,” in International MICCAI Brainlesion Workshop.   Springer, 2021, pp. 272–284.
  5. Y. He, D. Yang, H. Roth, C. Zhao, and D. Xu, “Dints: Differentiable neural network topology search for 3d medical image segmentation,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021, pp. 5841–5850.
  6. K. Hu, S. Jiang, Y. Zhang, X. Li, and X. Gao, “Joint-seg: Treat foveal avascular zone and retinal vessel segmentation in octa images as a joint task,” IEEE Transactions on Instrumentation and Measurement, vol. 71, pp. 1–13, 2022.
  7. A. Javed, A. Khanna, E. Palmer, C. Wilde, A. Zaman, G. Orr, D. Kumudhan, A. Lakshmanan, and G. D. Panos, “Optical coherence tomography angiography: a review of the current literature,” Journal of International Medical Research, vol. 51, no. 7, p. 03000605231187933, 2023.
  8. G. Kalra, J. Zarranz-Ventura, R. Chahal, C. Bernal-Morales, M. Lupidi, and J. Chhablani, “Optical coherence tomography (oct) angiolytics: a review of oct angiography quantitative biomarkers,” Survey of Ophthalmology, vol. 67, no. 4, pp. 1118–1134, 2022.
  9. A. Khan, J. Hao, Z. Dong, and J. Li, “Adaptive deep clustering network for retinal blood vessel and foveal avascular zone segmentation,” Applied Sciences, vol. 13, no. 20, p. 11259, 2023.
  10. M. Li, Y. Chen, Z. Ji, K. Xie, S. Yuan, Q. Chen, and S. Li, “Image projection network: 3d to 2d image segmentation in octa images,” IEEE Transactions on Medical Imaging, vol. 39, no. 11, pp. 3343–3354, 2020.
  11. M. Li, Y. Zhang, Z. Ji, K. Xie, S. Yuan, Q. Liu, and Q. Chen, “Ipn-v2 and octa-500: Methodology and dataset for retinal image segmentation,” arXiv preprint arXiv:2012.07261, 2020.
  12. W. Li, H. Zhang, F. Li, and L. Wang, “Rps-net: An effective retinal image projection segmentation network for retinal vessels and foveal avascular zone based on octa data,” Medical Physics, vol. 49, no. 6, pp. 3830–3844, 2022.
  13. Z. Liang, J. Zhang, and C. An, “Foveal avascular zone segmentation of octa images using deep learning approach with unsupervised vessel segmentation,” in ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).   IEEE, 2021, pp. 1200–1204.
  14. Z. Liu, Y. Lin, Y. Cao, H. Hu, Y. Wei, Z. Zhang, S. Lin, and B. Guo, “Swin transformer: Hierarchical vision transformer using shifted windows,” in Proceedings of the IEEE/CVF international conference on computer vision, 2021, pp. 10 012–10 022.
  15. Y. Ma, Q. Yan, Y. Liu, J. Liu, J. Zhang, and Y. Zhao, “Strunet: Perceptual and low-rank regularized transformer for medical image denoising,” Medical Physics, 2023.
  16. Z. Ma, D. Feng, J. Wang, and H. Ma, “Retinal octa image segmentation based on global contrastive learning,” Sensors, vol. 22, no. 24, p. 9847, 2022.
  17. A. Myronenko, “3d mri brain tumor segmentation using autoencoder regularization,” in Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries: 4th International Workshop, BrainLes 2018, Held in Conjunction with MICCAI 2018, Granada, Spain, September 16, 2018, Revised Selected Papers, Part II 4.   Springer, 2019, pp. 311–320.
  18. Y. Pang, G. Zhang, H. Zhang, J. She, X. Zhang, H. Li, and G. Zhang, “Foveal avascular zone in normal human eyes by optical coherence tomography angiography,” Photodiagnosis and Photodynamic Therapy, vol. 42, p. 103303, 2023.
  19. L. Peng, L. Lin, P. Cheng, Z. Wang, and X. Tang, “Fargo: A joint framework for faz and rv segmentation from octa images,” in Ophthalmic Medical Image Analysis: 8th International Workshop, OMIA 2021, Held in Conjunction with MICCAI 2021, Strasbourg, France, September 27, 2021, Proceedings 8.   Springer, 2021, pp. 42–51.
  20. Preity, A. K. Bhandari, and S. Shahnawazuddin, “Automated computationally intelligent methods for ocular vessel segmentation and disease detection: a review,” Archives of Computational Methods in Engineering, pp. 1–24, 2023.
  21. Y. Qi, Y. He, X. Qi, Y. Zhang, and G. Yang, “Dynamic snake convolution based on topological geometric constraints for tubular structure segmentation,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 6070–6079.
  22. O. Ronneberger, P. Fischer, and T. Brox, “U-net: Convolutional networks for biomedical image segmentation,” in Medical image computing and computer-assisted intervention–MICCAI 2015: 18th international conference, Munich, Germany, October 5-9, 2015, proceedings, part III 18.   Springer, 2015, pp. 234–241.
  23. Z. Shi, Y. Li, H. Zou, and X. Zhang, “Tcu-net: Transformer embedded in convolutional u-shaped network for retinal vessel segmentation,” Sensors, vol. 23, no. 10, p. 4897, 2023.
  24. S. Shit, J. C. Paetzold, A. Sekuboyina, I. Ezhov, A. Unger, A. Zhylka, J. P. Pluim, U. Bauer, and B. H. Menze, “cldice-a novel topology-preserving loss function for tubular structure segmentation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 16 560–16 569.
  25. X. Tan, X. Chen, Q. Meng, F. Shi, D. Xiang, Z. Chen, L. Pan, and W. Zhu, “Oct2former: A retinal oct-angiography vessel segmentation transformer,” Computer Methods and Programs in Biomedicine, vol. 233, p. 107454, 2023.
  26. Y. Z. Tun and P. Aimmanee, “A complete review of automatic detection, segmentation, and quantification of neovascularization in optical coherence tomography angiography images,” Diagnostics, vol. 13, no. 22, p. 3407, 2023.
  27. C. Wang, X. Chen, H. Ning, and S. Li, “Sam-octa: A fine-tuning strategy for applying foundation model to octa image segmentation tasks,” arXiv preprint arXiv:2309.11758, 2023.
  28. C. Wang, H. Ning, X. Chen, and S. Li, “Db-unet: Mlp based dual branch unet for accurate vessel segmentation in octa images,” in ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).   IEEE, 2023, pp. 1–5.
  29. Z. Wu, Z. Wang, W. Zou, F. Ji, H. Dang, W. Zhou, and M. Sun, “Paenet: A progressive attention-enhanced network for 3d to 2d retinal vessel segmentation,” in 2021 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).   IEEE, 2021, pp. 1579–1584.
  30. C. Zhu, H. Wang, Y. Xiao, Y. Dai, Z. Liu, and B. Zou, “Ovs-net: An effective feature extraction network for optical coherence tomography angiography vessel segmentation,” Computer Animation and Virtual Worlds, p. e2096, 2022.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now