Susceptibility of Adversarial Attack on Medical Image Segmentation Models (2401.11224v1)
Abstract: The nature of deep neural networks has given rise to a variety of attacks, but little work has been done to address the effect of adversarial attacks on segmentation models trained on MRI datasets. In light of the grave consequences that such attacks could cause, we explore four models from the U-Net family and examine their responses to the Fast Gradient Sign Method (FGSM) attack. We conduct FGSM attacks on each of them and experiment with various schemes to conduct the attacks. In this paper, we find that medical imaging segmentation models are indeed vulnerable to adversarial attacks and that there is a negligible correlation between parameter size and adversarial attack success. Furthermore, we show that using a different loss function than the one used for training yields higher adversarial attack success, contrary to what the FGSM authors suggested. In future efforts, we will conduct the experiments detailed in this paper with more segmentation models and different attacks. We will also attempt to find ways to counteract the attacks by using model ensembles or special data augmentations. Our code is available at https://github.com/ZhongxuanWang/adv_attk
- I. J. Goodfellow, J. Shlens, and C. Szegedy, “Explaining and harnessing adversarial examples,” 2014.
- K. O’Shea and R. Nash, “An introduction to convolutional neural networks,” 2015.
- “Image segmentation guide.” \urlhttps://www.fritz.ai/image-segmentation/.
- O. Ronneberger, P. Fischer, and T. Brox, “U-net: Convolutional networks for biomedical image segmentation,” 2015.
- Z. Zhou, M. M. R. Siddiquee, N. Tajbakhsh, and J. Liang, “Unet++: A nested u-net architecture for medical image segmentation,” 2018.
- H. Huang, L. Lin, R. Tong, H. Hu, Q. Zhang, Y. Iwamoto, X. Han, Y.-W. Chen, and J. Wu, “Unet 3+: A full-scale connected unet for medical image segmentation,” 2020.
- J. Chen, Y. Lu, Q. Yu, X. Luo, E. Adeli, Y. Wang, L. Lu, A. L. Yuille, and Y. Zhou, “Transunet: Transformers make strong encoders for medical image segmentation,” 2021.
- H. Cao, Y. Wang, J. Chen, D. Jiang, X. Zhang, Q. Tian, and M. Wang, “Swin-unet: Unet-like pure transformer for medical image segmentation,” 2021.
- Y. Li, Y. Jiang, Z. Li, and S.-T. Xia, “Backdoor learning: A survey,” IEEE Transactions on Neural Networks and Learning Systems, pp. 1–18, 2022.
- X. Ma, Y. Niu, L. Gu, Y. Wang, Y. Zhao, J. Bailey, and F. Lu, “Understanding adversarial attacks on deep learning based medical image analysis systems,” Pattern Recognition, vol. 110, p. 107332, feb 2021.
- X. Li and D. Zhu, “Robust detection of adversarial attacks on medical images,” in 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI), pp. 1154–1158, 2020.
- A. Subramanya, A. Saha, S. A. Koohpayegani, A. Tejankar, and H. Pirsiavash, “Backdoor attacks on vision transformers,” 2022.
- J. H. Metzen, M. C. Kumar, T. Brox, and V. Fischer, “Universal adversarial perturbations against semantic image segmentation,” in 2017 IEEE International Conference on Computer Vision (ICCV), pp. 2774–2783, 2017.
- C. Xie, J. Wang, Z. Zhang, Y. Zhou, L. Xie, and A. Yuille, “Adversarial examples for semantic segmentation and object detection,” 2017.
- A. Arnab, O. Miksik, and P. H. S. Torr, “On the robustness of semantic segmentation models to adversarial attacks,” 2017.
- J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, “Imagenet: A large-scale hierarchical image database,” in 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255, 2009.
- L. M. Fayad, “Ct scan versus mri versus x-ray: What type of imaging do i need?.” \urlhttps://www.hopkinsmedicine.org/health/treatment-tests-and-therapies/ct-vs-mri-vs-xray, Oct 2021.
- X. Kang, B. Song, X. Du, and M. Guizani, “Adversarial attacks for image segmentation on multiple lightweight models,” IEEE Access, vol. 8, pp. 31359–31370, 2020.
- S. Li, G. Huang, X. Xu, and H. Lu, “Query-based black-box attack against medical image segmentation model,” Future Generation Computer Systems, vol. 133, pp. 331–337, 2022.
- H. Kwon, “Medicalguard: U-net model robust against adversarially perturbed images,” Security and Communication Networks, vol. 2021, p. 1–8, 2021.
- C. Szegedy, W. Zaremba, I. Sutskever, J. Bruna, D. Erhan, I. Goodfellow, and R. Fergus, “Intriguing properties of neural networks,” 2013.
- S. Xie, R. Girshick, P. Dollár, Z. Tu, and K. He, “Aggregated residual transformations for deep neural networks,” 2016.
- S. Xie, R. B. Girshick, P. Dollár, Z. Tu, and K. He, “Aggregated residual transformations for deep neural networks,” CoRR, vol. abs/1611.05431, 2016.
- M. Tan and Q. V. Le, “Efficientnet: Rethinking model scaling for convolutional neural networks,” 2019.
- M. Phan, “Rsna-miccai brain tumor radiogenomic classification 2nd place solution.” \urlhttps://www.kaggle.com/competitions/rsna-miccai-brain-tumor-radiogenomic-classification/discussion/280033., July 2021.
- C. Zhao, “Uw-madison gi tract image segmentation 1st place winning solution.” \urlhttps://www.kaggle.com/code/carnozhao/1st-place-winning-solution, July 2022.
- O. Takumi, “Uw-madison gi tract image segmentation 2nd place winning solution.” \urlhttps://www.kaggle.com/code/takuok/2nd-place-winning-solution, July 2022.
- He, “Uw-madison gi tract image segmentation 3rd place winning solution.” \urlhttps://www.kaggle.com/code/hesene/3rd-place-winning-solution, July 2022.
- “Uw-madison gi tract image segmentation.” \urlhttps://www.kaggle.com/competitions/uw-madison-gi-tract-image-segmentation/data, Apr 2022.
- B. Prencipe, N. Altini, G. D. Cascarano, A. Brunetti, A. Guerriero, and V. Bevilacqua, “Focal dice loss-based v-net for liver segments classification,” Applied Sciences, vol. 12, no. 7, 2022.
- S. Jadon, “A survey of loss functions for semantic segmentation,” in 2020 IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB), IEEE, oct 2020.
- T. Lin, P. Goyal, R. B. Girshick, K. He, and P. Dollár, “Focal loss for dense object detection,” CoRR, vol. abs/1708.02002, 2017.
- T. Gneiting and A. E. Raftery, “Strictly proper scoring rules, prediction, and estimation,” Journal of the American Statistical Association, vol. 102, no. 477, pp. 359–378, 2007.
- K. Zou, S. Warfield, A. Bharatha, C. Tempany, M. Kaus, S. Haker, W. Wells, F. Jolesz, and R. Kikinis, “Statistical validation of image segmentation quality based on a spatial overlap index,” Academic radiology, vol. 11, pp. 178–89, 02 2004.