SSL-OTA: Unveiling Backdoor Threats in Self-Supervised Learning for Object Detection (2401.00137v2)
Abstract: The extensive adoption of Self-supervised learning(SSL) has led to an increased security threat from backdoor attacks. While existing research has mainly focused on backdoor attacks in image classification, there has been limited exploration of their implications for object detection. Object detection plays a critical role in security-sensitive applications, such as autonomous driving, where backdoor attacks seriously threaten human life and property. In this work, we propose the first backdoor attack designed for object detection tasks in SSL scenarios, called Object Transform Attack (SSL-OTA). SSL-OTA employs a trigger capable of altering predictions of the target object to the desired category, encompassing two attacks: Naive Attack(NA) and Dual-Source Blending Attack (DSBA). NA conducts data poisoning during downstream fine-tuning of the object detector, while DSBA additionally injects backdoors into the pre-trained encoder. We establish appropriate metrics and conduct extensive experiments on benchmark datasets, demonstrating the effectiveness of our proposed attack and its resistance to potential defenses. Notably, both NA and DSBA achieve high attack success rates (ASR) at extremely low poisoning rates (0.5%). The results underscore the importance of considering backdoor threats in SSL-based object detection and contribute a novel perspective to the field.
- “Momentum contrast for unsupervised visual representation learning,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020, pp. 9729–9738.
- “A simple framework for contrastive learning of visual representations,” in International Conference on Machine Learning, 2020, pp. 1597–1607.
- “Masked autoencoders are scalable vision learners,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022, pp. 16000–16009.
- “Badnets: Evaluating backdooring attacks on deep neural networks,” IEEE Access, vol. 7, pp. 47230–47244, 2019.
- “Invisible backdoor attack with sample-specific triggers,” in Proceedings of the IEEE International Conference on Computer Vision, 2021, pp. 16463–16472.
- “Rethinking the backdoor attacks’ triggers: A frequency perspective,” in Proceedings of the IEEE International Conference on Computer Vision, 2021, pp. 16473–16481.
- “Badencoder: Backdoor attacks to pre-trained encoders in self-supervised learning,” in 2022 IEEE Symposium on Security and Privacy (SP), 2022, pp. 2043–2059.
- “Backdoor attacks on self-supervised learning,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 13337–13346.
- “An embarrassingly simple backdoor attack on self-supervised learning,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 4367–4378.
- “Baddet: Backdoor attacks on object detection,” in European Conference on Computer Vision, 2022, pp. 396–412.
- “Untargeted backdoor attack against object detection,” in ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2023, pp. 1–5.
- “Backdoor attack against object detection with clean annotation,” arXiv preprint arXiv:2307.10487, 2023.
- “Just rotate it: Deploying backdoor attacks via rotation transformation,” in Proceedings of the 15th ACM Workshop on Artificial Intelligence and Security, 2022, pp. 91–102.
- “Generalizable pedestrian detection: The elephant in the room,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 11328–11337.
- “Rad: Realtime and accurate 3d object detection on embedded systems,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 2875–2883.
- “Faster r-cnn: Towards real-time object detection with region proposal networks,” Advances in Neural Information Processing Systems, vol. 28, 2015.
- “The pascal visual object classes (voc) challenge,” International Journal of Computer Vision, vol. 88, pp. 303–338, 2010.
- “The pascal visual object classes challenge 2012 (voc2012) results,” in http://www.pascal-network.org/challenges/VOC/voc2012/workshop/index .html, 2012.
- “Microsoft coco: Common objects in context,” in European Conference on Computer Vision, 2014.
- “Hidden trigger backdoor attacks,” in Proceedings of the AAAI conference on artificial intelligence, 2020, vol. 34, pp. 11957–11965.
- “Imagenet: A large-scale hierarchical image database,” 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255, 2009.
- “Mask r-cnn,” in Proceedings of the IEEE International Conference on Computer Vision, 2017, pp. 2961–2969.
- “Detectron2,” in https://github.com/facebookresearch/detectron2, 2019.