Benchmarking the Robustness of UAV Tracking Against Common Corruptions (2403.11424v1)
Abstract: The robustness of unmanned aerial vehicle (UAV) tracking is crucial in many tasks like surveillance and robotics. Despite its importance, little attention is paid to the performance of UAV trackers under common corruptions due to lack of a dedicated platform. Addressing this, we propose UAV-C, a large-scale benchmark for assessing robustness of UAV trackers under common corruptions. Specifically, UAV-C is built upon two popular UAV datasets by introducing 18 common corruptions from 4 representative categories including adversarial, sensor, blur, and composite corruptions in different levels. Finally, UAV-C contains more than 10K sequences. To understand the robustness of existing UAV trackers against corruptions, we extensively evaluate 12 representative algorithms on UAV-C. Our study reveals several key findings: 1) Current trackers are vulnerable to corruptions, indicating more attention needed in enhancing the robustness of UAV trackers; 2) When accompanying together, composite corruptions result in more severe degradation to trackers; and 3) While each tracker has its unique performance profile, some trackers may be more sensitive to specific corruptions. By releasing UAV-C, we hope it, along with comprehensive analysis, serves as a valuable resource for advancing the robustness of UAV tracking against corruption. Our UAV-C will be available at https://github.com/Xiaoqiong-Liu/UAV-C.
- Hift: Hierarchical feature transformer for aerial tracking. In ICCV, 2021.
- Siamapn++: Siamese attentional aggregation network for real-time uav tracking. In IROS, 2021.
- TCTrack: Temporal Contexts for Aerial Tracking. In CVPR, 2022.
- Transformer tracking. In CVPR, 2021.
- Siamese box adaptive network for visual tracking. In CVPR, 2020.
- The unmanned aerial vehicle benchmark: Object detection and tracking. In ECCV, 2018.
- Siamese object tracking for unmanned aerial vehicle: A review and comprehensive analysis. Artificial Intelligence Review, 56(Suppl 1):1417–1477, 2023.
- Generalisation in humans and deep neural networks. In NIPS, 2018.
- Explaining and harnessing adversarial examples. arxvi, 2014.
- Benchmarking neural network robustness to common corruptions and perturbations. arXiv, 2019.
- Anti-uav: a large-scale benchmark for vision-based uav tracking. IEEE TMM, 2021.
- Benchmarking the robustness of semantic segmentation models with respect to common corruptions. IJCV, 129:462 – 483, 2019.
- Siamrpn++: Evolution of siamese visual tracking with very deep networks. In CVPR, 2019.
- Adaptive and background-aware vision transformer for real-time uav tracking. In ICCV, 2023.
- Visual object tracking for unmanned aerial vehicles: A benchmark and new motion models. In AAAI, 2017.
- Autotrack: Towards high-performance visual tracking for uav with automatic spatio-temporal regularization. In CVPR, 2020.
- Transferable adversarial attack on 3d object tracking in point cloud. In MMM, 2023.
- Transforming model prediction for tracking. In CVPR, 2022.
- Learning target candidate association to keep track of what not to track. In ICCV, 2021.
- Benchmarking robustness in object detection: Autonomous driving when winter is coming. ArXiv, 2019.
- Nordic vehicle dataset (nvd): Performance of vehicle detectors using newly captured nvd from uav in different snowy weather conditions. CVPRW, 2023.
- A benchmark and simulator for uav tracking. In ECCV, 2016.
- Towards robust monocular depth estimation: Mixing datasets for zero-shot cross-dataset transfer. IEEE TPAMI, 44:1623–1637, 2019.
- Intriguing properties of neural networks. arXiv, 2013.
- Online object tracking: A benchmark. CVPR, 2013.
- Learning spatio-temporal transformer for visual tracking. ICCV, 2021.
- Sgdvit: Saliency-guided dynamic vision transformer for uav tracking. ICRA, 2023.
- Joint feature learning and relation modeling for tracking: A one-stream framework. In ECCV, 2022.
- Biodrone: A bionic drone-based single object tracking benchmark for robust vision. IJCV, pages 1–26, 2023.
- Detection and tracking meet drones challenge. IEEE TPAMI, 44(11):7380–7399, 2021.
- Multi-drone based single object tracking with agent sharing network. IEEE TCSVT, 2020.
Sponsor
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.