Papers
Topics
Authors
Recent
2000 character limit reached

Benchmarking the Robustness of UAV Tracking Against Common Corruptions (2403.11424v1)

Published 18 Mar 2024 in cs.CV

Abstract: The robustness of unmanned aerial vehicle (UAV) tracking is crucial in many tasks like surveillance and robotics. Despite its importance, little attention is paid to the performance of UAV trackers under common corruptions due to lack of a dedicated platform. Addressing this, we propose UAV-C, a large-scale benchmark for assessing robustness of UAV trackers under common corruptions. Specifically, UAV-C is built upon two popular UAV datasets by introducing 18 common corruptions from 4 representative categories including adversarial, sensor, blur, and composite corruptions in different levels. Finally, UAV-C contains more than 10K sequences. To understand the robustness of existing UAV trackers against corruptions, we extensively evaluate 12 representative algorithms on UAV-C. Our study reveals several key findings: 1) Current trackers are vulnerable to corruptions, indicating more attention needed in enhancing the robustness of UAV trackers; 2) When accompanying together, composite corruptions result in more severe degradation to trackers; and 3) While each tracker has its unique performance profile, some trackers may be more sensitive to specific corruptions. By releasing UAV-C, we hope it, along with comprehensive analysis, serves as a valuable resource for advancing the robustness of UAV tracking against corruption. Our UAV-C will be available at https://github.com/Xiaoqiong-Liu/UAV-C.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (31)
  1. Hift: Hierarchical feature transformer for aerial tracking. In ICCV, 2021.
  2. Siamapn++: Siamese attentional aggregation network for real-time uav tracking. In IROS, 2021.
  3. TCTrack: Temporal Contexts for Aerial Tracking. In CVPR, 2022.
  4. Transformer tracking. In CVPR, 2021.
  5. Siamese box adaptive network for visual tracking. In CVPR, 2020.
  6. The unmanned aerial vehicle benchmark: Object detection and tracking. In ECCV, 2018.
  7. Siamese object tracking for unmanned aerial vehicle: A review and comprehensive analysis. Artificial Intelligence Review, 56(Suppl 1):1417–1477, 2023.
  8. Generalisation in humans and deep neural networks. In NIPS, 2018.
  9. Explaining and harnessing adversarial examples. arxvi, 2014.
  10. Benchmarking neural network robustness to common corruptions and perturbations. arXiv, 2019.
  11. Anti-uav: a large-scale benchmark for vision-based uav tracking. IEEE TMM, 2021.
  12. Benchmarking the robustness of semantic segmentation models with respect to common corruptions. IJCV, 129:462 – 483, 2019.
  13. Siamrpn++: Evolution of siamese visual tracking with very deep networks. In CVPR, 2019.
  14. Adaptive and background-aware vision transformer for real-time uav tracking. In ICCV, 2023.
  15. Visual object tracking for unmanned aerial vehicles: A benchmark and new motion models. In AAAI, 2017.
  16. Autotrack: Towards high-performance visual tracking for uav with automatic spatio-temporal regularization. In CVPR, 2020.
  17. Transferable adversarial attack on 3d object tracking in point cloud. In MMM, 2023.
  18. Transforming model prediction for tracking. In CVPR, 2022.
  19. Learning target candidate association to keep track of what not to track. In ICCV, 2021.
  20. Benchmarking robustness in object detection: Autonomous driving when winter is coming. ArXiv, 2019.
  21. Nordic vehicle dataset (nvd): Performance of vehicle detectors using newly captured nvd from uav in different snowy weather conditions. CVPRW, 2023.
  22. A benchmark and simulator for uav tracking. In ECCV, 2016.
  23. Towards robust monocular depth estimation: Mixing datasets for zero-shot cross-dataset transfer. IEEE TPAMI, 44:1623–1637, 2019.
  24. Intriguing properties of neural networks. arXiv, 2013.
  25. Online object tracking: A benchmark. CVPR, 2013.
  26. Learning spatio-temporal transformer for visual tracking. ICCV, 2021.
  27. Sgdvit: Saliency-guided dynamic vision transformer for uav tracking. ICRA, 2023.
  28. Joint feature learning and relation modeling for tracking: A one-stream framework. In ECCV, 2022.
  29. Biodrone: A bionic drone-based single object tracking benchmark for robust vision. IJCV, pages 1–26, 2023.
  30. Detection and tracking meet drones challenge. IEEE TPAMI, 44(11):7380–7399, 2021.
  31. Multi-drone based single object tracking with agent sharing network. IEEE TCSVT, 2020.

Summary

We haven't generated a summary for this paper yet.

Slide Deck Streamline Icon: https://streamlinehq.com

Whiteboard

Dice Question Streamline Icon: https://streamlinehq.com

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Lightbulb Streamline Icon: https://streamlinehq.com

Continue Learning

We haven't generated follow-up questions for this paper yet.

List To Do Tasks Checklist Streamline Icon: https://streamlinehq.com

Collections

Sign up for free to add this paper to one or more collections.