Papers
Topics
Authors
Recent
Search
2000 character limit reached

Set-membership target search and tracking within an unknown cluttered area using cooperating UAVs equipped with vision systems

Published 22 Mar 2024 in eess.SY, cs.RO, and cs.SY | (2403.15113v3)

Abstract: This paper addresses the problem of target search and tracking using a fleet of cooperating UAVs evolving in some unknown region of interest containing an a priori unknown number of moving ground targets. Each drone is equipped with an embedded Computer Vision System (CVS), providing an image with labeled pixels and a depth map of the observed part of its environment. Moreover, a box containing the corresponding pixels in the image frame is available when a UAV identifies a target. Hypotheses regarding information provided by the pixel classification, depth map construction, and target identification algorithms are proposed to allow its exploitation by set-membership approaches. A set-membership target location estimator is developed using the information provided by the CVS. Each UAV evaluates sets guaranteed to contain the location of the identified targets and a set possibly containing the locations of targets still to be identified. Then, each UAV uses these sets to search and track targets cooperatively.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (62)
  1. Survey on Modern Applications of Multiple Unmanned Aerial Vehicles (UAV) Systems. In 2022 Fifth College of Science International Conference of Recent Trends in Information Technology (CSCTIT), pages 179–184. IEEE, 2022.
  2. Autonomous UAV-based Target Search, Tracking and Following using Reinforcement Learning and YOLOFlow. In 2020 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR), pages 15–20. IEEE, 2020.
  3. Bethany Allik. Tracking of multiple targets across distributed platforms with fov constraints. In in Proc. IEEE CDC, pages 6044–6049, 2019.
  4. Semantic OcTree mapping and Shannon mutual information computation for robot exploration. IEEE Transactions on Robotics, 2023. Publisher: IEEE.
  5. Nonmyopic view planning for active object classification and pose estimation. IEEE Transactions on Robotics, 30(5):1078–1090, 2014. Publisher: IEEE.
  6. Decentralized Multi-Agent Active Search and Tracking when Targets Outnumber Agents. arXiv preprint arXiv:2401.03154, 2024.
  7. Distributed model predictive control: A tutorial review and future research directions. Computers & Chemical Engineering, 51:21–41, 2013.
  8. ID Coope. Reliable computation of the points of intersection of n spheres in R^ n. ANZIAM Journal, 42:C461–C477, 2000.
  9. Philip M Dames. Distributed multi-target search and tracking using the PHD filter. Autonomous robots, 44(3):673–689, 2020.
  10. Sensor Fusion with Asynchronous Decentralized Processing for 3D Target Tracking with a Wireless Camera Network. Sensors, 23(3):1194, 2023.
  11. Deep learning on monocular object pose detection and tracking: A comprehensive overview. ACM Computing Surveys, 55(4):1–40, 2022.
  12. Olivier Faugeras. Three-dimensional computer vision: a geometric viewpoint. MIT press, 1993.
  13. Searching and tracking people with cooperative mobile robots. Autonomous Robots, 42(4):739–759, 2018.
  14. A review of point clouds segmentation and classification algorithms. The International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 42:339, 2017. Publisher: Copernicus GmbH.
  15. Next-Best-View planning for surface reconstruction of large-scale 3D environments with multiple UAVs. In 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 1567–1574. IEEE, 2020.
  16. UAV Swarm Cooperative Target Search: A Multi-Agent Reinforcement Learning Approach. IEEE Transactions on Intelligent Vehicles, 2023.
  17. Searching for mobilenetv3. In Proceedings of the IEEE/CVF international conference on computer vision, pages 1314–1324, 2019.
  18. Bounded-error target localization and tracking using a fleet of UAVs. Automatica, 132:109809, 2021.
  19. Localization of Partially Hidden Moving Targets Using a Fleet of UAVs via Bounded-Error Estimation. IEEE Transactions on Robotics, 2023.
  20. Applied Interval analysis. Springer, 2001.
  21. Accurate depth map estimation from a lenslet light field camera. In IEEE CVPR, 2015.
  22. Source searching in unknown obstructed environments through source estimation, target determination, and path planning. Building and Environment, 221:109266, 2022.
  23. A Review of Yolo algorithm developments. Procedia computer science, 199:1066–1073, 2022.
  24. Multipass target search in natural environments. Sensors, 2017.
  25. Partially observable markov decision processes in robotics: A survey. IEEE Transactions on Robotics, 39(1):21–40, 2022. Publisher: IEEE.
  26. Target search algorithm for AUV based on real-time perception maps in unknown environment. Machines, 2021.
  27. Vision-aware air-ground cooperative target localization for UAV and UGV. Aerospace Science and Technology, 124:107525, 2022.
  28. A novel real-time moving target tracking and path planning system for a quadrotor UAV in unknown unstructured outdoor scenes. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 49(11):2362–2372, 2018.
  29. Target localization in local dense mapping using RGBD SLAM and object detection. Concurrency and Computation: Practice and Experience, 34(4):e6655, 2022. Publisher: Wiley Online Library.
  30. YOLOD: A target detection method for UAV aerial imagery. Remote Sensing, 14(14):3240, 2022.
  31. Unmanned aerial vehicles for search and rescue: A survey. Remote Sensing, 15(13):3266, 2023.
  32. Self-supervised monocular depth estimation from oblique UAV videos. ISPRS journal of photogrammetry and remote sensing, 2021.
  33. Obstacle-aware adaptive informative path planning for uav-based target search. In in Proc. IEEE ICRA, pages 718–724, 2019.
  34. Image segmentation using deep learning: A survey. IEEE Trans Pattern Anal Mach Intell, 44(7):3523–3542, 2021.
  35. Vision-based target detection and localization via a team of cooperative UAV and UGVs. IEEE Transactions on systems, man, and cybernetics: systems, 2015.
  36. Effective and efficient detection of moving targets from a UAV camera. IEEE transactions on intelligent transportation systems, 19(2):497–506, 2018. Publisher: IEEE.
  37. 3d bounding box estimation using deep learning and geometry. In Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, pages 7074–7082, 2017.
  38. First successful rescue of a lost person using the human detection system: A case study from Beskid Niski (SE Poland). Remote Sensing, 13(23):4903, 2021. Publisher: MDPI.
  39. Stereo vision based collision avoidance of quadrotor UAV. In 2012 12th International Conference on Control, Automation and Systems, pages 173–178. IEEE, 2012.
  40. A survey on active simultaneous localization and mapping: State of the art and new frontiers. IEEE Transactions on Robotics, 2023.
  41. Collaborative multi-robot search and rescue: Planning, coordination, perception, and active vision. Ieee Access, 2020.
  42. Cooperative guidance of a fleet of UAVs for multi-target discovery and tracking in presence of obstacles using a set membership approach. IFAC-PapersOnLine, 52(12):340–345, 2019.
  43. You only look once: Unified, real-time object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 779–788, 2016.
  44. Multi-robot target detection and tracking: taxonomy and survey. Autonomous Robots, 40(4):729–760, 2016. Number: 4 Publisher: Springer.
  45. A review on object pose recovery: from 3d bounding box detectors to full 6d pose estimators. Image and Vision Computing, 96:103898, 2020. Publisher: Elsevier.
  46. SMaNa: Semantic Mapping and Navigation Architecture for Autonomous Robots. 2023.
  47. Fast and High-Quality Monocular Depth Estimation with Optical Flow for Autonomous Drones. Drones, 2023.
  48. Modeling and decision making in spatio-temporal processes for environmental surveillance. In 2010 IEEE International Conference on Robotics and Automation, pages 5490–5497. IEEE, 2010.
  49. A camera-based target detection and positioning UAV system for search and rescue (SAR) purposes. Sensors, 16(11):1778, 2016. Publisher: MDPI.
  50. Probabilistic target detection by camera-equipped UAVs. In in Proc. IEEE ICRA, pages 4076–4081, 2010.
  51. A novel hybrid algorithm based on PSO and FOA for target searching in unknown environments. Applied Intelligence, 49:2603–2622, 2019. Publisher: Springer.
  52. UAV based target finding and tracking in GPS-denied and cluttered environments. In 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 2307–2313. IEEE, 2016.
  53. Real-time multi-target localization from unmanned aerial vehicles. Sensors, 17(1):33, 2016. Number: 1 Publisher: MDPI.
  54. Evsen Yanmaz. Joint or decoupled optimization: Multi-UAV path planning for search and rescue. Ad Hoc Networks, 138:103018, 2023. Publisher: Elsevier.
  55. Semantic mapping with simultaneous object detection and localization. In RSJ International Conference on Intelligent Robots and Systems (IROS), pages 911–918, 2018.
  56. Enhancing Multi-UAV Reconnaissance and Search Through Double Critic DDPG With Belief Probability Maps. IEEE Trans. Intell. Veh., 2024.
  57. Vehicle Localization in a Completed City-Scale 3D Scene Using Aerial Images and an On-Board Stereo Camera. Remote Sensing, 15(15):3871, 2023. Publisher: MDPI.
  58. Fast active aerial exploration for traversable path finding of ground robots in unknown environments. IEEE Transactions on Instrumentation and Measurement, 71:1–13, 2022. Publisher: IEEE.
  59. A distributed model predictive control-based method for multidifferent-target search in unknown environments. IEEE Trans. Evol. Comput., 27(1):111–125, 2022.
  60. An intelligent cooperative mission planning scheme of UAV swarm in uncertain dynamic environment. Aerospace Science and Technology, 100:105826, 2020. Publisher: Elsevier.
  61. Detect-SLAM: Making object detection and SLAM mutually beneficial. In 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), pages 1001–1010. IEEE, 2018.
  62. A Multi-UAV System for Exploration and Target Finding in Cluttered and GPS-Denied Environments. In Proc. IEEE ICUAS, 2021.

Summary

No one has generated a summary of this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Summarize

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up