Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
125 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Decentralized Multi-Agent Active Search and Tracking when Targets Outnumber Agents (2401.03154v2)

Published 6 Jan 2024 in cs.RO, cs.AI, cs.LG, and cs.MA

Abstract: Multi-agent multi-target tracking has a wide range of applications, including wildlife patrolling, security surveillance or environment monitoring. Such algorithms often make restrictive assumptions: the number of targets and/or their initial locations may be assumed known, or agents may be pre-assigned to monitor disjoint partitions of the environment, reducing the burden of exploration. This also limits applicability when there are fewer agents than targets, since agents are unable to continuously follow the targets in their fields of view. Multi-agent tracking algorithms additionally assume inter-agent synchronization of observations, or the presence of a central controller to coordinate joint actions. Instead, we focus on the setting of decentralized multi-agent, multi-target, simultaneous active search-and-tracking with asynchronous inter-agent communication. Our proposed algorithm DecSTER uses a sequential monte carlo implementation of the probability hypothesis density filter for posterior inference combined with Thompson sampling for decentralized multi-agent decision making. We compare different action selection policies, focusing on scenarios where targets outnumber agents. In simulation, we demonstrate that DecSTER is robust to unreliable inter-agent communication and outperforms information-greedy baselines in terms of the Optimal Sub-Pattern Assignment (OSPA) metric for different numbers of targets and varying teamsizes.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (27)
  1. M. Popović, T. Vidal-Calleja, G. Hitz, J. J. Chung, I. Sa, R. Siegwart, and J. Nieto, “An informative path planning framework for uav-based terrain monitoring,” Autonomous Robots, vol. 44, pp. 889–911, 2020.
  2. J. A. Placed, J. Strader, H. Carrillo, N. Atanasov, V. Indelman, L. Carlone, and J. A. Castellanos, “A survey on active simultaneous localization and mapping: State of the art and new frontiers,” IEEE Transactions on Robotics, 2023.
  3. C. Robin and S. Lacroix, “Multi-robot target detection and tracking: taxonomy and survey,” Autonomous Robots, vol. 40, pp. 729–760, 2016.
  4. S. Papaioannou, P. Kolios, T. Theocharides, C. G. Panayiotou, and M. M. Polycarpou, “A cooperative multiagent probabilistic framework for search and track missions,” IEEE Transactions on Control of Network Systems, vol. 8, no. 2, pp. 847–858, 2020.
  5. J. Chen and P. Dames, “Active multi-target search using distributed thompson sampling,” 2022.
  6. R. R. Murphy, “Human-robot interaction in rescue robotics,” IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), vol. 34, no. 2, pp. 138–153, 2004.
  7. L. Doitsidis, S. Weiss, A. Renzaglia, M. W. Achtelik, E. Kosmatopoulos, R. Siegwart, and D. Scaramuzza, “Optimal surveillance coverage for teams of micro aerial vehicles in gps-denied environments using onboard vision,” Autonomous Robots, vol. 33, pp. 173–188, 2012.
  8. T. Oskam, R. W. Sumner, N. Thuerey, and M. Gross, “Visibility transition planning for dynamic camera control,” in Proceedings of the 2009 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 2009, pp. 55–65.
  9. R. E. Kalman, “A new approach to linear filtering and prediction problems,” 1960.
  10. S. S. Blackman, “Multiple hypothesis tracking for multiple target tracking,” IEEE Aerospace and Electronic Systems Magazine, vol. 19, no. 1, pp. 5–18, 2004.
  11. T. Fortmann, Y. Bar-Shalom, and M. Scheffe, “Sonar tracking of multiple targets using joint probabilistic data association,” IEEE journal of Oceanic Engineering, vol. 8, no. 3, pp. 173–184, 1983.
  12. R. P. Mahler, “Multitarget bayes filtering via first-order multitarget moments,” IEEE Transactions on Aerospace and Electronic systems, vol. 39, no. 4, pp. 1152–1178, 2003.
  13. B. Ristic, D. Clark, and B.-N. Vo, “Improved smc implementation of the phd filter,” in 2010 13th International Conference on Information Fusion.   IEEE, 2010, pp. 1–8.
  14. P. Dames, P. Tokekar, and V. Kumar, “Detecting, localizing, and tracking an unknown number of moving targets using a team of mobile robots,” The International Journal of Robotics Research, vol. 36, no. 13-14, pp. 1540–1553, 2017.
  15. P. M. Dames, “Distributed multi-target search and tracking using the phd filter,” Autonomous robots, vol. 44, no. 3-4, pp. 673–689, 2020.
  16. J. Chen and P. Dames, “Distributed multi-target search and tracking using a coordinated team of ground and aerial robots,” in Robotics science and systems, 2020.
  17. H. Van Nguyen, B.-N. Vo, B.-T. Vo, H. Rezatofighi, and D. C. Ranasinghe, “Multi-objective multi-agent planning for discovering and tracking multiple mobile objects,” arXiv preprint arXiv:2203.04551, 2022.
  18. P. Xin and P. Dames, “Comparing stochastic optimization methods for multi-robot, multi-target tracking,” in International Symposium on Distributed and Autonomous Systems, 2022.
  19. H. Jeong, H. Hassani, M. Morari, D. D. Lee, and G. J. Pappas, “Deep reinforcement learning for active target tracking,” in 2021 IEEE International Conference on Robotics and Automation (ICRA).   IEEE, 2021, pp. 1825–1831.
  20. L. Zhou, V. D. Sharma, Q. Li, A. Prorok, A. Ribeiro, P. Tokekar, and V. Kumar, “Graph neural networks for decentralized multi-robot target tracking,” in 2022 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).   IEEE, 2022, pp. 195–202.
  21. M. Tzes, N. Bousias, E. Chatzipantazis, and G. J. Pappas, “Graph neural networks for multi-robot active information acquisition,” in 2023 IEEE International Conference on Robotics and Automation (ICRA).   IEEE, 2023, pp. 3497–3503.
  22. R. Ghods, A. Banerjee, and J. Schneider, “Decentralized multi-agent active search for sparse signals,” in Uncertainty in Artificial Intelligence.   PMLR, 2021, pp. 696–706.
  23. N. A. Bakshi, T. Gupta, R. Ghods, and J. Schneider, “Guts: Generalized uncertainty-aware thompson sampling for multi-agent active search,” in 2023 IEEE International Conference on Robotics and Automation (ICRA), 2023, pp. 7735–7741.
  24. D. J. Russo, B. Van Roy, A. Kazerouni, I. Osband, Z. Wen, et al., “A tutorial on thompson sampling,” Foundations and Trends® in Machine Learning, vol. 11, no. 1, pp. 1–96, 2018.
  25. Z. Zhou, B. Hajek, N. Choi, and A. Walid, “Regenerative particle thompson sampling,” arXiv preprint arXiv:2203.08082, 2022.
  26. S. Thrun, “Probabilistic robotics,” Communications of the ACM, vol. 45, no. 3, pp. 52–57, 2002.
  27. B. Ristic, B.-N. Vo, and D. Clark, “A note on the reward function for phd filters with sensor control,” IEEE Transactions on Aerospace and Electronic Systems, vol. 47, no. 2, pp. 1521–1529, 2011.
Citations (3)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets