Papers
Topics
Authors
Recent
Search
2000 character limit reached

Deep and Decentralized Multi-Agent Coverage of a Target with Unknown Distribution

Published 10 Jul 2023 in eess.SY and cs.SY | (2307.04407v1)

Abstract: This paper proposes a new architecture for multi-agent systems to cover an unknowingly distributed fast, safely, and decentralizedly. The inter-agent communication is organized by a directed graph with fixed topology, and we model agent coordination as a decentralized leader-follower problem with time-varying communication weights. Given this problem setting, we first present a method for converting communication graph into a neural network, where an agent can be represented by a unique node of the communication graph but multiple neurons of the corresponding neural network. We then apply a mass-cetric strategy to train time-varying communication weights of the neural network in a decentralized fashion which in turn implies that the observation zone of every follower agent is independently assigned by the follower based on positions of in-neighbors. By training the neural network, we can ensure safe and decentralized multi-agent coordination of coverage control. Despite the target is unknown to the agent team, we provide a proof for convergence of the proposed multi-agent coverage method.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (30)
  1. R. N. Haksar, S. Trimpe, and M. Schwager, “Spatial scheduling of informative meetings for multi-agent persistent coverage,” IEEE Robotics and Automation Letters, vol. 5, no. 2, pp. 3027–3034, 2020.
  2. E. Seraj and M. Gombolay, “Coordinated control of uavs for human-centered active sensing of wildfires,” in 2020 American Control Conference (ACC), 2020, pp. 1645–1652.
  3. X. Pan, M. Liu, F. Zhong, Y. Yang, S.-C. Zhu, and Y. Wang, “Mate: Benchmarking multi-agent reinforcement learning in distributed target coverage control,” Advances in Neural Information Processing Systems, vol. 35, pp. 27 862–27 879, 2022.
  4. A. Din, M. Y. Ismail, B. Shah, M. Babar, F. Ali, and S. U. Baig, “A deep reinforcement learning-based multi-agent area coverage control for smart agriculture,” Computers and Electrical Engineering, vol. 101, p. 108089, 2022.
  5. M. Davoodi, S. Faryadi, and J. M. Velni, “A graph theoretic-based approach for deploying heterogeneous multi-agent systems with application in precision agriculture,” Journal of Intelligent & Robotic Systems, vol. 101, pp. 1–15, 2021.
  6. E. Seraj, A. Silva, and M. Gombolay, “Multi-uav planning for cooperative wildfire coverage and tracking with quality-of-service guarantees,” Autonomous Agents and Multi-Agent Systems, vol. 36, no. 2, p. 39, 2022.
  7. J. I. Vasquez and E. A. Merchán-Cruz, “A divide and conquer strategy for sweeping coverage path planning,” Energies, vol. 15, no. 21, p. 7898, 2022.
  8. S. Bochkarev and S. L. Smith, “On minimizing turns in robot coverage path planning,” in 2016 IEEE international conference on automation science and engineering (CASE).   IEEE, 2016, pp. 1237–1242.
  9. T. M. Cabreira, C. Di Franco, P. R. Ferreira, and G. C. Buttazzo, “Energy-aware spiral coverage path planning for uav photogrammetric applications,” IEEE Robotics and automation letters, vol. 3, no. 4, pp. 3662–3668, 2018.
  10. Y.-H. Choi, T.-K. Lee, S.-H. Baek, and S.-Y. Oh, “Online complete coverage path planning for mobile robots based on linked spiral paths using constrained inverse distance transform,” in 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.   IEEE, 2009, pp. 5788–5793.
  11. P. Toth and D. Vigo, “An overview of vehicle routing problems,” The vehicle routing problem, pp. 1–26, 2002.
  12. K. Elamvazhuthi and S. Berman, “Nonlinear generalizations of diffusion-based coverage by robotic swarms,” in 2018 IEEE Conference on Decision and Control (CDC).   IEEE, 2018, pp. 1341–1346.
  13. S. Biswal, K. Elamvazhuthi, and S. Berman, “Decentralized control of multiagent systems using local density feedback,” IEEE Transactions on Automatic Control, vol. 67, no. 8, pp. 3920–3932, 2021.
  14. G. M. Atınç, D. M. Stipanović, and P. G. Voulgaris, “A swarm-based approach to dynamic coverage control of multi-agent systems,” Automatica, vol. 112, p. 108637, 2020.
  15. C. Song, G. Feng, Y. Fan, and Y. Wang, “Decentralized adaptive awareness coverage control for multi-agent networks,” Automatica, vol. 47, no. 12, pp. 2749–2756, 2011.
  16. A. Dirafzoon, M. B. Menhaj, and A. Afshar, “Decentralized coverage control for multi-agent systems with nonlinear dynamics,” IEICE TRANSACTIONS on Information and Systems, vol. 94, no. 1, pp. 3–10, 2011.
  17. V. Krishnan and S. Martínez, “A multiscale analysis of multi-agent coverage control algorithms,” Automatica, vol. 145, p. 110516, 2022.
  18. Y. Feng, G. Lu, W. Bai, J. Zhao, Y. Bai, and T. Xu, “Rapid coverage control with multi-agent systems based on k-means algorithm,” in 2020 7th International Conference on Information, Cybernetics, and Computational Social Systems (ICCSS), 2020, pp. 870–874.
  19. A. A. Adepegba, “Multi-agent area coverage control using reinforcement learning techniques,” Ph.D. dissertation, Université d’Ottawa/University of Ottawa, 2016.
  20. A. Dai, R. Li, Z. Zhao, and H. Zhang, “Graph convolutional multi-agent reinforcement learning for uav coverage control,” in 2020 International Conference on Wireless Communications and Signal Processing (WCSP).   IEEE, 2020, pp. 1106–1111.
  21. J. Xiao, G. Wang, Y. Zhang, and L. Cheng, “A distributed multi-agent dynamic area coverage algorithm based on reinforcement learning,” IEEE Access, vol. 8, pp. 33 511–33 521, 2020.
  22. M. Kouzehgar, M. Meghjani, and R. Bouffanais, “Multi-agent reinforcement learning for dynamic ocean monitoring by a swarm of buoys,” in Global Oceans 2020: Singapore–US Gulf Coast.   IEEE, 2020, pp. 1–8.
  23. Y. Bai, Y. Wang, M. Svinin, E. Magid, and R. Sun, “Adaptive multi-agent coverage control with obstacle avoidance,” IEEE Control Systems Letters, vol. 6, pp. 944–949, 2021.
  24. M. T. Nguyen, L. Rodrigues, C. S. Maniu, and S. Olaru, “Discretized optimal control approach for dynamic multi-agent decentralized coverage,” in 2016 IEEE International Symposium on Intelligent Control (ISIC).   IEEE, 2016, pp. 1–6.
  25. F. Abbasi, A. Mesbahi, and J. M. Velni, “A new voronoi-based blanket coverage control method for moving sensor networks,” IEEE Transactions on Control Systems Technology, vol. 27, no. 1, pp. 409–417, 2017.
  26. W. Luo and K. Sycara, “Voronoi-based coverage control with connectivity maintenance for robotic sensor networks,” in 2019 International Symposium on Multi-Robot and Multi-Agent Systems (MRS).   IEEE, 2019, pp. 148–154.
  27. S. Patel, S. Hariharan, P. Dhulipala, M. C. Lin, D. Manocha, H. Xu, and M. Otte, “Multi-agent coverage in urban environments,” arXiv preprint arXiv:2008.07436, 2020.
  28. H. Rastgoftar and I. V. Kolmanovsky, “Safe affine transformation-based guidance of a large-scale multi-quadcopter system (mqs),” IEEE Transactions on Control of Network Systems, 2021.
  29. A. E. Asslouj and H. Rastgoftar, “Quadcopter tracking using euler-angle-free flatness-based control,” arXiv preprint arXiv:2212.01540, 2022.
  30. H. Rastgoftar, “Integration of a* search and classic optimal control for safe planning of continuum deformation of a multiquadcopter system,” IEEE Transactions on Aerospace and Electronic Systems, vol. 58, no. 5, pp. 4119–4134, 2022.

Summary

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Authors (1)

Collections

Sign up for free to add this paper to one or more collections.