Multi-Robot Collaborative Navigation with Formation Adaptation (2404.01618v1)
Abstract: Multi-robot collaborative navigation is an essential ability where teamwork and synchronization are keys. In complex and uncertain environments, adaptive formation is vital, as rigid formations prove to be inadequate. The ability of robots to dynamically adjust their formation enables navigation through unpredictable spaces, maintaining cohesion, and effectively responding to environmental challenges. In this paper, we introduce a novel approach that uses bi-level learning framework. Specifically, we use graph learning at a high level for group coordination and reinforcement learning for individual navigation. We innovate by integrating a spring-damper model within the reinforcement learning reward mechanism, addressing the rigidity of traditional formation control methods. During execution, our approach enables a team of robots to successfully navigate challenging environments, maintain a desired formation shape, and dynamically adjust their formation scale based on environmental information. We conduct extensive experiments to evaluate our approach across three distinct formation scenarios in multi-robot navigation: circle, line, and wedge. Experimental results show that our approach achieves promising results and scalability on multi-robot navigation with formation adaptation.
- Z. Ying and L. Xu, “Leader-follower formation control and obstacle avoidance of multi-robot based on artificial potential field,” in The 27th Chinese Control and Decision Conference (2015 CCDC). IEEE, 2015, pp. 4355–4360.
- D. Roy, A. Chowdhury, M. Maitra, and S. Bhattacharya, “Multi-robot virtual structure switching and formation changing strategy in an unknown occluded environment,” in 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2018, pp. 4854–4861.
- A. Benzerrouk, L. Adouane, and P. Martinet, “Stable navigation in formation for a multi-robot system based on a constrained virtual structure,” Robotics and Autonomous Systems, vol. 62, no. 12, pp. 1806–1815, 2014.
- J. Alonso-Mora, S. Baker, and D. Rus, “Multi-robot formation control and object transport in dynamic environments via constrained optimization,” The International Journal of Robotics Research, vol. 36, no. 9, pp. 1000–1021, 2017.
- J. Alonso-Mora, E. Montijano, M. Schwager, and D. Rus, “Distributed multi-robot formation control among obstacles: A geometric and optimization approach with consensus,” in 2016 IEEE international conference on robotics and automation (ICRA). IEEE, 2016, pp. 5356–5363.
- D. Koung, O. Kermorgant, I. Fantoni, and L. Belouaer, “Cooperative multi-robot object transportation system based on hierarchical quadratic programming,” IEEE Robotics and Automation Letters, vol. 6, no. 4, pp. 6466–6472, 2021.
- N. Hacene and B. Mendil, “Behavior-based autonomous navigation and formation control of mobile robots in unknown cluttered dynamic environments with dynamic target tracking,” International Journal of Automation and Computing, pp. 1–21, 2021.
- T. Fan, P. Long, W. Liu, and J. Pan, “Distributed multi-robot collision avoidance via deep reinforcement learning for navigation in complex scenarios,” The International Journal of Robotics Research, vol. 39, no. 7, pp. 856–892, 2020.
- J. Xie, R. Zhou, Y. Liu, J. Luo, S. Xie, Y. Peng, and H. Pu, “Reinforcement-learning-based asynchronous formation control scheme for multiple unmanned surface vehicles,” Applied Sciences, vol. 11, no. 2, p. 546, 2021.