2000 character limit reached
An MCTS-DRL Based Obstacle and Occlusion Avoidance Methodology in Robotic Follow-Ahead Applications (2309.16884v1)
Published 28 Sep 2023 in cs.RO, cs.SY, and eess.SY
Abstract: We propose a novel methodology for robotic follow-ahead applications that address the critical challenge of obstacle and occlusion avoidance. Our approach effectively navigates the robot while ensuring avoidance of collisions and occlusions caused by surrounding objects. To achieve this, we developed a high-level decision-making algorithm that generates short-term navigational goals for the mobile robot. Monte Carlo Tree Search is integrated with a Deep Reinforcement Learning method to enhance the performance of the decision-making process and generate more reliable navigational goals. Through extensive experimentation and analysis, we demonstrate the effectiveness and superiority of our proposed approach in comparison to the existing follow-ahead human-following robotic methods. Our code is available at https://github.com/saharLeisiazar/follow-ahead-ros.
- S. Sekiguchi, A. Yorozu, K. Kuno, M. Okada, Y. Watanabe, and M. Takahashi, “Uncertainty-aware non-linear model predictive control for human-following companion robot,” in 2021 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2021, pp. 8316–8322.
- Q. Yan, J. Huang, Z. Yang, Y. Hasegawa, and T. Fukuda, “Human-following control of cane-type walking-aid robot within fixed relative posture,” IEEE/ASME Transactions on Mechatronics, 2021.
- D. Jin, Z. Fang, and J. Zeng, “A robust autonomous following method for mobile robots in dynamic environments,” IEEE Access, vol. 8, pp. 150 311–150 325, 2020.
- G. P. Moustris and C. S. Tzafestas, “Intention-based front-following control for an intelligent robotic rollator in indoor environments,” in 2016 IEEE Symposium Series on Computational Intelligence (SSCI). IEEE, 2016, pp. 1–7.
- P. Nikdel, R. Vaughan, and M. Chen, “Lbgp: Learning based goal planning for autonomous following in front,” in 2021 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2021, pp. 3140–3146.
- M. Mahdavian, P. Nikdel, M. TaherAhmadi, and M. Chen, “Stpotr: Simultaneous human trajectory and pose prediction using a non-autoregressive transformer for robot following ahead,” arXiv preprint arXiv:2209.07600, 2022.
- H. Yao, H. Dai, E. Zhao, P. Liu, and R. Zhao, “Laser-based side-by-side following for human-following robots,” in 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, pp. 2651–2656.
- J. Zou, “Predictive visual control network for occlusion solution in human-following robot,” Assembly Automation, 2021.
- M. F. Aslan, A. Durdu, K. Sabanci, and M. A. Mutluer, “Cnn and hog based comparison study for complete occlusion handling in human tracking,” Measurement, vol. 158, p. 107704, 2020.
- L. Pang, Y. Zhang, S. Coleman, and H. Cao, “Efficient hybrid-supervised deep reinforcement learning for person following robot,” Journal of Intelligent & Robotic Systems, vol. 97, no. 2, pp. 299–312, 2020.
- A. K. Ashe and K. M. Krishna, “Maneuvering intersections & occlusions using mpc-based prioritized tracking for differential drive person following robot,” in 2021 IEEE 17th International Conference on Automation Science and Engineering (CASE). IEEE, 2021, pp. 1352–1357.
- H. Shin and S.-E. Yoon, “Optimization-based path planning for person following using following field,” in 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2020, pp. 11 352–11 359.
- S. D. Holcomb, W. K. Porter, S. V. Ault, G. Mao, and J. Wang, “Overview on deepmind and its alphago zero ai,” in Proceedings of the 2018 international conference on big data and education, 2018, pp. 67–71.
- D. Silver, A. Huang, C. J. Maddison, A. Guez, L. Sifre, G. Van Den Driessche, J. Schrittwieser, I. Antonoglou, V. Panneershelvam, M. Lanctot et al., “Mastering the game of go with deep neural networks and tree search,” nature, vol. 529, no. 7587, pp. 484–489, 2016.
- T. Dam, G. Chalvatzaki, J. Peters, and J. Pajarinen, “Monte-carlo robot path planning,” IEEE Robotics and Automation Letters, vol. 7, no. 4, pp. 11 213–11 220, 2022.
- Y. Qian, K. Sheng, C. Ma, J. Li, M. Ding, and M. Hassan, “Path planning for the dynamic uav-aided wireless systems using monte carlo tree search,” IEEE Transactions on Vehicular Technology, 2022.
- A. Li, S. Bansal, G. Giovanis, V. Tolani, C. Tomlin, and M. Chen, “Generating robust supervision for learning-based visual navigation using hamilton-jacobi reachability,” in Learning for Dynamics and Control. PMLR, 2020, pp. 500–510.
- H. Van Hasselt, A. Guez, and D. Silver, “Deep reinforcement learning with double q-learning,” in Proceedings of the AAAI conference on artificial intelligence, vol. 30, no. 1, 2016.
- P. Auer, N. Cesa-Bianchi, and P. Fischer, “Finite-time analysis of the multiarmed bandit problem,” Machine learning, vol. 47, pp. 235–256, 2002.
- M. Brady, “Artificial intelligence and robotics,” Artificial intelligence, vol. 26, no. 1, pp. 79–121, 1985.
- C. Rösmann, F. Hoffmann, and T. Bertram, “Kinodynamic trajectory optimization and control for car-like robots,” in 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2017, pp. 5681–5686.
- V. Rabaud, “slam_gmapping,” https://https://github.com/ros-perception/slam_gmapping.
- Y. Huang, H. Bi, Z. Li, T. Mao, and Z. Wang, “Stgat: Modeling spatial-temporal interactions for human trajectory prediction,” in Proceedings of the IEEE/CVF international conference on computer vision, 2019, pp. 6272–6281.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Collections
Sign up for free to add this paper to one or more collections.
