Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
126 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Efficient Motion Planning for Manipulators with Control Barrier Function-Induced Neural Controller (2404.01184v1)

Published 1 Apr 2024 in cs.RO and cs.LG

Abstract: Sampling-based motion planning methods for manipulators in crowded environments often suffer from expensive collision checking and high sampling complexity, which make them difficult to use in real time. To address this issue, we propose a new generalizable control barrier function (CBF)-based steering controller to reduce the number of samples needed in a sampling-based motion planner RRT. Our method combines the strength of CBF for real-time collision-avoidance control and RRT for long-horizon motion planning, by using CBF-induced neural controller (CBF-INC) to generate control signals that steer the system towards sampled configurations by RRT. CBF-INC is learned as Neural Networks and has two variants handling different inputs, respectively: state (signed distance) input and point-cloud input from LiDAR. In the latter case, we also study two different settings: fully and partially observed environmental information. Compared to manually crafted CBF which suffers from over-approximating robot geometry, CBF-INC can balance safety and goal-reaching better without being over-conservative. Given state-based input, our neural CBF-induced neural controller-enhanced RRT (CBF-INC-RRT) can increase the success rate by 14% while reducing the number of nodes explored by 30%, compared with vanilla RRT on hard test cases. Given LiDAR input where vanilla RRT is not directly applicable, we demonstrate that our CBF-INC-RRT can improve the success rate by 10%, compared with planning with other steering controllers. Our project page with supplementary material is at https://mit-realm.github.io/CBF-INC-RRT-website/.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (54)
  1. S. M. LaValle and J. J. Kuffner Jr, “Randomized kinodynamic planning,” The international journal of robotics research, vol. 20, no. 5, pp. 378–400, 2001.
  2. L. Kavraki, P. Svestka, J.-C. Latombe, and M. Overmars, “Probabilistic roadmaps for path planning in high-dimensional configuration spaces,” IEEE Transactions on Robotics and Automation, vol. 12, no. 4, pp. 566–580, 1996.
  3. D. J. Webb and J. Van Den Berg, “Kinodynamic rrt*: Asymptotically optimal motion planning for robots with linear dynamics,” in 2013 IEEE international conference on robotics and automation.   IEEE, 2013, pp. 5054–5061.
  4. R. Kala, “Rapidly exploring random graphs: motion planning of multiple mobile robots,” Advanced Robotics, vol. 27, no. 14, pp. 1113–1122, 2013.
  5. M. Brunner, B. Brüggemann, and D. Schulz, “Hierarchical rough terrain motion planning using an optimal sampling-based method,” in 2013 IEEE International Conference on Robotics and Automation.   IEEE, 2013, pp. 5539–5544.
  6. J. Wang, W. Chi, C. Li, C. Wang, and M. Q.-H. Meng, “Neural rrt*: Learning-based optimal path planning,” IEEE Transactions on Automation Science and Engineering, vol. 17, no. 4, pp. 1748–1758, 2020.
  7. B. Ichter, E. Schmerling, T.-W. E. Lee, and A. Faust, “Learned critical probabilistic roadmaps for robotic motion planning,” in 2020 IEEE International Conference on Robotics and Automation (ICRA).   IEEE, 2020, pp. 9535–9541.
  8. A. D. Ames, J. W. Grizzle, and P. Tabuada, “Control barrier function based quadratic programs with application to adaptive cruise control,” in 53rd IEEE Conference on Decision and Control, 2014, pp. 6271–6278.
  9. A. D. Ames, X. Xu, J. W. Grizzle, and P. Tabuada, “Control barrier function based quadratic programs for safety critical systems,” IEEE Transactions on Automatic Control, vol. 62, no. 8, pp. 3861–3876, 2016.
  10. A. Manjunath and Q. Nguyen, “Safe and robust motion planning for dynamic robotics via control barrier functions,” in 2021 60th IEEE Conference on Decision and Control (CDC).   IEEE, 2021, pp. 2122–2128.
  11. G. Yang, B. Vang, Z. Serlin, C. Belta, and R. Tron, “Sampling-based motion planning via control barrier functions,” in Proceedings of the 2019 3rd International Conference on Automation, Control and Robots, 2019, pp. 22–29.
  12. A. Ahmad, C. Belta, and R. Tron, “Adaptive sampling-based motion planning with control barrier functions,” in 2022 IEEE 61st Conference on Decision and Control (CDC).   IEEE, 2022, pp. 4513–4518.
  13. G. Yang, M. Cai, A. Ahmad, C. Belta, and R. Tron, “Efficient lqr-cbf-rrt*: Safe and optimal motion planning,” arXiv preprint arXiv:2304.00790, 2023.
  14. G. Wu and K. Sreenath, “Safety-critical control of a planar quadrotor,” in 2016 American control conference (ACC).   IEEE, 2016, pp. 2252–2258.
  15. Q. Nguyen, A. Hereid, J. W. Grizzle, A. D. Ames, and K. Sreenath, “3d dynamic walking on stepping stones with control barrier functions,” in 2016 IEEE 55th Conference on Decision and Control (CDC).   IEEE, 2016, pp. 827–834.
  16. A. Singletary, W. Guffey, T. G. Molnar, R. Sinnet, and A. D. Ames, “Safety-critical manipulation for collision-free food preparation,” IEEE Robotics and Automation Letters, vol. 7, no. 4, pp. 10 954–10 961, 2022.
  17. B. Dai, R. Khorrambakht, P. Krishnamurthy, V. Gonçalves, A. Tzes, and F. Khorrami, “Safe navigation and obstacle avoidance using differentiable optimization based control barrier functions,” arXiv preprint arXiv:2304.08586, 2023.
  18. C. T. Landi, F. Ferraguti, S. Costi, M. Bonfè, and C. Secchi, “Safety barrier functions for human-robot interaction with industrial manipulators,” in 2019 18th European Control Conference (ECC), 2019, pp. 2565–2570.
  19. C. Chang, M. J. Chung, and B. H. Lee, “Collision avoidance of two general robot manipulators by minimum delay time,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 24, no. 3, pp. 517–522, 1994.
  20. E. Rimon and S. P. Boyd, “Obstacle collision detection using best ellipsoid fit,” Journal of Intelligent and Robotic Systems, vol. 18, pp. 105–126, 1997.
  21. H.-C. Lin, Y. Fan, T. Tang, and M. Tomizuka, “Human guidance programming on a 6-dof robot with collision avoidance,” in 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2016, pp. 2676–2681.
  22. A. Singletary, P. Nilsson, T. Gurriet, and A. D. Ames, “Online active safety for robotic manipulators,” in 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2019, pp. 173–178.
  23. A. Singletary, S. Kolathaya, and A. D. Ames, “Safety-critical kinematic control of robotic systems,” IEEE Control Systems Letters, vol. 6, pp. 139–144, 2022.
  24. F. Castaneda, J. J. Choi, B. Zhang, C. J. Tomlin, and K. Sreenath, “Gaussian process-based min-norm stabilizing controller for control-affine systems with uncertain input effects and dynamics,” in 2021 American Control Conference (ACC).   IEEE, 2021, pp. 3683–3690.
  25. D. Sun, S. Jha, and C. Fan, “Learning certified control using contraction metric,” in Conference on Robot Learning.   PMLR, 2021, pp. 1519–1539.
  26. Z. Qin, K. Zhang, Y. Chen, J. Chen, and C. Fan, “Learning safe multi-agent control with decentralized neural barrier certificates,” arXiv preprint arXiv:2101.05436, 2021.
  27. C. Dawson, B. Lowenkamp, D. Goff, and C. Fan, “Learning safe, generalizable perception-based hybrid control with certificates,” IEEE Robotics and Automation Letters, vol. 7, no. 2, pp. 1904–1911, 2022.
  28. S. Dean, N. Matni, B. Recht, and V. Ye, “Robust guarantees for perception-based control,” in Learning for Dynamics and Control.   PMLR, 2020, pp. 350–360.
  29. O. Khatib, “Real-time obstacle avoidance for manipulators and mobile robots,” in Proceedings. 1985 IEEE International Conference on Robotics and Automation, vol. 2, 1985, pp. 500–505.
  30. A. De Santis, A. Albu-Schaffer, C. Ott, B. Siciliano, and G. Hirzinger, “The skeleton algorithm for self-collision avoidance of a humanoid manipulator,” in 2007 IEEE/ASME international conference on advanced intelligent mechatronics, 2007, pp. 1–6.
  31. F. Flacco, T. Kröger, A. De Luca, and O. Khatib, “A depth space approach to human-robot collision avoidance,” in 2012 IEEE International Conference on Robotics and Automation, 2012, pp. 338–345.
  32. P. Holmes, S. Kousik, B. Zhang, D. Raz, C. Barbalata, M. Johnson-Roberson, and R. Vasudevan, “Reachable sets for safe, real-time manipulator trajectory design,” arXiv preprint arXiv:2002.01591, 2020.
  33. P. Wieland and F. Allgöwer, “Constructive safety using control barrier functions,” IFAC Proceedings Volumes, vol. 40, no. 12, pp. 462–467, 2007.
  34. J. Haviland and P. Corke, “Neo: A novel expeditious optimisation algorithm for reactive motion control of manipulators,” IEEE Robotics and Automation Letters, vol. 6, no. 2, pp. 1043–1050, 2021.
  35. T.-H. Pham, G. De Magistris, and R. Tachibana, “Optlayer-practical constrained optimization for deep reinforcement learning in the real world,” in 2018 IEEE International Conference on Robotics and Automation (ICRA).   IEEE, 2018, pp. 6236–6243.
  36. M. Koptev, N. Figueroa, and A. Billard, “Neural joint space implicit signed distance functions for reactive robot manipulator control,” IEEE Robotics and Automation Letters, vol. 8, no. 2, pp. 480–487, 2023.
  37. P. Liu, K. Zhang, D. Tateo, S. Jauhri, Z. Hu, J. Peters, and G. Chalvatzaki, “Safe reinforcement learning of dynamic high-dimensional robotic tasks: navigation, manipulation, interaction,” arXiv preprint arXiv:2209.13308, 2022.
  38. S. McIlvanna, N. N. Minh, Y. Sun, M. Van, and W. Naeem, “Reinforcement learning-enhanced control barrier functions for robot manipulators,” arXiv preprint arXiv:2211.11391, 2022.
  39. B. Ichter, J. Harrison, and M. Pavone, “Learning sampling distributions for robot motion planning,” in 2018 IEEE International Conference on Robotics and Automation (ICRA).   IEEE, 2018, pp. 7087–7094.
  40. T. Jurgenson and A. Tamar, “Harnessing reinforcement learning for neural motion planning,” arXiv preprint arXiv:1906.00214, 2019.
  41. R. Strudel, R. G. Pinel, J. Carpentier, J.-P. Laumond, I. Laptev, and C. Schmid, “Learning obstacle representations for neural motion planning,” in Conference on Robot Learning.   PMLR, 2021, pp. 355–364.
  42. R. Zhang, C. Yu, J. Chen, C. Fan, and S. Gao, “Learning-based motion planning in dynamic environments using gnns and temporal encoding,” in Advances in Neural Information Processing Systems, 2022.
  43. L. Janson, E. Schmerling, A. Clark, and M. Pavone, “Fast marching tree: A fast marching sampling-based method for optimal motion planning in many dimensions,” The International journal of robotics research, vol. 34, no. 7, pp. 883–921, 2015.
  44. S. M. Persson and I. Sharf, “Sampling-based a* algorithm for robot path-planning,” The International Journal of Robotics Research, vol. 33, no. 13, pp. 1683–1708, 2014.
  45. C. Yu and S. Gao, “Reducing collision checking for sampling-based motion planning using graph neural networks,” Advances in Neural Information Processing Systems, vol. 34, pp. 4274–4289, 2021.
  46. C. Zhang, J. Huh, and D. D. Lee, “Learning implicit sampling distributions for motion planning,” in 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).   IEEE, 2018, pp. 3654–3661.
  47. M. Pfeiffer, M. Schaeuble, J. Nieto, R. Siegwart, and C. Cadena, “From perception to decision: A data-driven approach to end-to-end motion planning for autonomous ground robots,” in 2017 ieee international conference on robotics and automation (icra).   IEEE, 2017, pp. 1527–1533.
  48. A. H. Qureshi, A. Simeonov, M. J. Bency, and M. C. Yip, “Motion planning networks,” in 2019 International Conference on Robotics and Automation (ICRA).   IEEE, 2019, pp. 2118–2124.
  49. X. Wang, “Ensuring safety of learning-based motion planners using control barrier functions,” IEEE Robotics and Automation Letters, vol. 7, no. 2, pp. 4773–4780, 2022.
  50. X. Huang, D. Kroening, W. Ruan, J. Sharp, Y. Sun, E. Thamo, M. Wu, and X. Yi, “A survey of safety and trustworthiness of deep neural networks: Verification, testing, adversarial attack and defence, and interpretability,” Computer Science Review, vol. 37, p. 100270, 2020.
  51. C. R. Qi, H. Su, K. Mo, and L. J. Guibas, “Pointnet: Deep learning on point sets for 3d classification and segmentation,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 652–660.
  52. T. P. Lillicrap, J. J. Hunt, A. Pritzel, N. Heess, T. Erez, Y. Tassa, D. Silver, and D. Wierstra, “Continuous control with deep reinforcement learning,” arXiv preprint arXiv:1509.02971, 2015.
  53. F. Torabi, G. Warnell, and P. Stone, “Behavioral cloning from observation,” arXiv preprint arXiv:1805.01954, 2018.
  54. J. D. Gammell, S. S. Srinivasa, and T. D. Barfoot, “Bit*: Batch informed trees for optimal sampling-based planning via dynamic programming on implicit random geometric graphs,” arXiv preprint arXiv:1405.5848, 2014.
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now