Papers
Topics
Authors
Recent
2000 character limit reached

DiPPeR: Diffusion-based 2D Path Planner applied on Legged Robots (2310.07842v3)

Published 11 Oct 2023 in cs.RO

Abstract: In this work, we present DiPPeR, a novel and fast 2D path planning framework for quadrupedal locomotion, leveraging diffusion-driven techniques. Our contributions include a scalable dataset generator for map images and corresponding trajectories, an image-conditioned diffusion planner for mobile robots, and a training/inference pipeline employing CNNs. We validate our approach in several mazes, as well as in real-world deployment scenarios on Boston Dynamic's Spot and Unitree's Go1 robots. DiPPeR performs on average 23 times faster for trajectory generation against both search based and data driven path planning algorithms with an average of 87% consistency in producing feasible paths of various length in maps of variable size, and obstacle structure. Website: https://rpl-cs-ucl.github.io/DiPPeR

Definition Search Book Streamline Icon: https://streamlinehq.com
References (30)
  1. J. Di Carlo, P. M. Wensing, B. Katz, G. Bledt, and S. Kim, “Dynamic Locomotion in the MIT Cheetah 3 Through Convex Model-Predictive Control,” in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2018, pp. 1–9.
  2. N. Rudin, D. Hoeller, P. Reist, and M. Hutter, “Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learning,” in Conference on Robot Learning, 2021.
  3. Z. Xie, X. Da, B. Babich, A. Garg, and M. van de Panne, “GLiDE: Generalizable Quadrupedal Locomotion in Diverse Environments with a Centroidal Model,” in Algorithmic Foundations of Robotics XV.   Springer International Publishing, 2023, pp. 523–539.
  4. C. Lau and K. Byl, “Smooth RRT-Connect: An Extension of RRT-connect for Practical Use in Robots,” in IEEE International Conference on Technologies for Practical Robot Applications, 2015, pp. 1–7.
  5. Y. Zhang, H. Jiang, X. Zhong, X. Zhong, and J. Zhao, “MI-RRT-Connect Algorithm for Quadruped Robotics Navigation with Efficiently Path Planning,” Journal of Physics: Conference Series, vol. 2402, no. 1, 2022.
  6. S. Choudhury, M. Bhardwaj, S. Arora, A. Kapoor, G. Ranade, S. Scherer, and D. Dey, “Data-Driven Planning via Imitation Learning,” The International Journal of Robotics Research, vol. 37, no. 13-14, pp. 1632–1672, 2018.
  7. R. Yonetani, T. Taniai, M. Barekatain, M. Nishimura, and A. Kanezaki, “Path Planning using Neural A* Search,” in 38th International Conference on Machine Learning, 2021, pp. 12 029–12 039.
  8. C. Chi, S. Feng, Y. Du, Z. Xu, E. Cousineau, B. Burchfiel, and S. Song, “Diffusion Policy: Visuomotor Policy Learning via Action Diffusion,” in Robotics: Science and Systems (RSS), 2023.
  9. J. Carvalho, A. T. Le, M. Baierl, D. Koert, and J. Peters, “Motion Planning Diffusion: Learning and Planning of Robot Motions with Diffusion Models,” arXiv preprint arXiv:2308.01557, 2023.
  10. M. Janner, Y. Du, J. Tenenbaum, and S. Levine, “Planning with Diffusion for Flexible Behavior Synthesis,” in International Conference on Machine Learning, 2022.
  11. H. Huang, Y. Li, and Q. Bai, “An improved A* Algorithm for Wheeled Robots Path Planning with Jump Points Search and Pruning Method,” Complex Eng Syst, vol. 2, p. 11, 2022.
  12. M. Kusuma, C. Machbub, et al., “Humanoid Robot Path Planning and Rerouting Using A-Star Search Algorithm,” in 2019 IEEE International Conference on Signals and Systems (ICSigSys).   IEEE, 2019, pp. 110–115.
  13. V. Sushrutha Raghavan, D. Kanoulas, D. G. Caldwell, and G. T. Nikos, “Reconfigurable and Agile Legged-Wheeled Robot Navigation in Cluttered Environments with Movable Obstacles,” IEEE Access, 2021.
  14. D. Kanoulas, C. Zhou, A. Nguyen, G. Kanoulas, D. G. Caldwell, and N. G. Tsagarakis, “Vision-Based Foothold Contact Reasoning using Curved Surface Patches,” in IEEE-RAS International Conference on Humanoids Robots (Humanoids), 2017, pp. 121–128.
  15. D. Kanoulas, A. Stumpf, V. Sushrutha Raghavan, C. Zhou, A. Toumpa, O. von Stryk, D. Caldwell, and N. Tsagarakis, “Footstep Planning in Rough Terrain for Bipedal Robots using Curved Contact Patches,” in IEEE International Conference on Robotics and Automation (ICRA), 2018.
  16. D. Kanoulas, N. G. Tsagarakis, and M. Vona, “Curved patch mapping and tracking for irregular terrain modeling: Application to bipedal robot foot placement,” Robotics and Autonomous Systems, 2019.
  17. M. Pfeiffer, M. Schaeuble, J. Nieto, R. Siegwart, and C. Cadena, “From Perception to Decision: A Data-Driven Approach to End-to-End Motion Planning for Autonomous Ground Robots,” in IEEE International Conference on Robotics and Automation (ICRA), 2017, pp. 1527–1533.
  18. B. Ichter and M. Pavone, “Robot Motion Planning in Learned Latent Spaces,” IEEE Robotics and Automation Letters, vol. 4, no. 3, pp. 2407–2414, 2019.
  19. L. Lee, E. Parisotto, D. S. Chaplot, E. Xing, and R. Salakhutdinov, “Gated Path Planning Networks,” in International Conference on Machine Learning, 2018, pp. 2947–2955.
  20. R. Yonetani, T. Taniai, M. Barekatain, M. Nishimura, and A. Kanezaki, “Path Planning Using Neural A* Search,” in International Conference on Machine Learning, 2021, pp. 12 029–12 039.
  21. J. Liu, S. Lyu, D. Hadjivelichkov, V. Modugno, and D. Kanoulas, “Legged Robot Path Planning using Vision Transformer A*,” in IEEE-RAS International Conference on Humanoids Robots (Humanoids), 2023.
  22. S. Hong, J. Lu, and D. P. Filev, “Dynamic Diffusion Maps-based Path Planning for Real-time Collision Avoidance of Mobile Robots,” in IEEE Intelligent Vehicles Symposium (IV), 2018, pp. 2224–2229.
  23. S. G. Tzafestas, “Mobile Robot Path, Motion, and Task Planning,” in Introduction to Mobile Robot Control.   Elsevier, 2014, pp. 429–478.
  24. H. Ali, S. Murad, and Z. Shah, “Spot the Fake Lungs: Generating Synthetic Medical Images Using Neural Diffusion Models,” in Artificial Intelligence and Cognitive Science, L. Longo and R. O’Reilly, Eds.   Cham: Springer Nature Switzerland, 2023, pp. 32–39.
  25. L. Yang, Z. Zhang, Y. Song, S. Hong, R. Xu, Y. Zhao, W. Zhang, B. Cui, and M.-H. Yang, “Diffusion Models: A Comprehensive Survey of Methods and Applications,” ACM Comput. Surv., 2023.
  26. R. Yamashita, M. Nishio, R. K. G. Do, and K. Togashi, “Convolutional Neural Networks: an Overview and Application in Radiology,” Insights into imaging, vol. 9, pp. 611–629, 2018.
  27. J. B. Kruskal, “On the Shortest Spanning Subtree of a Graph and the Traveling Salesman Problem,” Proceedings of the American Mathematical society, vol. 7, no. 1, pp. 48–50, 1956.
  28. J. Wen, X. Zhang, Q. Bi, Z. Pan, Y. Feng, J. Yuan, and Y. Fang, “MRPB 1.0: A Unified Benchmark for the Evaluation of Mobile Robot Local Planning Approaches,” in IEEE International Conference on Robotics and Automation (ICRA), 2021, pp. 8238–8244.
  29. C. Rösmann, W. Feiten, T. Wösch, F. Hoffmann, and T. Bertram, “Trajectory Modification Considering Dynamic Constraints of Autonomous Robots,” in German Conference on Robotics (ROBOTIK).   VDE, 2012, pp. 1–6.
  30. ——, “Efficient Trajectory Optimization Using a Sparse Model,” in European Conference on Mobile Robots, 2013, pp. 138–143.
Citations (13)

Summary

  • The paper introduces DiPPeR, a novel diffusion model framework that achieves trajectory generation speeds up to 70 times faster than conventional planners.
  • It employs an image-conditioned CNN pipeline to adapt paths for varying terrains, enhancing real-time navigation accuracy.
  • Empirical evaluations on platforms like Spot and Go1 reveal an 80% success rate, underscoring the planner's practical deployment potential.

Analysis of DiPPeR: A Novel Diffusion-Based 2D Path Planner for Legged Robots

The paper "DiPPeR: Diffusion-based 2D Path Planner applied on Legged Robots" introduces an innovative framework for path planning in mobile robotics, specifically targeting quadrupedal locomotion. DiPPeR offers a significant contribution to the domain by utilizing diffusion-driven techniques, promising advancements in both speed and efficiency. This essay explores the critical aspects of the research, underscoring its theoretical and practical implications.

Technical Overview

DiPPeR is presented as a solution to the enduring challenge of path planning for legged robots, which must autonomously navigate complex environments. The inherent complexity arises from the need to interpret real-time sensor data effectively and manage uncertainties within variable terrains. Traditional path planning methods such as Rapidly-exploring Random Trees (RRT) and AA^* algorithms often fall short in dynamic and unpredictable scenarios, especially when rapid trajectory generation is crucial.

Diffusion-Based Approach: At the core of DiPPeR is the denoising diffusion probabilistic model (DDPM) adapted to path planning tasks. This approach models the path planning problem as a transformation from a latent encoded state to a feasible trajectory within a maze-like or open environment. A Convolutional Neural Network (CNN) framework underpins the diffusion model, enhancing the pipeline's efficacy in image conditions.

Empirical Validation: The framework's performance was assessed against several benchmark paths and environmental setups using Boston Dynamics' Spot and Unitree's Go1 robots. Notably, DiPPeR demonstrated trajectory generation speed up to 70 times faster than both conventional search-based algorithms and contemporary neural network-based planners, with a consistent feasibility success rate of approximately 80%.

Contributions and Innovations

  1. Scalable Dataset: The researchers provide a comprehensive dataset of map images paired with feasible trajectories, enhancing the diffusion model's training with a robust set of end-to-end solutions.
  2. Conditional Planning: DiPPeR incorporates an image-conditioned planner, allowing it to adjust paths based on varying visual and start-goal configurations. This feature marks an advancement over static models that often require a continuous recalibration in the field.
  3. Platform Agnosticism: The methodology's implementation on diverse robotic platforms indicates its robustness and adaptability, two key features desired in real-world applications.
  4. Real-World Deployment: The integration of DiPPeR into existing robotic navigation frameworks, specifically evidenced through deployment on commercial quadrupeds, attests to its practical utility and readiness for real-time applications.

Theoretical and Practical Implications

Theoretical Significance: This approach underscores the potential of diffusion models in robotics, traditionally explored within different contexts such as image generation or manipulation planning. The application to path planning not only opens a new area of exploration but also integrates well with modern advances in neural processing.

Practical Impact: By significantly reducing the time required to compute trajectories even in unpredictable environments, DiPPeR could enhance the operational efficiency of autonomous systems engaged in logistics, exploration, or disaster response. Such efficiency gains are crucial for tasks demanding rapid adaptation and navigation precision.

Speculation on Future Developments

Future work could aim to address the limitations observed in DiPPeR's performance with longer trajectories. Exploring hybrid architectures, perhaps incorporating transformer models alongside CNNs, could potentially enhance its scalability and adaptability to even more complex environments. Furthermore, expanding the dataset to include additional environmental variables, like varying light conditions or terrain textures, may refine the planner's generalizability and robustness.

In conclusion, the paper provides a detailed and promising new framework for path planning, laying the groundwork for further research in facilitating more adaptable and faster robotic navigation solutions. The incorporation of diffusion-based methodologies represents a significant stride forward in addressing the dynamic challenges faced in autonomous robotics.

Slide Deck Streamline Icon: https://streamlinehq.com

Whiteboard

Dice Question Streamline Icon: https://streamlinehq.com

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Lightbulb Streamline Icon: https://streamlinehq.com

Continue Learning

We haven't generated follow-up questions for this paper yet.

List To Do Tasks Checklist Streamline Icon: https://streamlinehq.com

Collections

Sign up for free to add this paper to one or more collections.

X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets

This paper has been mentioned in 7 tweets and received 167 likes.

Upgrade to Pro to view all of the tweets about this paper:

Youtube Logo Streamline Icon: https://streamlinehq.com