Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
125 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Pedipulate: Enabling Manipulation Skills using a Quadruped Robot's Leg (2402.10837v1)

Published 16 Feb 2024 in cs.RO, cs.AI, cs.SY, and eess.SY

Abstract: Legged robots have the potential to become vital in maintenance, home support, and exploration scenarios. In order to interact with and manipulate their environments, most legged robots are equipped with a dedicated robot arm, which means additional mass and mechanical complexity compared to standard legged robots. In this work, we explore pedipulation - using the legs of a legged robot for manipulation. By training a reinforcement learning policy that tracks position targets for one foot, we enable a dedicated pedipulation controller that is robust to disturbances, has a large workspace through whole-body behaviors, and can reach far-away targets with gait emergence, enabling loco-pedipulation. By deploying our controller on a quadrupedal robot using teleoperation, we demonstrate various real-world tasks such as door opening, sample collection, and pushing obstacles. We demonstrate load carrying of more than 2.0 kg at the foot. Additionally, the controller is robust to interaction forces at the foot, disturbances at the base, and slippery contact surfaces. Videos of the experiments are available at https://sites.google.com/leggedrobotics.com/pedipulate.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (37)
  1. J. Lee, et al., “Learning quadrupedal locomotion over challenging terrain,” Science Robotics, vol. 5, no. 47, p. eabc5986, 2020.
  2. T. Miki, et al., “Learning robust perceptive locomotion for quadrupedal robots in the wild,” Science Robotics, vol. 7, no. 62, p. eabk2822, 2022.
  3. S. Choi, et al., “Learning quadrupedal locomotion on deformable terrain,” Science Robotics, vol. 8, no. 74, p. eade2256, 2023.
  4. D. Hoeller, et al., “Anymal parkour: Learning agile navigation for quadrupedal robots,” arXiv preprint arXiv:2306.14874, 2023.
  5. M. Hutter, et al., “Towards a generic solution for inspection of industrial sites,” in Field and Service Robotics: Results of the 11th International Conference.   Springer, 2018, pp. 575–589.
  6. H. Kolvenbach, et al., “Towards autonomous inspection of concrete deterioration in sewers with legged robots,” Journal of Field Robotics, vol. 37, no. 8, pp. 1314–1327, 2020.
  7. M. Stachowiak, et al., “Procedures of detecting damage to a conveyor belt with use of an inspection legged robot for deep mine infrastructure,” Minerals, vol. 11, no. 10, p. 1040, 2021.
  8. M. Tranzatto, et al., “Cerberus in the darpa subterranean challenge,” Science Robotics, vol. 7, no. 66, p. eabp9742, 2022.
  9. P. Arm, et al., “Scientific exploration of challenging planetary analog environments with a team of legged robots,” Science robotics, vol. 8, no. 80, p. eade9548, 2023.
  10. B. Lindqvist, et al., “Multimodality robotic systems: Integrated combined legged-aerial mobility for subterranean search-and-rescue,” Robotics and Autonomous Systems, vol. 154, p. 104134, 2022.
  11. C. D. Bellicoso, et al., “Alma-articulated locomotion and manipulation for a torque-controllable robot,” in 2019 International conference on robotics and automation (ICRA).   IEEE, 2019, pp. 8477–8483.
  12. S. Zimmermann, et al., “Go fetch!-dynamic grasps using boston dynamics spot with external robotic arm,” in 2021 IEEE International Conference on Robotics and Automation (ICRA).   IEEE, 2021, pp. 4488–4494.
  13. M. Mittal, et al., “Articulated object interaction in unknown scenes with whole-body mobile manipulation,” in 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).   IEEE, 2022, pp. 1647–1654.
  14. H. Ferrolho, et al., “Roloma: Robust loco-manipulation for quadruped robots with arms,” arXiv preprint arXiv:2203.01446, 2022.
  15. J.-P. Sleiman, et al., “Versatile multicontact planning and control for legged loco-manipulation,” Science Robotics, vol. 8, no. 81, p. eadg5014, 2023.
  16. A. Pets, “Dogs and cats opening doors,” https://www.youtube.com/watch?v=MGGFNO3TVpg, online; accessed 06-September-2023.
  17. S. Jeon, et al., “Learning whole-body manipulation for quadrupedal robot,” arXiv preprint arXiv:2308.16820, 2023.
  18. O. Nachum, et al., “Multi-agent manipulation via locomotion using hierarchical sim2real,” arXiv preprint arXiv:1908.05224, 2019.
  19. M. J. Mataric, et al., “Cooperative multi-robot box-pushing,” in Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots, vol. 3.   IEEE, 1995, pp. 556–561.
  20. B. Lu, et al., “Autonomous obstacle legipulation with a hexapod robot,” arXiv preprint arXiv:2011.06227, 2020.
  21. Y. Ji, et al., “Hierarchical reinforcement learning for precise soccer shooting skills using a quadrupedal robot,” in 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).   IEEE, 2022, pp. 1479–1486.
  22. F. Shi, et al., “Circus anymal: A quadruped learning dexterous manipulation with its limbs,” in 2021 IEEE International Conference on Robotics and Automation (ICRA).   IEEE, 2021, pp. 2316–2323.
  23. H. Kolvenbach, et al., “Haptic inspection of planetary soils with legged robots,” IEEE Robotics and Automation Letters, vol. 4, no. 2, pp. 1626–1632, 2019.
  24. T. T. Topping, et al., “Quasi-static and dynamic mismatch for door opening and stair climbing with a legged robot,” in 2017 IEEE International Conference on Robotics and Automation (ICRA).   IEEE, 2017, pp. 1080–1087.
  25. P. Fankhauser, et al., “Free gait—an architecture for the versatile control of legged robots,” in 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).   IEEE, 2016, pp. 1052–1058.
  26. X. Cheng, et al., “Legs as manipulator: Pushing quadrupedal agility beyond locomotion,” arXiv preprint arXiv:2303.11330, 2023.
  27. A. Roennau, et al., “Lauron v: A versatile six-legged walking robot with advanced maneuverability,” in 2014 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.   IEEE, 2014, pp. 82–87.
  28. G. Heppner, et al., “Versatile-high power gripper for a six legged walking robot,” in Mobile Service Robotics.   World Scientific, 2014, pp. 461–468.
  29. W. Brinkmann, et al., “Enhancement of the six-legged robot mantis for assembly and construction tasks in lunar mission scenarios within a multi-robot team,” in Proceedings: International Symposium on Artificial Intelligence, Robotics and Automation in Space, 2020.
  30. Y. Tsvetkov and S. Ramamoorthy, “A novel design and evaluation of a dactylus-equipped quadruped robot for mobile manipulation,” in 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).   IEEE, 2022, pp. 1633–1638.
  31. A. Agarwal, et al., “Legged locomotion in challenging terrains using egocentric vision,” in Conference on Robot Learning.   PMLR, 2023, pp. 403–415.
  32. N. Rudin, et al., “Learning to walk in minutes using massively parallel deep reinforcement learning,” in Conference on Robot Learning.   PMLR, 2022, pp. 91–100.
  33. V. Makoviychuk, et al., “Isaac gym: High performance gpu-based physics simulation for robot learning,” arXiv preprint arXiv:2108.10470, 2021.
  34. J. Schulman, et al., “Proximal policy optimization algorithms,” arXiv preprint arXiv:1707.06347, 2017.
  35. ANYbotics, “Anymal specifications,” https://www.anybotics.com/anymal-autonomous-legged-robot/, online; accessed 27-January-2023.
  36. J. Hwangbo, et al., “Learning agile and dynamic motor skills for legged robots,” Science Robotics, vol. 4, no. 26, p. eaau5872, 2019.
  37. S. Khattak, et al., “Complementary multi–modal sensor fusion for resilient robot pose estimation in subterranean environments,” in 2020 International Conference on Unmanned Aircraft Systems (ICUAS).   IEEE, 2020, pp. 1024–1029.
Citations (17)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
Youtube Logo Streamline Icon: https://streamlinehq.com

YouTube