Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
169 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Dynamic Mobile Manipulation via Whole-Body Bilateral Teleoperation of a Wheeled Humanoid (2307.01350v1)

Published 3 Jul 2023 in cs.RO

Abstract: Humanoid robots have the potential to help human workers by realizing physically demanding manipulation tasks such as moving large boxes within warehouses. We define such tasks as Dynamic Mobile Manipulation (DMM). This paper presents a framework for DMM via whole-body teleoperation, built upon three key contributions: Firstly, a teleoperation framework employing a Human Machine Interface (HMI) and a bi-wheeled humanoid, SATYRR, is proposed. Secondly, the study introduces a dynamic locomotion mapping, utilizing human-robot reduced order models, and a kinematic retargeting strategy for manipulation tasks. Additionally, the paper discusses the role of whole-body haptic feedback for wheeled humanoid control. Finally, the system's effectiveness and mappings for DMM are validated through locomanipulation experiments and heavy box pushing tasks. Here we show two forms of DMM: grasping a target moving at an average speed of 0.4 m/s, and pushing boxes weighing up to 105\% of the robot's weight. By simultaneously adjusting their pitch and using their arms, the pilot adjusts the robot pose to apply larger contact forces and move a heavy box at a constant velocity of 0.2 m/s.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (23)
  1. L. Penco, B. Clément, V. Modugno, E. M. Hoffman, G. Nava, D. Pucci, N. G. Tsagarakis, J.-B. Mouret, and S. Ivaldi, “Robust real-time whole-body motion retargeting from human to humanoid,” in 2018 IEEE-RAS 18th International Conference on Humanoid Robots (Humanoids).   IEEE, 2018, pp. 425–432.
  2. A. Dallard, M. Benallegue, F. Kanehiro, and A. Kheddar, “Synchronized human-humanoid motion imitation,” IEEE Robotics and Automation Letters, 2023.
  3. A. Purushottam, Y. Jung, K. Murphy, D. Baek, and J. Ramos, “Hands-free telelocomotion of a wheeled humanoid,” in 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).   IEEE, 2022, pp. 8313–8320.
  4. S. Wang and J. Ramos, “Dynamic locomotion teleoperation of a wheeled humanoid robot reduced model with a whole-body human-machine interface,” arXiv preprint arXiv:2109.03906, 2021.
  5. J. Ramos and S. Kim, “Humanoid dynamic synchronization through whole-body bilateral feedback teleoperation,” IEEE Transactions on Robotics, vol. 34, no. 4, pp. 953–965, 2018.
  6. Y. Ishiguro, T. Makabe, Y. Nagamatsu, Y. Kojio, K. Kojima, F. Sugai, Y. Kakiuchi, K. Okada, and M. Inaba, “Bilateral humanoid teleoperation system using whole-body exoskeleton cockpit tablis,” IEEE Robotics and Automation Letters, vol. 5, no. 4, pp. 6419–6426, 2020.
  7. A. Dietrich, T. Wimböck, and A. Albu-Schäffer, “Dynamic whole-body mobile manipulation with a torque controlled humanoid robot via impedance control laws,” in 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.   IEEE, 2011, pp. 3199–3206.
  8. G. Zambella, G. Lentini, M. Garabini, G. Grioli, M. G. Catalano, A. Palleschi, L. Pallottino, A. Bicchi, A. Settimi, and D. Caporale, “Dynamic whole-body control of unstable wheeled humanoid robots,” IEEE Robotics and Automation Letters, vol. 4, no. 4, pp. 3489–3496, 2019.
  9. H. Chen, B. Wang, Z. Hong, C. Shen, P. M. Wensing, and W. Zhang, “Underactuated motion planning and control for jumping with wheeled-bipedal robots,” IEEE Robotics and Automation Letters, vol. 6, no. 2, pp. 747–754, 2020.
  10. H. Zhou, X. Li, H. Feng, J. Li, S. Zhang, and Y. Fu, “Model decoupling and control of the wheeled humanoid robot moving in sagittal plane,” in 2019 IEEE-RAS 19th International Conference on Humanoid Robots (Humanoids).   IEEE, 2019, pp. 1–6.
  11. G. Colin, Y. Sim, and J. Ramos, “Bipedal robot walking control using human whole-body dynamic telelocomotion,” arXiv preprint arXiv:2209.06964, 2022.
  12. M. V. Minniti, R. Grandia, K. Fäh, F. Farshidian, and M. Hutter, “Model predictive robot-environment interaction control for mobile manipulation tasks,” in 2021 IEEE International Conference on Robotics and Automation (ICRA).   IEEE, 2021, pp. 1651–1657.
  13. M. Stilman, J. Olson, and W. Gloss, “Golem krang: Dynamically stable humanoid robot for mobile manipulation,” in 2010 IEEE International Conference on Robotics and Automation.   IEEE, 2010, pp. 3304–3309.
  14. M. Mittal, D. Hoeller, F. Farshidian, M. Hutter, and A. Garg, “Articulated object interaction in unknown scenes with whole-body mobile manipulation,” in 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).   IEEE, 2022, pp. 1647–1654.
  15. J. Li and Q. Nguyen, “Kinodynamics-based pose optimization for humanoid loco-manipulation,” arXiv preprint arXiv:2303.04985, 2023.
  16. Y. Wu, P. Balatti, M. Lorenzini, F. Zhao, W. Kim, and A. Ajoudani, “A teleoperation interface for loco-manipulation control of mobile collaborative robotic assistant,” IEEE Robotics and Automation Letters, vol. 4, no. 4, pp. 3593–3600, 2019.
  17. N. E. Sian, K. Yokoi, S. Kajita, F. Kanehiro, and K. Tanie, “Whole body teleoperation of a humanoid robot development of a simple master device using joysticks,” Journal of the Robotics Society of Japan, vol. 22, no. 4, pp. 519–527, 2004.
  18. K. Otani and K. Bouyarmane, “Adaptive whole-body manipulation in human-to-humanoid multi-contact motion retargeting,” in 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids).   IEEE, 2017, pp. 446–453.
  19. R. A. Grupen, “Putting it all together: Balancing the cart-pole,” Department of Computer Science, University of Massachusetts, Tech. Rep., 2015. [Online]. Available: https://www-robotics.cs.umass.edu/~grupen/503/SLIDES/cart-pole.pdf
  20. A. Hof, M. Gazendam, and W. Sinke, “The condition for dynamic stability,” Journal of biomechanics, vol. 38, no. 1, pp. 1–8, 2005.
  21. S. Caron, “Divergent components of motion,” 2019, -JRLSeminar at CNRS-AISTJointRoboticsLaboratory Tsukuba. [Online]. Available: https://scaron.info/slides/jrl-2019.pdf
  22. S. Asif and P. Webb, “Kinematics analysis of 6-dof articulated robot with spherical wrist,” Mathematical Problems in Engineering, vol. 2021, p. 11, 2021.
  23. Y. Sim and J. Ramos, “Tello leg: The study of design principles and metrics for dynamic humanoid robots,” IEEE Robotics and Automation Letters, vol. 7, no. 4, pp. 9318–9325, 2022.
Citations (13)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now