Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
153 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Humanoid Robots at work: where are we ? (2404.04249v1)

Published 5 Apr 2024 in cs.CY, cs.HC, and cs.RO

Abstract: Launched by Elon Musk and its Optimus, we are witnessing a new race in which many companies have already engaged. The objective it to put at work a new generation of humanoid robots in demanding industrial environments within 2 or 3 years. Is this objective realistic ? The aim of this document and its main contributions is to provide some hints by covering the following topics: First an analysis of 12 companies based on eight criteria that will help us to distinguish companies based on their maturity and approach to the market; second as these humanoids are very complex systems we will provide an overview of the technological challenges to be addressed; third when humanoids are deployed at scale, Operation and Maintenance become critical and the we will explore what is new with these complex machines; Finally Pilots are the last step to test the feasibility of a new system before mass deployment. This is an important step to test the maturity of a product and the strategy of the humanoid supplier to address a market and two pragmatic approaches will be discussed.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (59)
  1. Evan Ackerman. Agility’s latest digit robot prepares for its first job. https://spectrum.ieee.org/agility-robotics-digit, 2023.
  2. Evan Ackerman. Apptronik developing general-purpose humanoid robot: Apollo will be a practical bipedal platform that can do useful tasks. https://spectrum.ieee.org/humanoid-robot-apptronik-apollo/, 2023.
  3. Evan Ackerman. Figure unveils its humanoid robot prototype. https://spectrum.ieee.org/figure-humanoid-robot-2665982283, 2023.
  4. Evan Ackerman. Sanctuary’s humanoid robot is for general-purpose autonomy. https://spectrum.ieee.org/sanctuary-humanoid-robot, 2023.
  5. Evan Ackerman. Nvidia announces gr00t, a foundation model for humanoids. https://spectrum.ieee.org/nvidia-gr00t-ros, 2024.
  6. Closed-form inverse kinematic joint solution for humanoid robots. 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 704–709, 2010.
  7. Loz Blain. Figure’s brett adcock on the practicalities of humanoid robot workers. https://newatlas.com/robotics/figure-brett-adcock-interview-practicalities-humanoid-robot-workers/, 2023.
  8. Loz Blain. Gr-1 general-purpose humanoid robot will carry nearly its own weight. https://newatlas.com/robotics/fourier-gr1-humanoid-robot/, 2023.
  9. Cyber security of robots: A comprehensive survey. Intelligent Systems with Applications, 18:200237, 2023.
  10. Rt-2: Vision-language-action models transfer web knowledge to robotic control. ArXiv, abs/2307.15818, 2023.
  11. The pinocchio c++ library – a fast and flexible implementation of rigid body dynamics algorithms and their analytical derivatives. In IEEE International Symposium on System Integrations (SII), 2019.
  12. Diffusion policy: Visuomotor policy learning via action diffusion. ArXiv, abs/2303.04137, 2023.
  13. Universal manipulation interface: In-the-wild robot teaching without in-the-wild robots. In arXiv, 2024.
  14. Steve Crowe. GXO logistics putting digit humanoid to test. https://www.therobotreport.com/gxo-logistics-putting-digit-humanoid-to-test/, 2023.
  15. Palm-e: An embodied multimodal language model. In International Conference on Machine Learning, 2023.
  16. LimX Dynamics. LimX dynamics unveils dynamic testing of humanoid robot, achieving real-time perceptive stair climbing and more. https://medium.com/@limxdynamics/limx-dynamics-unveils-dynamic-testing-of-humanoid-robot-achieving-real-time-perceptive-stair-51d37b0cc6a5, 2023.
  17. Bipedal humanoid hardware design: a technology review. Current Robotics Reports, 2:201 – 210, 2021.
  18. Strips: A new approach to the application of theorem proving to problem solving. Artif. Intell., 2:189–208, 1971.
  19. Dexpilot: Vision-based teleoperation of dexterous robotic hand-arm system. 2020 IEEE International Conference on Robotics and Automation (ICRA), pages 9164–9170, 2019.
  20. Brian Heater. Openai-backed 1x raises another $100m for the race to humanoid robots. https://techcrunch.com/2024/01/11/openai-backed-1x-raises-another-100m-for-the-race-to-humanoid-robots/, 2024.
  21. HSE. Transportation and storage statistics in great britain, 2022. Technical report, HSE, 2022. https://www.hse.gov.uk/statistics/industry/transportation.pdf.
  22. Krystal Hu. Bmw taps humanoid startup figure to take on tesla’s robot. https://www.reuters.com/business/autos-transportation/bmw-taps-humanoid-startup-figure-take-teslas-robot-2024-01-18/, 2024.
  23. Eric Jang. Data collection for embodied learning and smart behavior. https://www.1x.tech/discover/data-collection-for-embodied-learning, 2023.
  24. Eric Jang. All neural networks. all autonomous. all 1x speed. https://www.1x.tech/discover/all-neural-networks-all-autonomous-all-1x-speed, 2024.
  25. Effective virtual reality teleoperation of an upper-body humanoid with modified task jacobians and relaxed barrier functions for self-collision avoidance. In Workshop on Horizons of an Extended Robotics Reality, 2022.
  26. Simon Kalouche. Goat: A legged robot with 3d agility and virtual compliance. 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 4110–4117, 2017.
  27. Mini cheetah: A platform for pushing the limits of dynamic quadruped control. 2019 International Conference on Robotics and Automation (ICRA), pages 6295–6301, 2019.
  28. Kepler. Ces 2024 spotlight: Kepler’s humanoid robot launch gains international recognition. https://www.prnewswire.com/news-releases/ces-2024-spotlight-keplers-humanoid-robot-launch-gains-international-recognition-302040175.html, 2023.
  29. John Koetsier. Apptronik has a totally different approach to building humanoid robots. https://johnkoetsier.com/humanoid-robots/, 2023.
  30. John Koetsier. Sanctuary ai humanoid general purpose robot: a deep dive with ceo geordie ross. https://johnkoetsier.com/sanctuary-ai-humanoid-robot/, 2023.
  31. Vision-based teleoperation of shadow dexterous hand using end-to-end deep neural network. 2019 International Conference on Robotics and Automation (ICRA), pages 416–422, 2018.
  32. A survey of multifingered robotic manipulation: Biological results, structural evolvements, and learning methods. Frontiers in Neurorobotics, 16, 2022.
  33. Rita Liao. Why this autonomous vehicle veteran joined a legged robotics startup. https://johnkoetsier.com/sanctuary-ai-humanoid-robot/https://techcrunch.com/2023/11/06/why-this-autonomous-vehicle-veteran-joined-a-legged-robotics-startup/, 2023.
  34. Preliminary survey of backdrivable linear actuators for humanoid robots. In ROMANSY 22 – Robot Design, Dynamics and Control, pages 304–313. Springer International Publishing, 2019.
  35. Jyoti Mann. Sam altman’s openai wants to get humanoid robots talking. here’s why. https://www.businessinsider.com/openai-bets-big-on-humanoid-robots-with-figure-ai-2024-2, 2024.
  36. Gillian Tan Mark Gurman and Bloomberg. Jeff bezos and nvidia join openai and microsoft in backing a humanoid robot unicorn valued at $2 billion, sources say. https://fortune.com/2024/02/23/jeff-bezos-nvidia-openai-microsoft-robot-unicorn-figureai-funding-round/, 2024.
  37. OSU news. Cassie sets a guinness world record. https://agilityrobotics.com/news/2022/cassie-sets-a-guinness-world-record, 2023.
  38. Octo: An open-source generalist robot policy. https://octo-models.github.io, 2023.
  39. Mike Oitzman. Figure 01 humanoid takes first public steps. https://www.therobotreport.com/figure-01-humanoid-takes-first-public-steps/, 2023.
  40. Mike Oitzman. Unitree teases new h1 humanoid robot. https://www.therobotreport.com/unitree-teases-new-h1-humanoid-robot/, 2023.
  41. Mike Oitzman. Watch boston dynamics’ atlas humanoid handle automotive struts. https://www.therobotreport.com/boston-dynamics-atlas-humanoid-handle-automotive-struts/, 2024.
  42. South China Morning Post. China plans to be a world leader in artificial intelligence by 2030. https://multimedia.scmp.com/news/china/article/2166148/china-2025-artificial-intelligence/index.html, 2018. original document in chinese https://www.miit.gov.cn/jgsj/kjs/wjfb/art/2023/art_50316f76a9b1454b898c7bb2a5846b79.html.
  43. South China Morning Post. China says humanoid robots are new engine of growth, pushes for mass production by 2025 and world leadership by 2027. https://www.scmp.com/news/china/politics/article/3240259/china-says-humanoid-robots-are-new-engine-growth-pushes-mass-production-2025-and-world-leadership, 2023.
  44. Jerry E. Pratt. Exploiting inherent robustness and natural dynamics in the control of bipedal walking robots. Phd thesis, Massachusetts Institute of Technology, Cambridge, MA, USA, 2000., 2000.
  45. PRO ROBOTS. Wrc 2023 - china’s largest robot exhibition — robots and technologies at the exhibition in china. https://www.youtube.com/watch?v=8cJV08MTwA0, 2023.
  46. Performance analysis and feedback control of atrias, a three-dimensional bipedal robot. Journal of Dynamic Systems Measurement and Control-transactions of The Asme, 136:021012, 2014.
  47. Agility Robotics. Agility robotics broadens relationship with amazon. https://agilityrobotics.com/news/2023/expanded-partnership-amazon, 2023.
  48. Deep imitation learning for humanoid loco-manipulation through human teleoperation. 2023 IEEE-RAS 22nd International Conference on Humanoid Robots (Humanoids), pages 1–8, 2023.
  49. Videodex: Learning dexterity from internet videos. In Conference on Robot Learning, 2022.
  50. Jill Shen. Xpeng tech day 2023: first mpv, self-driving timeline, flying cars, and humanoid robots. https://technode.com/2023/10/25/xpeng-tech-day-2023-first-mpv-self-driving-timeline-flying-cars-and-humanoid-robots/, 2023.
  51. IHMC Development Team. IHMC open robotics software. https://github.com/ihmcrobotics/ihmc-open-robotics-software, 2016.
  52. TRI Team. Toyota research institute unveils breakthrough in teaching robots new behaviors. https://www.tri.global/news/toyota-research-institute-unveils-breakthrough-teaching-robots-new-behaviors, 2023.
  53. Russ Tedrake. Robotic Manipulation. 2023.
  54. Russ Tedrake and the Drake Development Team. Drake: Model-based design and verification for robotics. https://drake.mit.edu, 2019.
  55. Poco: Policy composition from and for heterogeneous robot learning. ArXiv, abs/2402.02511, 2024.
  56. Chain of thought prompting elicits reasoning in large language models. ArXiv, abs/2201.11903, 2022.
  57. Optimization-based control for dynamic legged robots. IEEE Transactions on Robotics, 40:43–63, 2022.
  58. A review on sensory perception for dexterous robotic manipulation. International Journal of Advanced Robotic Systems, 19, 2022.
  59. Large language models for robotics: A survey. ArXiv, abs/2311.07226, 2023.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now