Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
97 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

A System for Human-Robot Teaming through End-User Programming and Shared Autonomy (2401.12380v1)

Published 22 Jan 2024 in cs.RO

Abstract: Many industrial tasks-such as sanding, installing fasteners, and wire harnessing-are difficult to automate due to task complexity and variability. We instead investigate deploying robots in an assistive role for these tasks, where the robot assumes the physical task burden and the skilled worker provides both the high-level task planning and low-level feedback necessary to effectively complete the task. In this article, we describe the development of a system for flexible human-robot teaming that combines state-of-the-art methods in end-user programming and shared autonomy and its implementation in sanding applications. We demonstrate the use of the system in two types of sanding tasks, situated in aircraft manufacturing, that highlight two potential workflows within the human-robot teaming setup. We conclude by discussing challenges and opportunities in human-robot teaming identified during the development, application, and demonstration of our system.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (49)
  1. 2023. GrayMatter Robotics. https://graymatter-robotics.com/
  2. 2023. Nordbo Robotics. https://www.nordbo-robotics.com/
  3. 2023. Spot® - The Agile Mobile Robot. https://bostondynamics.com/products/spot/
  4. Haptic shared control: smoothly shifting control authority? Cognition, Technology & Work 14 (2012).
  5. A survey on end-user robot programming. ACM Computing Surveys (CSUR) 54, 8 (2021).
  6. Intuitive industrial robot programming through incremental multimodal language and augmented reality. In 2011 IEEE International Conference on Robotics and Automation. IEEE, 3934–3939.
  7. Learning robot objectives from physical human interaction. In Conference on Robot Learning. PMLR, 217–226.
  8. Combining interactive spatial augmented reality with head-mounted display for end-user collaborative robot programming. In 2019 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN). IEEE, 1–8.
  9. V. ra: An in-situ visual authoring system for robot-iot task planning with augmented reality. In Proceedings of the 2019 on Designing Interactive Systems Conference. 1059–1070.
  10. The ANBOT: An intelligent robotic co-worker for industrial abrasive blasting. In 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 8026–8033.
  11. Perception-aware human-assisted navigation of mobile robots on persistent trajectories. IEEE Robotics and Automation Letters 5, 3 (2020), 4711–4718.
  12. Fred D Davis. 1989. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS quarterly (1989), 319–340.
  13. Handheld Haptic Device with Coupled Bidirectional Input. In 2023 IEEE World Haptics Conference (WHC). IEEE, 453–459.
  14. Anca D Dragan and Siddhartha S Srinivasa. 2013. A policy-blending formalism for shared control. The International Journal of Robotics Research 32, 7 (2013).
  15. Mica R Endsley and Esin O Kiris. 1995. The out-of-the-loop performance problem and level of control in automation. Human factors 37, 2 (1995), 381–394.
  16. P. Evrard and A. Kheddar. 2009. Homotopy-based controller for physical human-robot interaction. In RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication. 1–6.
  17. Realizing mixed-reality environments with tablets for intuitive human-robot collaboration for object manipulation tasks. In 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). IEEE, 302–307.
  18. Study on application of a human-robot collaborative system using hand-guiding in a production line. IHI Eng. Rev 49, 1 (2016), 24–29.
  19. Yuxiang Gao and Chien-Ming Huang. 2019. PATI: a projection-based augmented table-top interface for robot programming. In Proceedings of the 24th international conference on intelligent user interfaces. 345–355.
  20. Industrial robotics. Springer handbook of robotics (2016), 1385–1422.
  21. Registering Articulated Objects With Human-in-the-loop Corrections. In 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2343–2350.
  22. Coordinated Multi-Robot Shared Autonomy Based on Scheduling and Demonstrations. IEEE Robotics and Automation Letters 8, 12 (2023), 8335–8342.
  23. Corrective shared autonomy for addressing task variability. IEEE robotics and automation letters 6, 2 (2021), 3720–3727.
  24. Informing real-time corrections in corrective shared autonomy through expert demonstrations. IEEE Robotics and Automation Letters 6, 4 (2021), 6442–6449.
  25. Shared autonomy via hindsight optimization for teleoperation and teaming. The International Journal of Robotics Research 37, 7 (2018), 717–742. https://doi.org/10.1177/0278364918776060
  26. Identifying optimal trajectory parameters in robotic finishing operations using minimum number of physical experiments. Integrated Computer-Aided Engineering 25, 2 (2018), 111–135.
  27. MOCA-MAN: A MObile and reconfigurable Collaborative Robot Assistant for conjoined huMAN-robot actions. In 2020 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 10191–10197.
  28. Mathieu Labbé and François Michaud. 2019. RTAB-Map as an open-source lidar and visual simultaneous localization and mapping library for large-scale and long-term online operation. Journal of Field Robotics 36, 2 (2019), 416–446.
  29. Jens Lambrecht and Jörg Krüger. 2012. Spatial programming for industrial robots based on gestures and augmented reality. In 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 466–472.
  30. Continuous Role Adaptation for Human–Robot Shared Control. IEEE Transactions on Robotics 31, 3 (2015), 672–681.
  31. Dylan P Losey and Marcia K O’Malley. 2017. Trajectory deformations from physical human–robot interaction. IEEE Transactions on Robotics 34, 1 (2017).
  32. Arc-lfd: Using augmented reality for interactive long-term robot skill maintenance via constrained learning from demonstration. In 2021 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 3794–3800.
  33. Collaborative human-robot framework for delicate sanding of complex shape surfaces. IEEE Robotics and Automation Letters 5, 2 (2020), 2848–2855.
  34. Semi-autonomous trajectory generation for mobile robots with integral haptic shared control. In 2014 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 6468–6475.
  35. Hammer: An Android based application for end-user industrial robot programming. In 2014 IEEE/ASME 10th International Conference on Mechatronic and Embedded Systems and Applications (MESA). IEEE, 1–6.
  36. Dynamic strategy selection for physical robotic assistance in partially known tasks. In 2013 IEEE International Conference on Robotics and Automation. 1180–1186.
  37. Collaborative or simply uncaged? understanding human-cobot interactions in automation. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–12.
  38. Lauren Milliken and Geoffrey A Hollinger. 2017. Modeling user expertise for choosing levels of shared autonomy. In 2017 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2285–2291.
  39. An efficient pbd framework for fast deployment of bi-manual assembly tasks. In 2018 IEEE-RAS 18th International Conference on Humanoid Robots (Humanoids). IEEE, 166–173.
  40. A model for types and levels of human interaction with automation. IEEE Transactions on systems, man, and cybernetics-Part A: Systems and Humans 30, 3 (2000).
  41. CoSTAR: Instructing collaborative robots with behavior trees and vision. In 2017 IEEE international conference on robotics and automation (ICRA). IEEE, 564–571.
  42. Optimizing makespan and ergonomics in integrating collaborative robots into manufacturing processes. IEEE transactions on automation science and engineering 15, 4 (2018), 1772–1784.
  43. Shared autonomy via deep reinforcement learning. arXiv preprint arXiv:1802.01744 (2018).
  44. Aircraft manufacturing and assembly. Springer handbook of automation (2009), 893–910.
  45. Autonomy in physical human-robot interaction: A brief survey. IEEE Robotics and Automation Letters 6, 4 (2021), 7989–7996.
  46. Situated live programming for human-robot collaboration. In The 34th Annual ACM Symposium on User Interface Software and Technology. 613–625.
  47. Task-level authoring for remote robot teleoperation. Frontiers in Robotics and AI 8 (2021), 707149.
  48. A survey of robot manipulation in contact. Robotics and Autonomous Systems 156 (2022).
  49. Optimization of temporal dynamics for adaptive human-robot interaction in assembly manufacturing. Robotics 8, 441 (2013), 10–15.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (6)
  1. Michael Hagenow (16 papers)
  2. Emmanuel Senft (24 papers)
  3. Robert Radwin (9 papers)
  4. Michael Gleicher (44 papers)
  5. Michael Zinn (14 papers)
  6. Bilge Mutlu (65 papers)
Citations (2)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now