Online Learning of Human Constraints from Feedback in Shared Autonomy
Abstract: Real-time collaboration with humans poses challenges due to the different behavior patterns of humans resulting from diverse physical constraints. Existing works typically focus on learning safety constraints for collaboration, or how to divide and distribute the subtasks between the participating agents to carry out the main task. In contrast, we propose to learn a human constraints model that, in addition, considers the diverse behaviors of different human operators. We consider a type of collaboration in a shared-autonomy fashion, where both a human operator and an assistive robot act simultaneously in the same task space that affects each other's actions. The task of the assistive agent is to augment the skill of humans to perform a shared task by supporting humans as much as possible, both in terms of reducing the workload and minimizing the discomfort for the human operator. Therefore, we propose an augmentative assistant agent capable of learning and adapting to human physical constraints, aligning its actions with the ergonomic preferences and limitations of the human operator.
- Relative entropy inverse reinforcement learning. In Proceedings of the fourteenth international conference on artificial intelligence and statistics, 182–189. JMLR Workshop and Conference Proceedings.
- Trust-aware decision making for human-robot collaboration: Model learning and planning. ACM Transactions on Human-Robot Interaction (THRI), 9(2): 1–23.
- Learning to collaborate from simulation for robot-assisted dressing. IEEE Robotics and Automation Letters, 5(2): 2746–2753.
- Using exoskeletons to assist medical staff during prone positioning of mechanically ventilated COVID-19 patients: a pilot study. In Advances in Human Factors and Ergonomics in Healthcare and Medical Devices: Proceedings of the AHFE 2021 Virtual Conference on Human Factors and Ergonomics in Healthcare and Medical Devices, July 25-29, 2021, USA, 88–100. Springer.
- Collaborative multiagent reinforcement learning by payoff propagation. Journal of Machine Learning Research, 7: 1789–1828.
- Towards proactive assistant robots for human assembly tasks. In Proceedings of the 6th international conference on Human-robot interaction, 175–176.
- An efficient, generalized Bellman update for cooperative inverse reinforcement learning. In International Conference on Machine Learning, 3394–3402. PMLR.
- Transfer of assembly operations to new workpiece poses by adaptation to the desired force profile. In 2013 16th International Conference on Advanced Robotics (ICAR), 1–7. IEEE.
- Efficient model learning from joint-action demonstrations for human-robot collaborative tasks. In Proceedings of the tenth annual ACM/IEEE international conference on human-robot interaction, 189–196.
- Deep decentralized multi-task multi-agent reinforcement learning under partial observability. In International Conference on Machine Learning, 2681–2690. PMLR.
- Recent development of rehabilitation robots. Advances in Mechanical Engineering, 7(2): 563062.
- Tejima, N. 2001. Rehabilitation robotics: a review. Advanced Robotics, 14(7): 551–564.
- Collaborative suturing: A reinforcement learning approach to automate hand-off task in suturing for surgical robots. In 2020 29th IEEE international conference on robot and human interactive communication (RO-MAN), 1380–1386. IEEE.
- Design and evaluation of the LOPES exoskeleton robot for interactive gait rehabilitation. IEEE Transactions on neural systems and rehabilitation engineering, 15(3): 379–386.
- Facilitating human–robot collaborative tasks by teaching-learning-collaboration from human demonstrations. IEEE Transactions on Automation Science and Engineering, 16(2): 640–653.
- Too Many Cooks: Bayesian Inference for Coordinating Multi-Agent Collaboration. Topics in Cognitive Science, 13(2): 414–432.
- Human-in-the-loop optimization of exoskeleton assistance during walking. Science, 356(6344): 1280–1284.
- Maximum entropy inverse reinforcement learning. In Aaai, volume 8, 1433–1438. Chicago, IL, USA.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.
