Adaptable Recovery Behaviors in Robotics: A Behavior Trees and Motion Generators(BTMG) Approach for Failure Management (2404.06129v2)
Abstract: In dynamic operational environments, particularly in collaborative robotics, the inevitability of failures necessitates robust and adaptable recovery strategies. Traditional automated recovery strategies, while effective for predefined scenarios, often lack the flexibility required for on-the-fly task management and adaptation to expected failures. Addressing this gap, we propose a novel approach that models recovery behaviors as adaptable robotic skills, leveraging the Behavior Trees and Motion Generators~(BTMG) framework for policy representation. This approach distinguishes itself by employing reinforcement learning~(RL) to dynamically refine recovery behavior parameters, enabling a tailored response to a wide array of failure scenarios with minimal human intervention. We assess our methodology through a series of progressively challenging scenarios within a peg-in-a-hole task, demonstrating the approach's effectiveness in enhancing operational efficiency and task success rates in collaborative robotics settings. We validate our approach using a dual-arm KUKA robot.
- F. Rovida, D. Wuthier, B. Grossmann, M. Fumagalli, and V. Krüger, “Motion Generators Combined with Behavior Trees: A Novel Approach to Skill Modelling,” in 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2018, pp. 5964–5971.
- F. Jusuf, A. Susanto, A. Waluyo, and N. Siwhan, “Review on defenses against common cause failures on digital safety system,” in AIP Conference Proceedings, vol. 2374, no. 1. AIP Publishing, 2021.
- Y. Lei, J. Wilch, B. Rupprecht, and B. Vogel-Heuser, “Artificial intelligence planning of failure recovery strategies in discrete manufacturing automation,” in 2023 IEEE 19th International Conference on Automation Science and Engineering (CASE). IEEE, 2023, pp. 1–8.
- L. V. Alves and P. N. Pena, “Secure recovery procedure for manufacturing systems using synchronizing automata and supervisory control theory,” IEEE Transactions on Automation Science and Engineering, vol. 19, no. 1, pp. 486–496, 2020.
- M. R. Pedersen, L. Nalpantidis, R. S. Andersen, C. Schou, S. Bøgh, V. Krüger, and O. Madsen, “Robot skills for manufacturing: From concept to industrial deployment,” Robotics and Computer-Integrated Manufacturing, vol. 37, pp. 282–291, 2016.
- F. Rovida, M. Crosby, D. Holz, A. S. Polydoros, B. Großmann, R. P. Petrick, and V. Krüger, “SkiROS-A skill-based robot control platform on top of ROS,” in Studies in Computational Intelligence, 2017, vol. 707, pp. 121–160.
- M. Mayr, F. Rovida, and V. Krueger, “Skiros2: A skill-based robot control platform for ros,” in 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2023, pp. 6273–6280.
- A. Herzig, L. Perrussel, and Z. Xiao, “On hierarchical task networks,” in Logics in Artificial Intelligence: 15th European Conference, JELIA 2016, Larnaca, Cyprus, November 9-11, 2016, Proceedings 15. Springer, 2016, pp. 551–557.
- M. Iovino, J. Förster, P. Falco, J. J. Chung, R. Siegwart, and C. Smith, “On the programming effort required to generate behavior trees and finite state machines for robotic applications,” in 2023 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2023, pp. 5807–5813.
- J. Styrud, M. Mayr, E. Hellsten, V. Krueger, and C. Smith, “Bebop–combining reactive planning and bayesian optimization to solve robotic manipulation tasks,” in 2024 International Conference on Robotics and Automation (ICRA). IEEE, 2024.
- G. Council and S. Revzen, “Recovery of behaviors encoded via bilateral constraints,” arXiv preprint arXiv:2005.00506.
- J. Lee, J. Hwangbo, and M. Hutter, “Robust recovery controller for a quadrupedal robot using deep reinforcement learning,” arXiv preprint arXiv:1901.07517, 2019.
- H. Wu, S. Luo, H. Lin, S. Duan, Y. Guan, and J. Rojas, “Recovering from external disturbances in online manipulation through state-dependent revertive recovery policies,” in 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). IEEE, 2018, pp. 166–173.
- Z. Gu, N. Boyd, and Y. Zhao, “Reactive locomotion decision-making and robust motion planning for real-time perturbation recovery,” in 2022 International Conference on Robotics and Automation (ICRA). IEEE, 2022, pp. 1896–1902.
- S. Koos, A. Cully, and J.-B. Mouret, “Fast damage recovery in robotics with the t-resilience algorithm,” The International Journal of Robotics Research, vol. 32, no. 14, pp. 1700–1723, 2013.
- M. Iovino, E. Scukins, J. Styrud, P. Ögren, and C. Smith, “A survey of behavior trees in robotics and ai,” 2020.
- R. Ghzouli, T. Berger, E. B. Johnsen, A. Wasowski, and S. Dragule, “Behavior trees and state machines in robotics applications,” IEEE Transactions on Software Engineering, 2023.
- R. Wu, S. Kortik, and C. H. Santos, “Automated behavior tree error recovery framework for robotic systems,” in 2021 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2021, pp. 6898–6904.
- A. De Luca, L. Muratore, and N. G. Tsagarakis, “Autonomous navigation with online replanning and recovery behaviors for wheeled-legged robots using behavior trees,” IEEE Robotics and Automation Letters, 2023.
- C. Pezzato, C. Hernandez, and M. Wisse, “Active inference and behavior trees for reactive action planning and execution in robotics. arxiv,” arXiv preprint arXiv:2011.09756, 2020.
- C. Paxton, N. Ratliff, C. Eppner, and D. Fox, “Representing robot task plans as robust logical-dynamical systems,” in 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2019, pp. 5588–5595.
- M. Olsson, “Behavior trees for decision-making in autonomous driving,” 2016.
- M. Colledanchise and P. Ögren, “How Behavior Trees modularize robustness and safety in hybrid systems,” in 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2014, pp. 1482–1488.
- O. Biggar, M. Zamani, and I. Shames, “On modularity in reactive control architectures, with an application to formal verification,” ACM Transactions on Cyber-Physical Systems (TCPS), vol. 6, no. 2, pp. 1–36, 2022.
- F. Ahmad, M. Mayr, E. A. Topp, J. Malec, and V. Krueger, “Generalizing behavior trees and motion-generator (btmg) policy representation for robotic tasks over scenario parameters,” in 2022 IJCAI Planning and Reinforcement Learning Workshop, 2022.
- F. Ahmad, M. Mayr, and V. Krueger, “Learning to adapt the parameters of behavior trees and motion generators (btmgs) to task variations,” 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 10 133–10 140, 2023. [Online]. Available: https://api.semanticscholar.org/CorpusID:257532298
- M. Mayr, K. Chatzilygeroudis, F. Ahmad, L. Nardi, and V. Krueger, “Learning of Parameters in Behavior Trees for Movement Skills,” in 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2021.
- M. Mayr, F. Ahmad, K. Chatzilygeroudis, L. Nardi, and V. Krueger, “Skill-based multi-objective reinforcement learning of industrial robot tasks with planning and knowledge integration,” in 2022 IEEE International Conference on Robotics and Biomimetics (ROBIO). IEEE, 2022, pp. 1995–2002.
- ——, “Combining planning, reasoning and reinforcement learning to solve industrial robot tasks,” IROS 2022 Workshop on Trends and Advances in Machine Learning and Automated Reasoning for Intelligent Robots and Systems, 2022.
- F. Ahmad, M. Mayr, and V. Krueger, “Learning to adapt the parameters of behavior trees and motion generators (btmgs) to task variations,” in 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2023, pp. 10 133–10 140.
- M. Mayr, C. Hvarfner, K. Chatzilygeroudis, L. Nardi, and V. Krueger, “Learning skill-based industrial robot tasks with user priors,” in 2022 IEEE 18th International Conference on Automation Science and Engineering (CASE). IEEE, 2022, pp. 1485–1492.
- K. Chatzilygeroudis, R. Rama, R. Kaushik, D. Goepp, V. Vassiliades, and J.-B. Mouret, “Black-box data-efficient policy search for robotics,” in 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2017, pp. 51–58.
- K. Chatzilygeroudis, V. Vassiliades, F. Stulp, S. Calinon, and J.-B. Mouret, “A survey on policy search algorithms for learning robot controllers in a handful of trials,” IEEE Transactions on Robotics, vol. 36, no. 2, pp. 328–347, 2019.
- L. Nardi, D. Koeplinger, and K. Olukotun, “Practical design space exploration,” in International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, 2019.
- M. Mayr, F. Ahmad, A. Duerr, and V. Krueger, “Using knowledge representation and task planning for robot-agnostic skills on the example of contact-rich wiping tasks,” in 2023 IEEE 19th International Conference on Automation Science and Engineering (CASE). IEEE, 2023, pp. 1–7.
- S. Nasiriany, H. Liu, and Y. Zhu, “Augmenting reinforcement learning with behavior primitives for diverse manipulation tasks,” in 2022 International Conference on Robotics and Automation (ICRA). IEEE, 2022, pp. 7477–7484.
- J. Lee, M. Grey, S. Ha, T. Kunz, S. Jain, Y. Ye, S. Srinivasa, M. Stilman, and C. Liu, “DART: Dynamic Animation and Robotics Toolkit,” Journal of Open Source Software, vol. 3, no. 22, p. 500, 2018. [Online]. Available: https://joss.theoj.org/papers/10.21105/joss.00500
- M. Mayr and J. M. Salt-Ducaju, “A C++ Implementation of a Cartesian Impedance Controller for Robotic Manipulators,” Journal of Open Source Software, vol. 9, no. 93, p. 5194, Jan. 2024. [Online]. Available: https://joss.theoj.org/papers/10.21105/joss.05194