A Multi-Level Corroborative Approach for Verification and Validation of Autonomous Robotic Swarms (2407.15475v1)
Abstract: Modelling and characterizing emergent behaviour within a swarm can pose significant challenges in terms of 'assurance'. Assurance tasks encompass adherence to standards, certification processes, and the execution of verification and validation (V&V) methods, such as model checking. In this study, we propose a holistic, multi-level modelling approach for formally verifying and validating autonomous robotic swarms, which are defined at the macroscopic formal modelling, low-fidelity simulation, high-fidelity simulation, and real-robot levels. Our formal macroscopic models, used for verification, are characterized by data derived from actual simulations, ensuring both accuracy and traceability across different system models. Furthermore, our work combines formal verification with experimental validation involving real robots. In this way, our corroborative approach for V&V seeks to enhance confidence in the evidence, in contrast to employing these methods separately. We explore our approach through a case study focused on a swarm of robots operating within a public cloakroom.
- E. Şahin, “Swarm robotics: From sources of inspiration to domains of application,” in Swarm Robotics, ser. LNCS, vol. 3342. Springer, 2005, pp. 10–20.
- D. B. Abeywickrama, J. Wilson, S. Lee, G. Chance, P. D. Winter, A. Manzini, I. Habli, S. Windsor, S. Hauert, and K. Eder, “AERoS: Assurance of emergent behaviour in autonomous robotic swarms,” in Computer Safety, Reliability, and Security. SAFECOMP 2023 Workshops. Springer, 2023, pp. 341–354.
- D. B. Abeywickrama, A. Bennaceur, G. Chance, Y. Demiris, A. Kordoni, M. Levine, L. Moffat, L. Moreau, M. R. Mousavi, B. Nuseibeh, S. Ramamoorthy, J. O. Ringert, J. Wilson, S. Windsor, and K. Eder, “On specifying for trustworthiness,” Commun. ACM, vol. 67, no. 1, p. 98–109, dec 2023.
- M. Webster, D. Western, D. Araiza-Illan, D. Clare, K. Eder, M. Fisher, and A. Pipe, “A corroborative approach to verification and validation of human–robot teams,” The International Journal of Robotics Research, vol. 39, no. 1, pp. 73–99, 2020.
- S. Jones, E. Milner, M. Sooriyabandara, and S. Hauert, “DOTS: An open testbed for industrial swarm robotic solutions,” arXiv, 2022.
- W. Liu and A. F. T. Winfield, “Modeling and optimization of adaptive foraging in swarm robotic systems,” The International Journal of Robotics Research, vol. 29, no. 14, pp. 1743–1760, 2010.
- S. Konur, C. Dixon, and M. Fisher, “Analysing robot swarm behaviour via probabilistic model checking,” Robot. Auton. Syst., vol. 60, no. 2, p. 199–213, feb 2012.
- K. Lerman, A. Martinoli, and A. Galstyan, “A review of probabilistic macroscopic models for swarm robotic systems,” in Swarm Robotics, E. Şahin and W. M. Spears, Eds. Springer, 2005, pp. 143–152.
- A. F. Winfield, J. Sa, M.-C. Fernández-Gago, C. Dixon, and M. Fisher, “On formal specification of emergent behaviours in swarm robotic systems,” International Journal of Advanced Robotic Systems, vol. 2, no. 4, p. 39, 2005.
- C. Dixon, A. Winfield, and M. Fisher, “Towards temporal verification of emergent behaviours in swarm robotic systems,” in Towards Autonomous Robotic Systems. Springer, 2011, pp. 336–347.
- W. Endo, C. Baumann, H. Asama, and A. Martinoli, “Automatic multi-robot control design and optimization leveraging multi-level modeling: An exploration case study,” IFAC-PapersOnLine, vol. 56, no. 2, pp. 11 462–11 469, 2023.
- M. Egerstedt, K. Johansson, J. Lygeros, and S. Sastry, “Behavior based robotics using regularized hybrid automata,” in Proc. of the 38th IEEE Conference on Decision and Control, vol. 4, 1999, pp. 3400–3405.
- A. Martinoli, K. Easton, and W. Agassounon, “Modeling swarm robotic systems: a case study in collaborative distributed manipulation,” The International Journal of Robotics Research, vol. 23, no. 4-5, pp. 415–436, 2004.
- M. Brambilla, E. Ferrante, M. Birattari, and M. Dorigo, “Swarm robotics: a review from the swarm engineering perspective,” Swarm Intelligence, vol. 7, no. 1, pp. 1–41, 2013.
- R. Hawkins, C. Paterson, C. Picardi, Y. Jia, R. Calinescu, and I. Habli, “Guidance on the assurance of machine learning in autonomous systems (AMLAS),” University of York, Guidance Version 1.1, Mar. 2021.
- C. Baumann, H. Birch, and A. Martinoli, “Leveraging multi-level modelling to automatically design behavioral arbitrators in robotic controllers,” in Proc. of the 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2022, pp. 9318–9325.
- S. Lee, E. Milner, and S. Hauert, “A data-driven method for metric extraction to detect faults in robot swarms,” IEEE Robot. Autom. Lett., vol. 7, no. 4, pp. 10 746–10 753, 2022.
- S. Lee and S. Hauert, “Building trustworthiness by minimizing the sim-to-real gap in fault detection for robot swarms,” in Proc. of the First International Symposium on Trustworthy Autonomous Systems (TAS’23). ACM, 2023.
- PRISM Model Checker, “Property specification,” Online, 2023. [Online]. Available: https://www.prismmodelchecker.org/manual/PropertySpecification/AllOnOnePage
- S. Jones, E. Milner, M. Sooriyabandara, and S. Hauert, “Distributed situational awareness in robot swarms,” Advanced Intelligent Systems, vol. 2, no. 11, p. 2000110, 2020.
- J. Dougherty, R. Kohavi, and M. Sahami, “Supervised and unsupervised discretization of continuous features,” in Machine Learning Proceedings 1995. Morgan Kaufmann, 1995, pp. 194–202.
- The Institute of Electrical and Electronics Engineers (IEEE), “IEEE standard for system, software, and hardware verification and validation,” IEEE 1012-2016, pp. 1–260, 2017.
- International Organization for Standardization (ISO), “Systems and software engineering–system life cycle processes,” ISO/IEC/IEEE 15288:2023(E), pp. 1–128, 2023.
- S. Macenski, T. Foote, B. Gerkey, C. Lalancette, and W. Woodall, “Robot operating system 2: Design, architecture, and uses in the wild,” Science Robotics, vol. 7, no. 66, p. eabm6074, 2022.
- D. B. Abeywickrama, S. Lee, C. Bennett, R. Abu-Aisheh, T. Didiot-Cook, S. Jones, S. Hauert, and K. Eder, “A multi-level corroborative approach for verification and validation of autonomous robotic swarms: Models, datasets and results,” https://doi.org/10.5523/bris.16ckwq1v44odw29sbsvca8yyhs.
- M. R. Mousavi, A. Cavalcanti, M. Fisher, L. Dennis, R. Hierons, B. Kaddouh, E. L.-C. Law, R. Richardson, J. O. Ringer, I. Tyukin, and J. Woodcock, “Trustworthy autonomous systems through verifiability,” Computer, vol. 56, no. 2, pp. 40–47, 2023.
- S. Moarref and H. Kress-Gazit, “Automated synthesis of decentralized controllers for robot swarms from high-level temporal logic specifications,” Autonomous Robots, vol. 44, no. 3-4, pp. 580–600, 2020.
- Dhaminda B. Abeywickrama (6 papers)
- Suet Lee (2 papers)
- Chris Bennett (4 papers)
- Razanne Abu-Aisheh (1 paper)
- Tom Didiot-Cook (1 paper)
- Simon Jones (5 papers)
- Sabine Hauert (14 papers)
- Kerstin Eder (70 papers)