Towards the Combination of Model Checking and Runtime Verification on Multi-Agent Systems (2202.09344v2)
Abstract: Multi-Agent Systems (MAS) are notoriously complex and hard to verify. In fact, it is not trivial to model a MAS, and even when a model is built, it is not always possible to verify, in a formal way, that it is actually behaving as we expect. Usually, it is relevant to know whether an agent is capable of fulfilling its own goals. One possible way to check this is through Model Checking. Specifically, by verifying Alternating-time Temporal Logic (ATL) properties, where the notion of strategies for achieving goals can be described. Unfortunately, the resulting model checking problem is not decidable in general. In this paper, we present a verification procedure based on combining Model Checking and Runtime Verification, where sub-models of the MAS model belonging to decidable fragments are verified by a model checker, and runtime monitors are used to verify the rest. Furthermore, we implement our technique and show experimental results.
- Alternating-time temporal logic. J. ACM, 49(5):672–713, 2002.
- C. Dima and F.L. Tiplea. Model-checking ATL under imperfect information and perfect recall semantics is undecidable. CoRR, abs/1102.4225, 2011.
- P.Y. Schobbens. Alternating-Time Logic with Imperfect Recall. ENTCS, 85(2):82–93, 2004.
- Decidability results for atl* with imperfect information and perfect recall. In Kate Larson, Michael Winikoff, Sanmay Das, and Edmund H. Durfee, editors, Proceedings of the 16th Conference on Autonomous Agents and MultiAgent Systems, AAMAS 2017, São Paulo, Brazil, May 8-12, 2017, pages 1250–1258. ACM, 2017.
- Strategy logic with imperfect information. ACM Trans. Comput. Log., 22(1):5:1–5:51, 2021.
- Verification of multi-agent systems with imperfect information and public actions. In AAMAS 2017, pages 1268–1276, 2017.
- Verification of multi-agent systems with public actions against strategy logic. Artif. Intell., 285:103302, 2020.
- An abstraction-based method for verifying strategic properties in multi-agent systems with imperfect information. In Proceedings of AAAI, 2019.
- A three-valued approach to strategic abilities under imperfect information. In Proceedings of the 17th International Conference on Knowledge Representation and Reasoning, pages 89–98, 2020.
- Approximating perfect recall when model checking strategic abilities. In KR2018, pages 435–444, 2018.
- Natural strategic ability. Artif. Intell., 277, 2019.
- Natural strategic ability under imperfect information. In Edith Elkind, Manuela Veloso, Noa Agmon, and Matthew E. Taylor, editors, Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems, AAMAS ’19, Montreal, QC, Canada, May 13-17, 2019, pages 962–970. International Foundation for Autonomous Agents and Multiagent Systems, 2019.
- Model check what you can, runtime verify the rest. In Andrei Voronkov and Margarita V. Korovina, editors, HOWARD-60: A Festschrift on the Occasion of Howard Barringer’s 60th Birthday, volume 42 of EPiC Series in Computing, pages 234–244. EasyChair, 2014.
- Combining model checking and runtime verification for safe robotics. In Shuvendu K. Lahiri and Giles Reger, editors, Runtime Verification - 17th International Conference, RV 2017, Seattle, WA, USA, September 13-16, 2017, Proceedings, volume 10548 of Lecture Notes in Computer Science, pages 172–189. Springer, 2017.
- From model checking to runtime verification and back. In Shuvendu K. Lahiri and Giles Reger, editors, Runtime Verification - 17th International Conference, RV 2017, Seattle, WA, USA, September 13-16, 2017, Proceedings, volume 10548 of Lecture Notes in Computer Science, pages 225–240. Springer, 2017.
- DiVinE 3.0–an explicit-state model checker for multithreaded C & C++ programs. In International Conference on Computer Aided Verification, pages 863–868. Springer, 2013.
- A verification-centric software development process for java. In Byoungju Choi, editor, Proceedings of the Ninth International Conference on Quality Software, QSIC 2009, Jeju, Korea, August 24-25, 2009, pages 76–85. IEEE Computer Society, 2009.
- Strategy rv: A tool to approximate atl model checking under imperfect information and perfect recall. In Proceedings of the 20th International Conference on Autonomous Agents and MultiAgent Systems, AAMAS ’21, page 1764–1766, Richland, SC, 2021. International Foundation for Autonomous Agents and Multiagent Systems.
- W. Jamroga and W. van der Hoek. Agents that know how to play. Fund. Inf., 62:1–35, 2004.
- Reasoning about Knowledge. MIT, 1995.
- C. Baier and J. P. Katoen. Principles of Model Checking (Representation and Mind Series). 2008.
- Amir Pnueli. The temporal logic of programs. In 18th Annual Symposium on Foundations of Computer Science, Providence, Rhode Island, USA, 31 October - 1 November 1977, pages 46–57. IEEE Computer Society, 1977.
- Towards the verification of strategic properties in multi-agent systems with imperfect information. CoRR, abs/2112.13621, 2021.
- Runtime verification for LTL and TLTL. ACM Trans. Softw. Eng. Methodol., 20(4):14:1–14:64, 2011.
- Parameterised verification for multi-agent systems. Artif. Intell., 234:152–189, 2016.
- A. Lomuscio and F. Raimondi. Model checking knowledge, strategies, and games in multi-agent systems. In Proceedings of the 5th International Joint Conference on Autonomous agents and Multi-Agent Systems (AAMAS06), pages 161–168. ACM Press, 2006.
- A tool for verifying strategic properties in mas with imperfect information, 2020.
- LamaConv- logics and automata converter library, 2016.