Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
149 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

On Automating Video Game Regression Testing by Planning and Learning (2402.12393v2)

Published 16 Feb 2024 in cs.HC and cs.AI

Abstract: In this paper, we propose a method and workflow for automating regression testing of certain video game aspects using automated planning and incremental action model learning techniques. The basic idea is to use detailed game logs and incremental action model learning techniques to maintain a formal model in the planning domain description language (PDDL) of the gameplay mechanics. The workflow enables efficient cooperation of game developers without any experience with PDDL or other formal systems and a person experienced with PDDL modeling but no game development skills. We describe the method and workflow in general and then demonstrate it on a concrete proof-of-concept example -- a simple role-playing game provided as one of the tutorial projects in the popular game development engine Unity. This paper presents the first step towards minimizing or even eliminating the need for a modeling expert in the workflow, thus making automated planning accessible to a broader audience.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (28)
  1. Pddl— the planning domain definition language. Technical Report, Tech. Rep.
  2. Learning action models with minimal observability. Artificial Intelligence, 275: 104–137.
  3. Automated video game testing using synthetic and humanlike agents. IEEE Transactions on Games, 13(1): 50–67.
  4. MACQ: a holistic view of model acquisition techniques. arXiv preprint arXiv:2206.06530.
  5. Monte Carlo Planning in RTS Games. In Proceedings of the 2005 IEEE Symposium on Computational Intelligence and Games (CIG05). IEEE.
  6. A survey of planning and learning in games. Applied Sciences, 10(13): 4529.
  7. Search-based automated play testing of computer games: A model-based approach. In International Symposium on Search Based Software Engineering, 56–71. Springer.
  8. Search-Based Automated Play Testing of Computer Games: A Model-Based Approach. In Search-Based Software Engineering: 13th International Symposium, SSBSE 2021, Bari, Italy, October 11–12, 2021, Proceedings, 56–71. Berlin, Heidelberg: Springer-Verlag. ISBN 978-3-030-88105-4.
  9. Towards Agent-Based Testing of 3D Games Using Reinforcement Learning. In Proceedings of the 37th IEEE/ACM International Conference on Automated Software Engineering, 1–8.
  10. STRIPS: A new approach to the application of theorem proving to problem solving. Artificial intelligence, 2(3-4): 189–208.
  11. Fray, A. 2023. Automated Testing Roundtables GDC 2023. https://autotestingroundtable.com/. (Accessed on 12/12/2023).
  12. The FF planning system: Fast plan generation through heuristic search. Journal of Artificial Intelligence Research, 14: 253–302.
  13. Deep thought. In Computers, Chess, and Cognition, 55–78. Springer.
  14. Human problem solving, volume 104:9. Prentice-hall Englewood Cliffs, NJ.
  15. Modeling user exploration and boundary testing in digital learning games. In Proceedings of the 2016 conference on user modeling adaptation and personalization, 301–302.
  16. Towards automated video game testing: still a long way to go. In Proceedings of the 6th International ICSE Workshop on Games and Software Engineering: Engineering Fun, Inspiration, and Motivation, 37–43.
  17. Riddler, B. 2021. Improve Automated Game Testing Using Domain Independent AI Planning - YouTube. https://www.youtube.com/watch?v=2KXmxuCjjCw. (Accessed on 12/12/2023).
  18. Samuel, A. L. 1959. Some studies in machine learning using the game of checkers. IBM Journal of research and development, 3(3): 210–229.
  19. Chinook the world man-machine checkers champion. AI magazine, 17(1): 21–21.
  20. Using an agent-based approach for robust automated testing of computer games. In Proceedings of the 12th International Workshop on Automating TEST Case Design, Selection, and Evaluation, 1–8.
  21. Computer bridge: A big win for AI planning. AI magazine, 19(2): 93–93.
  22. Using reinforcement learning for load testing of video games. In Proceedings of the 44th International Conference on Software Engineering, 2303–2314.
  23. Unity Technologies. 2019. Creator Kit: RPG - Unity Learn. https://learn.unity.com/project/creator-kit-rpg. (Accessed on 12/09/2023).
  24. Unity Technologies. 2023. Unity Real-Time Development Platform — 3D, 2D, VR & AR Engine. https://unity.com/. (Accessed on 12/09/2023).
  25. Wang, X. 1996. Learning planning operators by observation and practice. Ph.D. thesis, Citeseer.
  26. Outracing champion Gran Turismo drivers with deep reinforcement learning. Nat., 602(7896): 223–228.
  27. Learning action models from plan examples using weighted MAX-SAT. Artificial Intelligence, 171(2-3): 107–143.
  28. Learning complex action models with quantifiers and logical implications. Artificial Intelligence, 174(18): 1540–1569.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now