Boosting Mixed-Initiative Co-Creativity in Game Design: A Tutorial (2401.05999v1)
Abstract: In recent years, there has been a growing application of mixed-initiative co-creative approaches in the creation of video games. The rapid advances in the capabilities of AI systems further propel creative collaboration between humans and computational agents. In this tutorial, we present guidelines for researchers and practitioners to develop game design tools with a high degree of mixed-initiative co-creativity (MI-CCy). We begin by reviewing a selection of current works that will serve as case studies and categorize them by the type of game content they address. We introduce the MI-CCy Quantifier, a framework that can be used by researchers and developers to assess co-creative tools on their level of MI-CCy through a visual scheme of quantifiable criteria scales. We demonstrate the usage of the MI-CCy Quantifier by applying it to the selected works. This analysis enabled us to discern prevalent patterns within these tools, as well as features that contribute to a higher level of MI-CCy. We highlight current gaps in MI-CCy approaches within game design, which we propose as pivotal aspects to tackle in the development of forthcoming approaches.
- Assessing aesthetic criteria in the evolutionary dungeon designer. Proceedings of the 13th International Conference on the Foundations of Digital Games, 1–4. https://doi.org/10.1145/3235765.3235810
- Fostering creativity in the mixed-initiative evolutionary dungeon designer. Proceedings of the 13th International Conference on the Foundations of Digital Games, 1–8. https://doi.org/10.1145/3235765.3235815
- Empowering Quality Diversity in Dungeon Design with Interactive Constrained MAP-Elites. 2019 IEEE Conference on Games (CoG), 1–8. https://doi.org/10.1109/CIG.2019.8848022
- Story Designer: Towards a Mixed-Initiative Tool to Create Narrative Structures. Proceedings of the 17th International Conference on the Foundations of Digital Games, 1–9. https://doi.org/10.1145/3555858.3555929
- Questgram [Qg]: Toward a Mixed-Initiative Quest Generation Tool. The 16th International Conference on the Foundations of Digital Games (FDG) 2021, 1–10. https://doi.org/10.1145/3472538.3472544
- Mixed-initiative procedural generation of dungeons using game design patterns. 2017 IEEE Conference on Computational Intelligence and Games (CIG), 25–32. https://doi.org/10.1109/CIG.2017.8080411
- Towards pattern-based mixed-initiative dungeon generation. Proceedings of the 12th International Conference on the Foundations of Digital Games, 1–10. https://doi.org/10.1145/3102071.3110572
- Lode Encoder: AI-constrained co-creativity. 2021 IEEE Conference on Games (CoG), 01–08. https://doi.org/10.1109/CoG52621.2021.9619009
- Language models are few-shot learners. Advances in Neural Information Processing Systems 33 (2020).
- A mixed-initiative tool for designing level progressions in games. Proceedings of the 26th annual ACM symposium on User interface software and technology, 377–386. https://doi.org/10.1145/2501988.2502011
- Towards Game-based Metrics for Computational Co-Creativity. 2018 IEEE Conference on Computational Intelligence and Games (CIG), 1–8. https://doi.org/10.1109/CIG.2018.8490429
- Jaime R. Carbornell. 1970. Mixed-initiative man-computer instructional dialogues. (1970).
- Help me write a Poem: Instruction Tuning as a Vehicle for Collaborative Poetry Writing. Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 6848–6863. https://doi.org/10.18653/v1/2022.emnlp-main.460
- Baba is Y’all 2.0: Design and Investigation of a Collaborative Mixed-Initiative System. IEEE Transactions on Games (2022), 1–15. https://doi.org/10.1109/TG.2022.3223527
- Baba is Y’all: Collaborative Mixed-Initiative Level Design. 2020 IEEE Conference on Games (CoG), 542–549. https://doi.org/10.1109/CoG47356.2020.9231807
- Patterns, Dungeons and Generators. 10th International Conference on the Foundations of Digital Games.
- Nicholas Davis. 2013. Human-computer co-creativity: blending human and computational creativity. Proceedings of the Ninth Artificial Intelligence and Interactive Digital Entertainment Conference.
- Mixed-Initiative Level Design with RL Brush. Artificial Intelligence in Music, Sound, Art and Design. EvoMUSART 2021, 412–426. https://doi.org/10.1007/978-3-030-72914-1_27
- Mixed-Initiative Creative Interfaces. Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, 628–635. https://doi.org/10.1145/3027063.3027072
- Flávio Roberto dos Santos Coutinho and Luiz Chaimowicz. 2023. Towards a Mixed-Initiative Sprite Editor for Pixel Art Characters. SSRN (2023).
- Preference-Learning Emitters for Mixed-Initiative Quality-Diversity Algorithms. IEEE Transactions on Games (2023), 1–14. https://doi.org/10.1109/TG.2023.3264457
- Towards a Framework for Human-AI Interaction Patterns in Co-Creative GAN Applications. Proceeding of the 3rd Workshop on Human-AI Co-Creation with Generative Models (HAI-GEN ‘22) at ACM IUI Workshops 3124.
- Friend, Collaborator, Student, Manager. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 1–13. https://doi.org/10.1145/3290605.3300854
- Procedural content generation for games. ACM Transactions on Multimedia Computing, Communications, and Applications 9 (2 2013), 1–22. Issue 1. https://doi.org/10.1145/2422956.2422957
- Anna Kantosalo and Hannu Toivonen. 2016. Modes for creative human-computer collaboration: alternating and task-divided co-creativity. Proceedings of the Seventh International Conference on Computational Creativity.
- Mixed-initiative design of game levels: integrating mission and space into level generation. 10th International Conference on the Foundations of Digital Games. http://graphics.tudelft.nl/Publications-new/2015/KBB15
- Creative sketching partner. Proceedings of the 25th International Conference on Intelligent User Interfaces, 221–230. https://doi.org/10.1145/3377325.3377522
- Germinate: A Mixed-Initiative Casual Creator for Rhetorical Games. Proceedings of the Sixteenth Artificial Intelligence and Interactive Digital Entertainment Conference. https://ojs.aaai.org/index.php/AIIDE/article/view/7417
- Loose Ends: A Mixed-Initiative Creative Interface for Playful Storytelling. Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment 18 (10 2022), 120–128. Issue 1. https://doi.org/10.1609/aiide.v18i1.21955
- On Mixed-Initiative Content Creation for Video Games. IEEE Transactions on Games 14 (12 2022), 543–557. Issue 4. https://doi.org/10.1109/TG.2022.3176215
- Thijmen Stefanus Leendert Langendam and Rafael Bidarra. 2022. miWFC - Designer Empowerment through mixed-initiative Wave Function Collapse. Proceedings of the 17th International Conference on the Foundations of Digital Games, 1–8. https://doi.org/10.1145/3555858.3563266
- CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilities. CHI Conference on Human Factors in Computing Systems, 1–19. https://doi.org/10.1145/3491102.3502030
- Mixed-initiative content creation. Procedural content generation in games (2016), 195–214. https://doi.org/10.1007/978-3-319-42716-4_11
- Adapting Models of Visual Aesthetics for Personalized Content Creation. IEEE Transactions on Computational Intelligence and AI in Games 4 (9 2012), 213–228. Issue 3. https://doi.org/10.1109/TCIAIG.2012.2192438
- Co-creating game content using an adaptive model of user taste. Proceedings of the 3rd International Conference on Computational Creativity.
- Sentient sketchbook : computer-assisted game level authoring. 8th International Conference on the Foundations of Digital Games.
- Creative Wand: A System to Study Effects of Communications in Co-creative Settings. Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment 18 (10 2022), 45–52. Issue 1. https://doi.org/10.1609/aiide.v18i1.21946
- Explainable Computational Creativity. 11th International Conference on Computational Creativity, 334–341.
- Pitako - Recommending Game Design Elements in Cicero. 2019 IEEE Conference on Games (CoG), 1–8. https://doi.org/10.1109/CIG.2019.8848081
- Evaluation of a Recommender System for Assisting Novice Game Designers. Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment 15 (10 2019), 167–173. Issue 1. https://doi.org/10.1609/aiide.v15i1.5240
- Let’s Make Games Together: Explainability in Mixed-initiative Co-creative Game Design. 2022 IEEE Conference on Games (CoG), 638–645. https://doi.org/10.1109/CoG51982.2022.9893636
- CADI — A Conversational Assistive Design Interface for Discovering Pong Variants. Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment 14 (9 2018), 194–200. Issue 1. https://doi.org/10.1609/aiide.v14i1.13042
- Mixed initiative generative AI interfaces: An analytic framework for generative AI applications. Proceedings of the Workshop The Future of Co-Creative Systems - A Workshop on Human-Computer Co-Creativity of the 11th International Conference on Computational Creativity.
- Mixed-initiative approaches to on-device mobile game design. CHI’17 Workshop on Mixed-Initiative Creative Interfaces. http://repository.falmouth.ac.uk/id/eprint/2568
- Co-PoeTryMe: a Co-Creative Interface for the Composition of Poetry. Proceedings of the 10th International Conference on Natural Language Generation, 70–71. https://doi.org/10.18653/v1/W17-3508
- EvolvingBehavior: Towards Co-Creative Evolution of Behavior Trees for Game NPCs. Proceedings of the 17th International Conference on the Foundations of Digital Games, 1–13. https://doi.org/10.1145/3555858.3555896
- Jeba Rezwana and Mary Lou Maher. 2021. COFI: A Framework for Modeling Interaction in Human-AI Co-Creative Systems. 12th International Conference on Computational Creativity, 444–448.
- Jeba Rezwana and Mary Lou Maher. 2023. Designing Creative AI Partners with COFI: A Framework for Modeling Interaction in Human-AI Co-Creative Systems. ACM Transactions on Computer-Human Interaction 30 (10 2023), 1–28. Issue 5. https://doi.org/10.1145/3519026
- The Design of Writing Buddy: A Mixed-Initiative Approach Towards Computational Story Collaboration. Interactive Storytelling: 9th International Conference on Interactive Digital Storytellingg, ICIDS 2016, 388–396. https://doi.org/10.1007/978-3-319-48279-8_34
- Jesse Schell. 2008. The Art of Game Design: A Book of Lenses. Morgan Kaufmann Publishers Inc.
- Evolving Playable Content for Cut the Rope through a Simulation-Based Approach. Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment 9 (6 2013), 72–78. Issue 1. https://doi.org/10.1609/aiide.v9i1.12690
- Ropossum: An Authoring Tool for Designing, Optimizing and Solving Cut the Rope Levels. Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment 9 (6 2013), 215–216. Issue 1. https://doi.org/10.1609/aiide.v9i1.12611
- Procedural Content Generation in Games. Springer.
- Tanagra. Proceedings of the Fifth International Conference on the Foundations of Digital Games, 209–216. https://doi.org/10.1145/1822348.1822376
- Tanagra: Reactive Planning and Constraint Solving for Mixed-Initiative Level Design. IEEE Transactions on Computational Intelligence and AI in Games 3 (9 2011), 201–215. Issue 3. https://doi.org/10.1109/TCIAIG.2011.2159716
- Angie Spoto and Natalia Oleynik. 2017. Library of Mixed-Initiative Creative Interfaces. http://mici.codingconduct.cc/
- Ingibergur Stefnisson and David Thue. 2018. Mimisbrunnur: AI-Assisted Authoring for Interactive Storytelling. Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment 14 (9 2018), 236–242. Issue 1. https://doi.org/10.1609/aiide.v14i1.13046
- Bringing stories to life in 1001 nights: A co- creative text adventure game using a story generation model. International Conference on Interactive Digital Storytelling, 651–672.
- Evaluating Mixed-Initiative Procedural Level Design Tools Using a Triple-Blind Mixed-Method User Study. IEEE Transactions on Games 14 (9 2022), 413–422. Issue 3. https://doi.org/10.1109/TG.2021.3086215
- Mixed-initiative co-creativity. 9th International Conference on the Foundations of Digital Games. https://www.um.edu.mt/library/oar/handle/123456789/29459
- Wordcraft: Story Writing With Large Language Models. 27th International Conference on Intelligent User Interfaces, 841–852. https://doi.org/10.1145/3490099.3511105
- Explainable AI for Designers: A Human-Centered Perspective on Mixed-Initiative Co-Creation. 2018 IEEE Conference on Computational Intelligence and Games (CIG), 1–8. https://doi.org/10.1109/CIG.2018.8490433
- Solange Margarido (1 paper)
- Licínio Roque (2 papers)
- Penousal Machado (39 papers)
- Pedro Martins (17 papers)