Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
184 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Deriving and Evaluating a Detailed Taxonomy of Game Bugs (2311.16645v1)

Published 28 Nov 2023 in cs.SE

Abstract: Game development has become an extremely competitive multi-billion-dollar industry. Many games fail even after years of development efforts because of game-breaking bugs that disrupt the game-play and ruin the player experience. The goal of this work is to provide a bug taxonomy for games that will help game developers in developing bug-resistant games, game testers in designing and executing fault-finding test cases, and researchers in evaluating game testing approaches. For this purpose, we performed a Multivocal Literature Review (MLR) by analyzing 436 sources, out of which 189 (78 academic and 111 grey) sources reporting bugs encountered in the game development industry were selected for analysis. We validate the proposed taxonomy by conducting a survey involving different game industry practitioners. The MLR allowed us to finalize a detailed taxonomy of 63 game bug categories in end-user perspective including eight first-tier categories: Gaming Balance, Implementation Response, Network, Sound, Temporal, Unexpected Crash, Navigational, and Non-Temporal faults. We observed that manual approaches towards game testing are still widely used. Only one of the approaches targets sound bugs whereas game balancing and how to incorporate machine learning in game testing is trending in the recent literature. Most of the game testing techniques are specialized and dependent on specific platforms.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (232)
  1. Teodora Dobrilova “How Much Is the Gaming Industry Worth in 2021?”, 2021 URL: https://techjury.net/blog/gaming-industry-worth/#gref
  2. Cristiano Politowski, Fabio Petrillo and Yann-Gaël Guéhéneuc “A Survey of Video Game Testing” In 2021 IEEE/ACM International Conference on Automation of Software Test(AST), 2021, pp. 90–99 IEEE
  3. “Game industry problems: An extensive analysis of the gray literature” In Information and Software Technology 134 Elsevier, 2021, pp. 106538
  4. Charles P Schultz and Robert Denton Bryant “Game testing: All in one” Mercury LearningInformation, 2016
  5. “Using defect taxonomies for testing requirements” In IEEE Software 32.3 IEEE, 2014, pp. 94–101
  6. Alessandro Marchetto, Filippo Ricca and Paolo Tonella “An empirical validation of a web fault taxonomy and its usage for web testing” In Journal of Web Engineering, 2009, pp. 316–345
  7. Chris Lewis, Jim Whitehead and Noah Wardrip-Fruin “What Went Wrong: A Taxonomy of Video Game Bugs” In Proceedings of the Fifth International Conference on the Foundations of Digital Games, 2010
  8. “Taxonomy of real faults in deep learning systems” In ICSE ’20: Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering IEEE Computer Society, 2020, pp. 1110–1121
  9. Batu Aytemiz and Adam M. Smith “A Diagnostic Taxonomy of Failure in Videogames” In PervasiveHealth: Pervasive Computing Technologies for Healthcare, 2020
  10. “Improving test automation maturity: A multivocal literature review” In Software Testing, Verification and Reliability 32.3 Wiley Online Library, 2022, pp. e1804
  11. Richard J. Adams, Palie Smart and Anne Sigismund Huff “Shades of Grey: Guidelines for Working with the Grey Literature in Systematic Reviews for Management and Organizational Studies” In International Journal of Management Reviews 19.4, 2017
  12. “Deep learning for video game playing” In IEEE Transactions on Games 12, 2020
  13. “Landscaping systematic mapping studies in software engineering: A tertiary study” In Journal of Systems and Software 149 Elsevier, 2019, pp. 396–436
  14. “A co-evolutionary genetic algorithms approach to detect video game bugs” In Journal of Systems and Software 188 Elsevier, 2022, pp. 111261
  15. “AI-based playtesting of contemporary board games” In ACM International Conference Proceeding Series Part F130151 Association for Computing Machinery, 2017
  16. “Towards an agent-based automated testing environment for massively multi-player role playing games” In 2017 40th International Convention on Information and Communication Technology, Electronics and Microelectronics(MIPRO) IEEE
  17. Markus Schatten, Bogdan Okreša Đurić and Igor Tomičić “Towards an Application Programming Interface for Automated Testing of Artificial Intelligence Agents in Massively Multi-Player On-Line Role-Playing Games” In Central European Conference on Information and Intelligent Systems
  18. “Automated Tests for Mobile Games: an Experience Report” In 17th Brazilian Symposium on Computer Games
  19. “Exploring Gameplay With AI Agents” In Fourteenth Artificial Intelligence and Interactive Digital Entertainment Conference
  20. Aaron Isaksen, Dan Gopstein and Andy Nealen “Exploring Game Space Using Survival Analysis” In FDG
  21. Jennifer Hernández Bécares, Luis Costero Valero and Pedro Pablo Gómez Martín “An approach to automated videogame beta testing” In Entertainment Computing 18, 2017
  22. “An automated model based testing approach for platform games” In 2015 ACM/IEEE MODELS 2015-Proceedings
  23. “Dungeons and replicants II: automated game balancing across multiple difficulty dimensions via deep player behavior modeling” In IEEE Transactions on Games IEEE, 2022
  24. “An online agent-based search approach in automated computer game testing with model construction” In Proceedings of the 13th International Workshop on Automating Test Case Design, Selection and Evaluation, 2022, pp. 45–52
  25. “Augmenting Automated Game Testing with Deep Reinforcement Learning” In IEEE Conference on Computatonal Intelligence and Games, CIG 2020-August, 2020
  26. “Wuji : Automatic Online Combat Game Testing Using Evolutionary Deep Reinforcement Learning” In 34th ACM/IEEE International Conference on Automated Software Engineering, pp. 772–784
  27. “Automated mmorpg testing–an agent-based approach” In International conference on practical applications of agents and multi-agent system 10349 Springer International Publishing
  28. Johannes Pfau, Jan David Smeddinck and Rainer Malaka “Automated game testing with ICARUS: Intelligent completion of adventure riddles via unsupervised solving” In CHI PLAY 2017 Extended Abstracts-Extended Abstracts Publication of the Annual Symposium on Computer-Human Interaction in Play, 2017, pp. 153–163
  29. Kenneth Chang, Batu Aytemiz and Adam M. Smith “Reveal-more: Amplifying human effort in quality assurance testing using automated exploration” In 2019 IEEE Conference on Games(CoG) 2019-Augus
  30. “Search-Based Automated Play Testing of Computer Games: A Model-Based Approach”, 2021
  31. “GLIB: Towards Automated Test Oracle for Graphically-Rich Applications” In 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering Association for Computing Machinery(ACM)
  32. Christopher J. Schaefer and Hyunsook Do “Model-based exploratory testing: A controlled experiment” In Proceedings-IEEE 7th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2014 IEEE Computer Society, pp. 284–293
  33. “Towards Automated Playtesting in Game Development” In Proceedings of SB
  34. “Automated playtesting in collectible card games using evolutionary algorithms: A case study in hearthstone” In Knowledge-Based Systems 153, 2018
  35. “A long/short-term memory based automated testing model to quantitatively evaluate game design” In Applied Sciences(Switzerland) 10.19, 2020
  36. Samantha Stahlke, Atiya Nova and Pejman Mirza-Babaei “Artificial Playfulness: A Tool for Automated Agent-Based Playtesting” In Conference on Human Factors in Computing Systems-Proceedings
  37. Zihe Song “An Automated Framework For Gaming Platform To Test Multiple Games” In ICSE-Companion
  38. “Automated bug finding in video games: A case study for runtime monitoring” In Proceedings-IEEE 7th International Conference on Software Testing, Verification and Validation, ICST 2014, 2014, pp. 143–152
  39. J. Tuovenen, M. Oussalah and P. Kostakos “MAuto: Automatic Mobile Game Testing Tool Using Image-Matching Based Approach” In The Computer Games Journal 8, 2019
  40. Sinan Ariyurek, Aysu Betin-Can and Elif Surer “Automated video game testing using synthetic and humanlike agents” In IEEE Transactions on Games 13.1 IEEE, 2019, pp. 50–67
  41. Sinan Ariyurek, Aysu Betin-Can and Elif Surer “Enhancing the Monte Carlo Tree Search Algorithm for Video Game Testing” In IEEE Conference on Computatonal Intelligence and Games, CIG
  42. Mohammad Reza Taesiri, Moselem Habibi and MohammadAmin Fazli “A Video Game Testing Method Utilizing Deep Learning” In The CSI Journal on Computer Science and Engineering 17.2, 2020, pp. 26–33
  43. “A Case Study: Online Game Testing Using Massive Virtual Player” In Communications in Computer and Information Science 256 CCIS, 2011
  44. Cristina Guerrero-Romero, Simon M. Lucas and Diego Perez-Liebana “Using a Team of General AI Algorithms to Assist Game Design and Testing” In 2018 IEEE Conference on Computational Intelligence and Games(CIG) IEEE, pp. 1–8
  45. “Online game testing using scenario-based control of massive virtual users” In International Conference on Advanced Communication Technology, ICACT 2, 2010
  46. “Automatic generation of tower defense levels using PCG” In International Conference on the Foundations of Digital Games ICST
  47. “Scenario-based approach for blackbox load testing of online game servers” In Proceedings-2010 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery, CyberC 2010, 2010, pp. 259–265
  48. Aisha Liaqat, Muddassar Azam Sindhu and Ghazanfar Farooq Siddiqui “Metamorphic testing of an artificially intelligent chess game” In IEEE Access 8, 2020
  49. Woei-kae Chen, Chien-hung Liu and Ping-hung Chen “A Game Framework Supporting Automatic Functional Testing for Games” In Applied Computing and Information Technology 727, 2016
  50. Alfredo Nantes, Ross Brown and Frederic Maire “A Framework for the Semi-Automatic Testing of Video Games” In Proceedings of the Fourth Artificial Intelligence and Interactive Digital Entertainment Conference, 2008
  51. “Regression Testing of Massively Multiplayer Online Role-Playing Games” In Proceedings-2020 IEEE International Conference on Software Maintenance and Evolution, ICSME 2020 Institute of ElectricalElectronics Engineers Inc., pp. 692–696
  52. “Unity application testing automation with appium and image recognition” In Communications in Computer and Information Science 779 Springer, Cham, pp. 139–150
  53. “Evolutionary behavior testing of commercial computer games” In Proceedings of the 2004 Congress on Evolutionary Computation, CEC2004, 2004
  54. Mohammad Shaker, Noor Shaker and Julian Toglius “Evolving playable content for cut the rope through a simulation-based approach” In Proceedings / the Ninth AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment AAAI Press, pp. 72–78
  55. “Playtesting in Match 3 Game Using Strategic Plays via Reinforcement Learning” In IEEE Access 8, 2020
  56. “Software testing by active learning for commercial games” In Proceedings of the National Conference on Artificial Intelligence 2, 2005, pp. 898–903
  57. Huiqun Zhao, Jing Sun and Gongzhu Hu “Study of Methodology of Testing Mobile Games Based on TTCN-3” In 2009 10th ACIS International Conference on Software Engineering, Artificial Intelligences, Networking and Parallel/Distributed Computing IEEE
  58. Matthias P. Krieger and Achim D. Brucker “OCL-based Runtime Monitoring of JVM hosted Applications”, 2011
  59. “Reproducing Bugs in Video Games using Genetic Algorithms” á In IEEE Games, Multimedia, Animation and Multiple Realities Conference(GMAX)
  60. “Reinforcement Learning Methods to Evaluate the Impact of AI Changes in Game Design” In Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment 17.1, 2021
  61. Alfredo Nantes, Ross Brown and Frederic Maire “Measuring visual consistency in 3d rendering systems” In Proceedings of the Thirty-Third Australasian Computer Science Conference, pp. 43–52
  62. Samantha N. Stahlke and Pejman Mirza-Babaei “Usertesting without the user: Opportunities and challenges of an AI-driven approach in games user research” In Computers in Entertainment 16.2, 2018
  63. “Human-like UI Automation through Automatic Exploration” In International Conference on Big Data and Artificial Intelligence ICST
  64. “Runtime Monitoring of Temporal Logic Properties in a Platform Game” In International Conference on Runtime Verification
  65. “Multi-Game Automation Approach For Cocos-2dx Based Card Game” In International Conference on Computing, Communication and Networking Technologies(ICCCNT)
  66. Benedict Wilkins, Chris Watkins and Kostas Stathis “A Metric Learning Approach to Anomaly Detection in Video Games” In IEEE Conference on Computatonal Intelligence and Games, CIG 2020-August IEEE Computer Society, pp. 604–607
  67. “Adaptive usage statistical testing for 3D gaming applications” In 2018 International Conference on Computing, Electronic and Electrical Engineering, ICE Cube 2018, 2018, pp. 1–6
  68. “Automatic difficulty management and testing in games using a framework based on behavior trees and genetic algorithms” In Proceedings of the IEEE International Conference on Engineering of Complex Computer Systems, ICECCS 2019-November Institute of ElectricalElectronics Engineers Inc., pp. 170–179
  69. “Semi-automated Level Design via Auto-Playtesting for Handheld Casual Game Creation” In IEEE Conference on Computational Intelligence and Games
  70. “VENUS: The Online Game Simulator Using Massively Virtual Clients” In Asian Simulation Conference
  71. “Lessons from Testing an Evolutionary Automated Game Balancer in Industry” In IEEE Games, Entertainment, Media Conference(GEM)
  72. “Automated Playtesting with RECYCLEd CARDSTOCK” In Game and Puzzle Design, 2016
  73. Alexis Toumi, Julian Gutierrez and Michael Wooldridge “A Tool for the Automated Verification of Nash Equilibria in Concurrent Games” In International Colloquium on Theoretical Aspects of Computing 9399 Springer International Publishing, pp. 583–594
  74. “Evaluating Competitive Game Balance with Restricted Play” In Artificial Intelligence and Interactive Digital Entertainment Conference
  75. “Integrated Balancing of an RTS Game: Case Study and Toolbox Refinement” In IEEE Conference on Computational Intelligence and Games(CIG)
  76. “Exploring game space of minimal action games via parameter tuning and survival analysis” In IEEE Transactions on Games 10.2, 2018
  77. “Automated Game Balancing in Ms PacMan and StarCraft Using Evolutionary Algorithms” In European Conference on the Applications of Evolutionary Computation 10199 Springer International Publishing
  78. Ciprian Paduraru, Miruna Paduraru and Alin Stefanescu “RiverGame-a game testing tool using artificial intelligence” In 2022 IEEE Conference on Software Testing, Verification and Validation (ICST), 2022, pp. 422–432 IEEE
  79. Cong Lu, Raluca Georgescu and Johan Verwey “Go-Explore Complex 3D Game Environments for Automated Reachability Testing” In IEEE Transactions on Games IEEE, 2022
  80. “Using reinforcement learning for load testing of video games” In Proceedings of the 44th International Conference on Software Engineering, 2022, pp. 2303–2314
  81. “A Lightweight Approach of Human-Like Playtest for Android Apps” In 2022 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER), 2022, pp. 309–320 IEEE
  82. “Neuroevolution-based generation of tests and oracles for games” In Proceedings of the 37th IEEE/ACM International Conference on Automated Software Engineering, 2022, pp. 1–13
  83. “Inspector: Pixel-Based Automated Game Testing via Exploration, Detection, and Investigation” In 2022 IEEE Conference on Games (CoG), 2022, pp. 237–244 IEEE
  84. “Toward automated game balance: A systematic engineering design approach” In 2021 IEEE Conference on Games (CoG), 2021, pp. 1–8 IEEE
  85. Patricia Monteiro Negrao “Automated Playtesting In Videogames”, 2020
  86. Sriram and Varun “Automated Playtesting of Platformer Games using Reinforcement Learning”, 2019
  87. Dimitrios Loubos “Automated Testing in Virtual Worlds”, 2018 URL: https://doi.org/10.475/123_4
  88. Santosh Raj Dandey “An Automated Testing Tool For The Virtual Cell Game”, 2013
  89. By Steffan Derek Hooper “Automated Testing and Validation of Computer Graphics Implementations for Cross-Platform Game Development”, 2017
  90. A. Nikas “Automated Gui Testing for Games using pseudo-DSL”, 2015
  91. “Applying automated testing in an existing client-server game A pursuit for fault localization in Quake 3”, 2015
  92. “CCPT: Automatic Gameplay Testing and Validation with Curiosity-Conditioned Proximal Trajectories” In arXiv preprint arXiv:2202.10057, 2022
  93. “Improving Playtesting Coverage via Curiosity Driven Reinforcement Learning Agents”, 2021
  94. “Adversarial Behaviour Debugging in a Two Button Fighting Game”, 2021
  95. “Using Artificial Intelligence for Gameplay Testing On Turn-Based Games”, 2018
  96. “Repairing games at runtime or, how we learned to stop worrying and love emergence” In IEEE Software 28.5, 2011
  97. Alexander Zook, Eric Fruchter and Mark O. Riedl “Automatic Playtesting for Game Parameter Tuning via Active Learning”, 2019
  98. “Efficient Exploration via First-Person Behavior Cloning Assisted Rapidly-Exploring Random Trees” In arXiv preprint arXiv:2203.12774, 2022
  99. “Quality assessment of systematic reviews in software engineering: A tertiary study” In Proceedings of the 19th international conference on evaluation and assessment in software engineering, 2015, pp. 1–14
  100. “A systematic review on software testing ontologies” In International conference on the quality of information and communications technology Springer
  101. “Dataset of Video Game Development Problems” In Proceedings-2020 IEEE/ACM 17th International Conference on Mining Software Repositories, MSR 2020, 2020
  102. “Activisions Heavy Gear 2”, 1999 URL: https://bit.ly/3rqbeBL
  103. “An indie-style experiment at a AAA studio: Insomniacs Slow Down, Bull”, 2015 URL: https://bit.ly/34egfol
  104. “Another One Bites the Dust: Dynasty Feud Postmortem”, 2018 URL: https://bit.ly/3IZig6A
  105. “Appy Entertainments SpellCraft School of Magic”, 2012 URL: https://bit.ly/3IZigU8
  106. “Baldurs Gate II The Anatomy of a Sequel”, 2001 URL: https://bit.ly/3IZihaE
  107. “Blizzards Diablo II”, 2000 URL: https://bit.ly/3HsdMoJ
  108. “Blue Fangs Zoo Tycoon 2 Marine Mania”, 2007 URL: https://bit.ly/3LcO75Q
  109. “Blue Tongue Softwares Jurassic Park: Operation Genesis”, 2003 URL: https://bit.ly/34xVWSq
  110. “Collaborating on an indie sensation-Cuphead”, 2018 URL: https://bit.ly/3uqcAyC
  111. “Disney Onlines Toontown”, 2003 URL: https://bit.ly/3Grf167
  112. “DreamForges Sanitarium”, 1998 URL: https://bit.ly/3rpbhxK
  113. “DreamWorks Interactives Trespasser”, 1999 URL: https://bit.ly/3rqWp24
  114. “DrinkBox Studios Guacamelee!”, 2013 URL: https://bit.ly/34lqfvU
  115. “Ensemble Studios Age of Empires II: Age of Kings”, 2000 URL: https://bit.ly/35OfMd0
  116. “Freeverses Marathon 2: Durandal”, 2007 URL: https://bit.ly/34fmus0
  117. “Freeverses Top Gun For iPhone”, 2009 URL: https://bit.ly/3ooAIxB
  118. “Games Kitchens Wireless Pets”, 2002 URL: https://bit.ly/3op8p26
  119. “Hero-U: Rogue to Redemption Postmortem”, 2019 URL: https://bit.ly/3opx3zt
  120. “Ion Storms Deus Ex”, 2000 URL: https://bit.ly/3AXGj2P
  121. “Ironclad/Stardocks Sins of a Solar Empire”, 2008 URL: https://bit.ly/3oo9M0Y
  122. “Irrational Games System Shock 2”, 1999 URL: https://bit.ly/3Hx4TtZ
  123. “Lucas Arts Star Wars Starfighter”, 2001 URL: https://bit.ly/3Hr9QEt
  124. “McMillen and Himsls The Binding of Isaac”, 2012 URL: https://bit.ly/3GEbced
  125. “Micro Forte s Fallout Tactics”, 2001 URL: https://bit.ly/34h3yJs
  126. “Mind Controls Oasis”, 2005 URL: https://bit.ly/3umseuz
  127. “Mode 7 Games Frozen Synapse”, 2012 URL: https://bit.ly/3ooWVLY
  128. “Multitude Fireteam”, 1999 URL: https://bit.ly/3gnnyMX
  129. “Nayantaras Star Chamber”, 2003 URL: https://bit.ly/3onQgl0
  130. “Ngames Chop Suey Kung Fu”, 2001 URL: https://bit.ly/3GlDR7n
  131. “NinjaBees A Kingdom for Keflings”, 2009 URL: https://bit.ly/3sgtM6P
  132. “Operation Flashpoint”, 2001 URL: https://bit.ly/3GqF1yw
  133. “Over the Top Games NyxQuest Kindred Spirits”, 2010 URL: https://bit.ly/3rsH9lk
  134. “Pangalores Knightly Adventure”, 2013 URL: https://bit.ly/3LcO7mm
  135. “Pipeworks Softwares Deadliest Warrior”, 2010 URL: https://bit.ly/3seWRzE
  136. “Pixelogics The Italian Job”, 2002 URL: https://bit.ly/3J3JwRu
  137. “PONCHO-A Postmortem”, 2017 URL: https://bit.ly/3GtfRiR
  138. “Postcard from GDC Europe 2005: The First Generation of The Next Generation: A Project Gotham Racing 3 Postmortem”, 2005 URL: https://bit.ly/3rrcSDg
  139. “Postmortem Sniper Studios Crazy Taxi Fare Wars”, 2007 URL: https://bit.ly/3uFEA1l
  140. “Postmortem: E-Line Media and Upper One Games Never Alone”, 2015 URL: https://bit.ly/3rocBRE
  141. “Postmortem: Presto Studios Star Trek: Hidden Evil”, 1999 URL: https://bit.ly/34lqfMq
  142. “Prestos Whacked!”, 2002 URL: https://bit.ly/3AXCWJo
  143. “Raven Softwares Heretic II”, 1999 URL: https://bit.ly/3roKNMJ
  144. “Realtime Worlds Crackdown”, 2009 URL: https://bit.ly/3LbMaXh
  145. “Redstorms Rainbow Six”, 2000 URL: https://bit.ly/3rmDTI2
  146. “Rpublique”, 2016 URL: https://bit.ly/3uoqCAB
  147. “Saber Interactives TimeShift”, 2008 URL: https://bit.ly/35HToSl
  148. “Sierra Studios Gabriel Knight 3”, 2000 URL: https://bit.ly/3goEkeI
  149. “Sony Bend Studios Uncharted: Golden Abyss”, 2012 URL: https://bit.ly/3uqcJSG
  150. “Stardock Entertainment and Ironclad Games Sins of a Solar Empire: Rebellion”, 2012 URL: https://bit.ly/34bNF7c
  151. “Stardocks Galactic Civilizations 2: Dread Lords”, 2006 URL: https://bit.ly/3smLB4m
  152. “Stardocks The Political Machine”, 2004 URL: https://bit.ly/35HTpFT
  153. “Starting From Scratch: Haemimont Games Tropico 5 postmortem”, 2014 URL: https://bit.ly/3J8n21P
  154. “Student Postmortem: 6mSofts Romeo and Juliet”, 2005 URL: https://bit.ly/3L916Ft
  155. “Surreal Software Drakan Order of the Flame”, 1999 URL: https://bit.ly/3Gl8uKp
  156. “Team Meats Super Meat Boy”, 2011 URL: https://bit.ly/3GqF1P2
  157. “The Chinese Rooms Amnesia: A Machine for Pigs”, 2014 URL: https://bit.ly/3utZZKz
  158. “The Game Design of SurrealsThe Suffering”, 2004 URL: https://bit.ly/3oqHt21
  159. “Tom Clancys Splinter Cell”, 2003 URL: https://bit.ly/3scvXbD
  160. “Torpex Games’ Schizoid”, 2008 URL: https://bit.ly/3J3va3k
  161. “Ty the Tasmanian Tiger 2 for the Younger Market”, 2005 URL: https://bit.ly/3IWQhnY
  162. “Vampire The Masquerade Redemption”, 2000 URL: https://bit.ly/3upjuDX
  163. “Zachtronics Industries SpaceChem”, 2012 URL: https://bit.ly/3sj0CUr
  164. Bennett Foddy “Designing with Physics-Bend the Physics Engine to Your Will(Game Developers Conference(GDC))”, 2015 URL: https://bit.ly/3sjxTio
  165. Raphael Saint-Pierre “Time Where it Matters-Friction Free Bug Reporting(Game Developers Conference(GDC))”, 2013 URL: https://bit.ly/3Gp7dSr
  166. “Managing the Movement-Getting Your Animation Behaviors to Behave Better(Game Developers Conference(GDC))”, 2013 URL: https://bit.ly/3ooeSdL
  167. Michał Madej “Challenges of designing multiplayer games(Digital Dragons)”, 2014 URL: https://bit.ly/3opMg3x
  168. Błażej Żywiczyński “Upgrading the production toolbelt from This War of Mine to Frostpunk(Digital Dragons)”, 2018 URL: https://bit.ly/3J7j6hL
  169. “Failures to be celebrated: an analysis of major pivots of software startups” In Empirical Software Engineering 22, 2017
  170. “Game-breaking glitches” URL: https://bit.ly/3okWTF2
  171. “Game Breaking Bug” URL: https://bit.ly/3GkZu7W
  172. “Metroid Dread Has a Game-Breaking Bug: Here’s How to Avoid It” URL: https://bit.ly/3GqiJgy
  173. “10 Infamous Game Breaking Bugs In Famous Video Games” URL: https://bit.ly/3unigcz
  174. “5 Worst Game-Breaking Bugs of All Time” URL: https://bit.ly/3IWRbRo
  175. “Pokémon Unite Politely Asks Players To Stop Using Game-Breaking Bug” URL: https://bit.ly/3Hr0LvG
  176. “Halo Infinite Has A Save Game-Breaking Bug That Needs To Be Fixed” URL: https://bit.ly/3skm23T
  177. “Destiny 2 Game-Breaking Glitch Surfaces, Bungie Starts Handing Out Bans” URL: https://bit.ly/3goNjwo
  178. “Game breaking bug in Apex Legends makes players invulnerable while reviving” URL: https://bit.ly/3sguMrB
  179. “New World’s latest patch has brought 2 game-breaking bugs to healing and the auction house” URL: https://bit.ly/3gqo6Sh
  180. “Assassin’s Creed: Valhalla has game-breaking bug four months after release despite recent update” URL: https://bit.ly/3GEc5n3
  181. “Call of Duty: Warzone’s Biggest Game-Breaking Bug Is Back” URL: https://bit.ly/3LcPb9Q
  182. “‘Cyberpunk 2077’ update introduced a game-breaking bug” URL: https://engt.co/3oqjpfz
  183. “Three game-breaking bugs still present in the game” URL: https://bit.ly/32WO5O5
  184. “Vanguard players demand fix to ‘game-breaking’ Dead Drop glitch” URL: https://bit.ly/3ATWyy4
  185. “Game breaking bug on war!” URL: https://bit.ly/3gkuAC4
  186. “New World invincibility exploit discovered and it’s game-breaking” URL: https://bit.ly/3GvyRNE
  187. ““Game-breaking” Apex Legends bug is making Ash’s phase ultimate useless” URL: https://bit.ly/3AVdsMC
  188. “POSSIBLE GAME-BREAKING BUG DISCOVERED IN FALLOUT 4” URL: https://bit.ly/3umttKf
  189. “Game-breaking bug in SOMA safe mode(EPIC store)” URL: https://bit.ly/3AUIvs9
  190. Dayi Lin, Cor-Paul Bezemer and Ahmed E Hassan “Identifying gameplay videos that exhibit bugs in computer games” In Empirical Software Engineering, 2019
  191. “This is the most GAME BREAKING BUG i’ve ever seen-(youtube)” URL: https://bit.ly/3GlF7r7
  192. “10 recent worst game breaking glitches-(youtube)” URL: https://bit.ly/3AYTJvq
  193. “Top 10 worst game breaking glitches-(youtube)” URL: https://bit.ly/3AYTKzu
  194. “Top 10 worst game breaking glitches-(youtube)” URL: https://bit.ly/3Lb60Sa
  195. “New World game breaking bug needs to be fixed ASAP!-(youtube)” URL: https://bit.ly/34xq40y
  196. “Massive game breaking glitch in fortnite!-(youtube)” URL: https://bit.ly/3LcPqlg
  197. “Blizzard HAS TO FIX this GAME BREAKING bug NOW!-(youtube)” URL: https://bit.ly/3rzRfAZ
  198. “5 Game Breaking Glitches that BRICKED your Console — Fact Hunt — Larry Bundy Jr-(youtube)” URL: https://bit.ly/3AWESSk
  199. “Fallout 4 game-breaking bug discovered-gs news update-(youtube)” URL: https://bit.ly/34lrOdg
  200. “Top 5 game breaking bugs and exploits in overwatch-(youtube)” URL: https://bit.ly/3uFG8sb
  201. “New World GAME BREAKING BUG Deletes Hours of Gameplay!-(youtube)” URL: https://bit.ly/3omVy08
  202. “New Game BREAKING Bug Is Truly Awful… Maybe Don’t Play Ranked rn-Pokemon Unite-(youtube)” URL: https://bit.ly/3LbNkSD
  203. “Wtf new game breaking bug-unlimited gold abuse glitch-7.29 patch dota 2-(youtube)” URL: https://bit.ly/3gtJXrL
  204. “Fallout 76’s Latest Update Adds in a Major Game Breaking Bug-(youtube)” URL: https://bit.ly/3ro7aSI
  205. “The most game Breaking Bug of all time-(youtube)” URL: https://bit.ly/3L8Q1UV
  206. “Season 11 gamebreaking bug #954-(youtube)” URL: https://bit.ly/3B0DjCT
  207. “The “game breaking” bugs that closed classic-(youtube)” URL: https://bit.ly/3Gr8rwo
  208. “Game breaking bug gets you banned in destiny 2!-(youtube)” URL: https://bit.ly/3GpPOJu
  209. “There is a Game Breaking Glitch in Sword and Shield…-(youtube)” URL: https://bit.ly/3J3wovs
  210. “Minecraft’s most game breaking glitches…-(youtube)” URL: https://bit.ly/36pvj37
  211. “Is It Worse Post 1.1 Patch?-GAME BREAKING BUGS and GLITCHES-Cyberpunk 2077(Down on the Street)-(youtube)” URL: https://bit.ly/3BbbZCh
  212. “Bug that CRASHED LCS GAME! Taliyah/Karthus Gamebreaking Bug Investigation!-(youtube)” URL: https://bit.ly/3siXxno
  213. “Game-Breaking Glitch Discovered in Paper Mario: The Origami King. Here’s How to Avoid It!-(youtube)” URL: https://bit.ly/3HtfyWE
  214. “The wheelchair paladin [gamebreaking bug]-(youtube)” URL: https://bit.ly/3sj2yfF
  215. “Data for Deriving and Evaluating a Detailed Taxonomy of Game Bugs” Zenodo, 2023 DOI: 10.5281/zenodo.8425685
  216. “ISO/IEC” In IEEE International Standard-Systems and software engineering–Vocabulary–24765-2017, 2017, pp. 1–541
  217. Jesse Schell “The Art of Game Design: A book of lenses” CRC press, 2008
  218. “Challenges for network computer games” In Proceedings of the IADIS International Conference IADIS, 2004
  219. Robert Zubek “Elements of game design” MIT Press, 2020
  220. “Evaluation and measurement of software process improvement—a systematic literature review” In IEEE Transactions on Software Engineering 38.2 IEEE, 2011, pp. 398–424
  221. “Conducting on-line surveys in software engineering” In 2003 International Symposium on Empirical Software Engineering, 2003. ISESE 2003. Proceedings., 2003, pp. 80–88 IEEE
  222. Sorrel Brown “Likert scale examples for surveys”, 2010
  223. “An empirical study of bugs in build process” In Proceedings of the 29th Annual ACM Symposium on Applied Computing, 2014, pp. 1187–1189
  224. Luiz Alberto Ferreira Gomes, Ricardo Silva Torres and Mario Lúcio Côrtes “Bug report severity level prediction in open source software: A survey and research opportunities” In Information and software technology 115 Elsevier, 2019, pp. 58–78
  225. “Understanding the software development practices of blockchain projects: a survey” In Proceedings of the 12th ACM/IEEE international symposium on empirical software engineering and measurement, 2018, pp. 1–10
  226. “Framework for Task Allocation in Global Software Development” In IEEE Access 8 IEEE, 2020, pp. 206235–206247
  227. Aghyad Mohammad Albaghajati and Moataz Aly Kamaleldin Ahmed “Video Game Automated Testing Approaches: An Assessment Framework” In IEEE Transactions on Games, 2020
  228. “Empirical studies of software testing techniques: Challenges, practical strategies, and future research” In ACM SIGSOFT Software Engineering Notes 29.5 ACM New York, NY, USA, 2004, pp. 1–3
  229. Daniel Lowry Lough “A taxonomy of computer attacks with applications to wireless networks” Virginia Polytechnic InstituteState University, 2001
  230. “”What Went Right and What Went Wrong”: An Analysis of 155 Postmortems from Game Development” In IEEE/ACM 38th IEEE International Conference on Software Engineering Companion
  231. “An Overview of Game Testing Techniques”, 2011
  232. “GBGallery: A benchmark and framework for game testing” In Empirical Software Engineering 27.6 Springer, 2022, pp. 1–27

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now