Surveyor: Facilitating Discovery Within Video Games for Blind and Low Vision Players (2403.10512v1)
Abstract: Video games are increasingly accessible to blind and low vision (BLV) players, yet many aspects remain inaccessible. One aspect is the joy players feel when they explore environments and make new discoveries, which is integral to many games. Sighted players experience discovery by surveying environments and identifying unexplored areas. Current accessibility tools, however, guide BLV players directly to items and places, robbing them of that experience. Thus, a crucial challenge is to develop navigation assistance tools that also foster exploration and discovery. To address this challenge, we propose the concept of exploration assistance in games and design Surveyor, an in-game exploration assistance tool that enhances discovery by tracking where BLV players look and highlighting unexplored areas. We designed Surveyor using insights from a formative study and compared Surveyor's effectiveness to approaches found in existing accessible games. Our findings reveal implications for facilitating richer play experiences for BLV users within games.
- Playing Blind: Revealing the World of Gamers with Visual Impairment. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3290605.3300346
- Towards Generalised Accessibility of Computer Games. In Technologies for E-Learning and Digital Entertainment (Lecture Notes in Computer Science), Zhigeng Pan, Xiaopeng Zhang, Abdennour El Rhalibi, Woontack Woo, and Yi Li (Eds.). Springer, Berlin, Heidelberg, 518–527. https://doi.org/10.1007/978-3-540-69736-7_55
- Uncovering Information Needs for Independent Spatial Learning for Users Who Are Visually Impaired. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS ’13). Association for Computing Machinery, New York, NY, USA, 1–8. https://doi.org/10.1145/2513383.2513445
- Birds vs. Fish: Visualizing Out-of-View Objects in Augmented Reality Using 3D Minimaps. In 2019 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). 285–286. https://doi.org/10.1109/ISMAR-Adjunct.2019.00-28
- Geoffrey Bunting. 2022. For Disabled Gamers, ‘The Last of Us Part I’ Remake Is Worth $70. Washington Post (Aug. 2022).
- Geoffrey Bunting. 2023. Games Are More Visually Accessible Than Ever. It’s Just the Start. Wired (April 2023).
- Rethinking GPS Navigation: Creating Cognitive Maps through Auditory Clues. Scientific Reports 11, 1 (April 2021), 7764. https://doi.org/10.1038/s41598-021-87148-4
- Code Respawn. [n. d.]. Dungeon Architect. https://assetstore.unity.com/packages/tools/utilities/dungeon-architect-53895
- Tom Cole and Marco Gillies. 2021. Thinking and Doing: Challenge, Agency, and the Eudaimonic Experience in Video Games. Games and Culture 16, 2 (March 2021), 187–207. https://doi.org/10.1177/1555412019881536
- Virtual Environments for the Transfer of Navigation Skills in the Blind: A Comparison of Directed Instruction vs. Video Game Based Learning Approaches. Frontiers in Human Neuroscience 8 (2014).
- Liam Croft. 2022. Feature: How Accessibility Options Help Disabled Gamers Beat The Last of Us: Part I. https://www.pushsquare.com/features/how-accessibility-options-help-disabled-gamers-beat-the-last-of-us-part-i.
- Core Design. 1996. Tomb Raider. Eidos Interactive, London, England.
- Naughty Dog. 2020. The Last of Us Part II. Sony Interactive Entertainment, San Mateo, CA.
- Naughty Dog. 2022. The Last of Us Part I. Sony Interactive Entertainment, San Mateo, CA.
- Dowino. 2016. A Blind Legend. Plug In Digital.
- Johnny Friberg and Dan Gärdenfors. 2004. Audio Games: New Perspectives on Game Audio. In Proceedings of the 2004 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology (ACE ’04). Association for Computing Machinery, New York, NY, USA, 148–154. https://doi.org/10.1145/1067343.1067361
- Matthew Gallant. 2020. The Last of Us Part II: Accessibility Features Detailed. https://blog.playstation.com/2020/06/09/the-last-of-us-part-ii-accessibility-features-detailed/.
- Riot Games. 2019. Module 1: Game Feeling & 8 Kinds of Fun — URF Academy Online Game Design Curriculum. https://www.riotgames.com/en/urf-academy/fun-and-feeling.
- Pierre-Alexandre Garneau. 2001. Fourteen Forms of Fun. https://www.gamasutra.com/view/feature/227531/fourteen_forms_of_fun.php.
- Nicholas A. Giudice. 2018. Navigating without Vision: Principles of Blind Spatial Cognition. Handbook of Behavioral and Cognitive Geography (April 2018).
- ”My Zelda Cane”: Strategies Used by Blind Players to Play Visual-Centric Digital Games. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3544548.3580702
- Playing With Others: Depicting Multiplayer Gaming Experiences of People With Visual Impairments. In Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS ’20). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3373625.3418304
- How Persons with Visual Impairments Explore Novel Spaces: Strategies of Good and Poor Performers. Journal of Visual Impairment & Blindness 87, 8 (Oct. 1993), 295–301. https://doi.org/10.1177/0145482X9308700805
- MDA: A Formal Approach to Game Design and Game Research. In Proceedings of the AAAI Workshop on Challenges in Game AI, Vol. 4. 1722.
- Pin Interactive. 2003. Terraformers.
- ”I Want to Figure Things Out”: Supporting Exploration in Navigation for People with Visual Impairments. Proceedings of the ACM on Human-Computer Interaction 7, CSCW1 (April 2023), 63:1–63:28. https://doi.org/10.1145/3579496
- Jeremy Kaldobsky. 2011. Swamp.
- Orly Lahav and David Mioduser. 2008. Construction of Cognitive Maps of Unknown Spaces Using a Multi-Sensory Virtual Environment for People Who Are Blind. Computers in Human Behavior 24, 3 (May 2008), 1139–1155. https://doi.org/10.1016/j.chb.2007.04.003
- Marc LeBlanc. 2008. 8KindsOfFun.Com: The Collected Game Design Rants of Marc ”MAHK” LeBlanc. http://algorithmancy.8kindsoffun.com/.
- Audible Mapper & ShadowRine: Development of Map Editor Using Only Sound in Accessible Game for Blind Users, and Accessible Action RPG for Visually Impaired Gamers. In Computers Helping People with Special Needs (Lecture Notes in Computer Science), Klaus Miesenberger, Christian Bühler, and Petr Penaz (Eds.). Springer International Publishing, Cham, 537–544. https://doi.org/10.1007/978-3-319-41264-1_73
- Gillen McAllister. 2022. The Last of Us Part I: Full List of Accessibility Features.
- Microsoft. 2017. Seeing AI. https://www.microsoft.com/en-us/ai/seeing-ai
- Midway. 1992. Mortal Kombat. Midway, Chicago, IL.
- David Molloy and Paul Carter. 2020. Last of Us Part II: Is This the Most Accessible Game Ever? BBC News (June 2020).
- NavStick: Making Video Games Blind-Accessible via the Ability to Look Around. In The 34th Annual ACM Symposium on User Interface Software and Technology (UIST ’21). Association for Computing Machinery, New York, NY, USA, 538–551. https://doi.org/10.1145/3472749.3474768
- Uncovering Visually Impaired Gamers’ Preferences for Spatial Awareness Tools Within Video Games. In Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS ’22). Association for Computing Machinery, New York, NY, USA, 1–16. https://doi.org/10.1145/3517428.3544802
- Vishnu Nair and Brian A. Smith. 2020. Toward Self-Directed Navigation for People with Visual Impairments. In Adjunct Publication of the 33rd Annual ACM Symposium on User Interface Software and Technology (UIST ’20 Adjunct). Association for Computing Machinery, New York, NY, USA, 139–141. https://doi.org/10.1145/3379350.3416156
- ImageAssist: Tools for Enhancing Touchscreen-Based Image Exploration Systems for Blind and Low Vision Users. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23). Association for Computing Machinery, New York, NY, USA, 1–17. https://doi.org/10.1145/3544548.3581302
- Out of Sight Games. 2017. A Hero’s Call.
- John R. Porter and Julie A. Kientz. 2013. An Empirical Study of Issues and Barriers to Mainstream Video Game Accessibility. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS ’13). Association for Computing Machinery, New York, NY, USA, 1–8.
- Nintendo R&D4. 1985. Super Mario Bros. Nintendo, Kyoto, Japan.
- Microsoft Research. 2018. Microsoft Soundscape.
- The Motivational Pull of Video Games: A Self-Determination Theory Approach. Motivation and Emotion 30, 4 (Dec. 2006), 344–360. https://doi.org/10.1007/s11031-006-9051-8
- NavCog3: An Evaluation of a Smartphone-Based Blind Indoor Navigation Assistant with Semantic Features in a Large-Scale Environment. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS ’17). Association for Computing Machinery, New York, NY, USA, 270–279. https://doi.org/10.1145/3132525.3132535
- Andrew Sears and Vicki L. Hanson. 2012. Representing Users in Accessibility Research. ACM Transactions on Accessible Computing 4, 2 (March 2012), 7:1–7:6. https://doi.org/10.1145/2141943.2141945
- Team Silent and Konami Computer Entertainment Tokyo. 1999. Silent Hill. Konami, Tokyo, Japan.
- Stumbling in Their Shoes: Disability Simulations Reduce Judged Capabilities of Disabled People. Social Psychological and Personality Science 6, 4 (May 2015), 464–471. https://doi.org/10.1177/1948550614559650
- Brian A. Smith and Shree K. Nayar. 2018. The RAD: Making Racing Games Equivalently Accessible to People Who Are Blind. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3174090
- Falling Squirrel and Creative Bytes Studios. 2021. The Vale: Shadow of the Crown. Falling Squirrel.
- Retro Studios. 2002. Metroid Prime. Nintendo, Kyoto, Japan.
- Retro Studios. 2004. Metroid Prime 2: Echoes. Nintendo, Kyoto, Japan.
- Retro Studios. 2007. Metroid Prime 3: Corruption. Nintendo, Kyoto, Japan.
- Ross Thorn. 2018. How to Play With Maps. Thesis.
- PowerUp: an accessible virtual world. In Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility - Assets ’08. ACM Press, 177–184. https://doi.org/10.1145/1414471.1414504
- April Tyack and Peta Wyeth. 2021. ”The Small Decisions Are What Makes It Interesting”: Autonomy, Control, and Restoration in Player Experience. Proceedings of the ACM on Human-Computer Interaction 5, CHI PLAY (Oct. 2021), 1–26. https://doi.org/10.1145/3474709
- Unity Technologies. 2021. Unity.
- Steve Watts. 2021. 2020 Video Game Accessibility Awards Announced. GameSpot (March 2021).
- Thomas Westin. 2004. Game Accessibility Case Study: Terraformers–a Real-Time 3D Graphic Game. In Proc. of The Fifth International Conference on Disability, Virtual Reality and Associated Technologies. 95–100.
- Supporting Spatial Awareness and Independent Wayfinding for Pedestrians with Visual Impairments. In The Proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS ’11). Association for Computing Machinery, New York, NY, USA, 27–34. https://doi.org/10.1145/2049536.2049544
- Mini-Map for Gamers Who Walk and Teleport in a Virtual Stronghold. ISPRS International Journal of Geo-Information 10, 2 (Feb. 2021), 96. https://doi.org/10.3390/ijgi10020096
- Zenly. 2022. Your World — Zenly Community. https://community.zen.ly/hc/en-us/articles/5467330606609-Your-World.