Towards Robotic Companions: Understanding Handler-Guide Dog Interactions for Informed Guide Dog Robot Design (2402.06790v1)
Abstract: Dog guides are favored by blind and low-vision (BLV) individuals for their ability to enhance independence and confidence by reducing safety concerns and increasing navigation efficiency compared to traditional mobility aids. However, only a relatively small proportion of BLV individuals work with dog guides due to their limited availability and associated maintenance responsibilities. There is considerable recent interest in addressing this challenge by developing legged guide dog robots. This study was designed to determine critical aspects of the handler-guide dog interaction and better understand handler needs to inform guide dog robot development. We conducted semi-structured interviews and observation sessions with 23 dog guide handlers and 5 trainers. Thematic analysis revealed critical limitations in guide dog work, desired personalization in handler-guide dog interaction, and important perspectives on future guide dog robots. Grounded on these findings, we discuss pivotal design insights for guide dog robots aimed for adoption within the BLV community.
- World blindness and visual impairment: despite many successes, the problem is growing. Community eye health 30, 100 (2017), 71.
- Deep Visual Navigation under Partial Observability. In 2022 International Conference on Robotics and Automation (ICRA) (Philadelphia, PA, USA). IEEE Press, 9439–9446. https://doi.org/10.1109/ICRA46639.2022.9811598
- Aira. 2023. We’re Aira, a Visual Interpreting Service. https://aira.io/
- Exploring the use of a drone to guide blind runners. In Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility. 263–264.
- Affective touch in human–robot interaction: conveying emotion to the Nao robot. International Journal of Social Robotics 10 (2018), 473–491.
- Dronenavigator: Using leashed and free-floating quadcopters to navigate visually impaired travelers. In Proceedings of the 19th international acm sigaccess conference on computers and accessibility. 300–304.
- AYES. 2023. Meet oko — The AI-powered navigation app for all pedestrians. https://www.ayes.ai/
- Enabling building service robots to guide blind people a participatory design approach. In 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 3–10.
- Emotional support domestic robots for healthy older adults: Conversational prototypes to help with loneliness. In Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction. 122–124.
- Christie Bane. 2020. Forward Together: an inside look at guide dog training. Independently published.
- Automation technology and sense of control: a window on human agency. PloS one 7, 3 (2012), e34075.
- Human-robot interaction: developing trust in robots. In Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction. 109–110.
- Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77–101.
- Acceptance of healthcare robots for the older population: Review and future directions. International journal of social robotics 1 (2009), 319–330.
- Review of quantitative empirical evaluations of technology for people with visual impairments. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–14.
- Sparks of artificial general intelligence: Early experiments with gpt-4. arXiv preprint arXiv:2303.12712 (2023).
- nuscenes: A multimodal dataset for autonomous driving. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 11621–11631.
- MINIGPT-V2: LARGE LANGUAGE MODEL AS A UNIFIED INTERFACE FOR VISION-LANGUAGE MULTI-TASK LEARNING. arXiv preprint arXiv:2310.09478 (2023).
- Encoder-decoder with atrous separable convolution for semantic image segmentation. In Proceedings of the European conference on computer vision (ECCV). 801–818.
- Can Quadruped Navigation Robots be Used as Guide Dogs? arXiv preprint arXiv:2210.08727 (2022).
- Quadruped guidance robot for the visually impaired: A comfort-based approach. In 2023 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 12078–12084.
- Vicuna: An Open-Source Chatbot Impressing GPT-4 with 90%* ChatGPT Quality. https://lmsys.org/blog/2023-03-30-vicuna/
- The efficiency and walking speed of visually impaired people. Ergonomics 29, 6 (1986), 779–789.
- The cityscapes dataset for semantic urban scene understanding. In Proceedings of the IEEE conference on computer vision and pattern recognition. 3213–3223.
- “She’s a dog at the end of the day”: Guide dog owners’ perspectives on the behaviour of their guide dog. PloS one 12, 4 (2017), e0176018.
- daglo. 2023. daglo - Never Miss a Word. https://daglo.ai/
- Seeing-Eye Quadruped Navigation with Force Responsive Locomotion Control. In 7th Annual Conference on Robot Learning.
- An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020).
- Brian L Due. 2023. Guide dog versus robot dog: assembling visually impaired people with non-human agents and achieving assisted mobility through distributed co-constructed perception. Mobilities 18, 1 (2023), 148–166.
- Boston Dynamics. [n. d.]. Home - Bostondynamics. Retrieved July 25, 2023 from https://bostondynamics.com
- Stephen Eick and Annie I Antón. 2020. Enhancing privacy in robotics via judicious sensor selection. In 2020 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 7156–7165.
- Be My Eyes. 2023. Be My Eyes - See the world together. https://www.bemyeyes.com/
- International Guide Dog Federation. 2023. History of Guide Dogs - International Guide Dog Federation. https://www.igdf.org.uk/guide-dogs/history-of-guide-dogs/
- Designing a robot guide for blind people in indoor environments. In Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction Extended Abstracts. 107–108.
- Clovernook Center for the Blind. 2023a. Guide Dogs: Your Questions Answered – Clovernook. https://clovernook.org/2021/09/22/guide-dogs-your-questions-answered/
- Canadian Guide Dogs for the Blind. 2023b. Realities of Guide Dog Mobility – Canadian Guide Dogs for the Blind. https://www.guidedogs.ca/realities-guide-dog-mobility
- Guiding Eyes for the Blind. 2023c. Guide Dogs 101 - Guiding Eyes for the Blind. https://www.guidingeyes.org/guide-dogs-101/
- Guiding Eyes for the Blind. 2023d. Who We Are - Guiding Eyes for the Blind. https://www.guidingeyes.org/who-we-are/
- The Carroll Center for the blind. 2023. The Carroll Center for the Blind. https://carroll.org/
- Guide Dog Foundation. 2023. Characteristics for Success. https://www.guidedog.org/gd/get-a-guide-dog/characteristics-for-success/gd/dog-programs/characteristics-for-success.aspx?hkey=504cd63e-30d8-4f1e-a533-8c4955f49313
- Measurement of trust in human-robot collaboration. In 2007 International symposium on collaborative technologies and systems. Ieee, 106–114.
- Shaun Gallagher. 2000. Philosophical conceptions of the self: implications for cognitive science. Trends in cognitive sciences 4, 1 (2000), 14–21.
- Shaun Gallagher. 2012. Multiple aspects in the sense of agency. New ideas in psychology 30, 1 (2012), 15–31.
- Florence Gaunet and Sandie Besse. 2019. Guide dogs’ navigation after a single journey: A descriptive study of path reproduction, homing, shortcut and detour. PLoS One 14, 7 (2019), e0219816.
- Guide Dog Users Inc. (GDUI). 2023. GDUI School Surveys - Guide Dog Users, Inc. (GDUI). https://guidedogusersinc.org/resources/gdui-school-survey/
- A2d2: Audi autonomous driving dataset. arXiv preprint arXiv:2004.06320 (2020).
- Nicholas A Giudice and Gordon E Legge. 2008. Blind navigation and the role of technology. The engineering handbook of smart technology for aging, disability, and independence 8 (2008), 479–500.
- FootNotes: Geo-referenced audio annotations for nonvisual exploration. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 3 (2018), 1–24.
- Cabot: Designing and evaluating an autonomous navigation robot for blind people. In Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility. 68–82.
- Touch-and-Heal: Data-driven Affective Computing in Tactile Interaction with Robotic Dog. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 7, 2 (2023), 1–33.
- Patrick Haggard and Manos Tsakiris. 2009. The experience of agency: Feelings, judgments, and responsibility. Current Directions in Psychological Science 18, 4 (2009), 242–246.
- Hierarchical and safe motion control for cooperative locomotion of robotic guide dogs and humans: A hybrid systems approach. IEEE Robotics and Automation Letters 5, 1 (2019), 56–63.
- A meta-analysis of factors affecting trust in human-robot interaction. Human factors 53, 5 (2011), 517–527.
- ”What’s That Robot Doing Here?”: Perceptions Of Incidental Encounters With Autonomous Quadruped Robots. In Proceedings of the First International Symposium on Trustworthy Autonomous Systems. 1–15.
- Marion A Hersh and Michael A Johnson. 2010. A robotic guide for blind people. Part 1. A multi-national survey of the attitudes, requirements and preferences of potential end-users. Applied Bionics and Biomechanics 7, 4 (2010), 277–288.
- Development and application of key technologies for Guide Dog Robot: A systematic literature review. Robotics and Autonomous Systems 154 (2022), 104104.
- Beyond the cane: describing urban scenes to blind people for mobility tasks. ACM Transactions on Accessible Computing (TACCESS) 15, 3 (2022), 1–29.
- System configuration and navigation of a guide dog robot: Toward animal guide dog-level guiding work. In 2023 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 9778–9784.
- Learning agile and dynamic motor skills for legged robots. Science Robotics 4, 26 (2019), eaau5872.
- Indoor navigation by blind people: Behaviors and challenges in unfamiliar spaces and buildings. British Journal of Visual Impairment 37, 2 (2019), 140–153.
- YOLO by Ultralytics. https://github.com/ultralytics/ultralytics
- Voice recognition based multi robot for blind people using lidar sensor. In 2020 International Conference on System, Computation, Automation and Networking (ICSCAN). IEEE, 1–6.
- Socially compliant navigation dataset (scand): A large-scale dataset of demonstrations for social navigation. IEEE Robotics and Automation Letters 7, 4 (2022), 11807–11814.
- STERLING: Self-Supervised Terrain Representation Learning from Unconstrained Robot Experience. In 7th Annual Conference on Robot Learning.
- Highly dynamic quadruped locomotion via whole-body impulse control and model predictive control. arXiv preprint arXiv:1909.06586 (2019).
- Transforming a Quadruped into a Guide Robot for the Visually Impaired: Formalizing Wayfinding, Interaction Modeling, and Safety Mechanism. arXiv preprint arXiv:2306.14055 (2023).
- How to Train Your Guide Dog: Wayfinding and Safe Navigation with Human-Robot Modeling. In Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction. 221–225.
- Segment anything. arXiv preprint arXiv:2304.02643 (2023).
- PathFinder: Designing a Map-less Navigation System for Blind People in Unfamiliar Buildings. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–16.
- Deep learning. nature 521, 7553 (2015), 436–444.
- The role of trust in human-robot interaction. Foundations of trusted autonomy (2018), 135–159.
- Visual instruction tuning. arXiv preprint arXiv:2304.08485 (2023).
- DRAGON: A Dialogue-Based Robot for Assistive Navigation with Visual Language Grounding. arXiv preprint arXiv:2307.06924 (2023).
- Designing a Wayfinding Robot for People with Visual Impairments. arXiv preprint arXiv:2302.09144 (2023).
- The guide dog as a mobility aid part 1: Perceived effectiveness on travel performance. Vision Rehabilitation International 1, 1 (2008), 17–33.
- The guide dog as a mobility aid part 2: Perceived changes to travel habits. Vision Rehabilitation International 1, 1 (2008), 34–45.
- Richard G Long and Nicholas A Giudice. 2010. Establishing and Maintaining Orientation for Mobility. (2010).
- Explanations and trust: What happens to trust when a robot partner does something unexpected? Computers in Human Behavior 138 (2023), 107473.
- What do we mean by “accessibility research”? A literature survey of accessibility papers in CHI and ASSETS from 1994 to 2019. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–18.
- That person moves like a car: Misclassification attack detection for autonomous systems using spatiotemporal consistency. In USENIX Security.
- Early evaluation of fearfulness in future guide dogs for blind people. Animals 11, 2 (2021), 412.
- Rachel Joy-Taub Miner. 2001. The experience of living with and using a dog guide. RE: view 32, 4 (2001), 183.
- James W Moore. 2016. What is the sense of agency and why does it matter? Frontiers in psychology 7 (2016), 1272.
- Guide Dogs of America. 2023. How to Get a Service Dog - Guide Dogs of America. https://www.guidedogsofamerica.org/admissions/
- Bay State Council of the Blind. 2022. Bay State Council of the Blind. https://acbofma.org/
- Listen to it yourself! evaluating usability of what’s around me? for the blind. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2107–2116.
- Naver Papago. 2023. Papago. https://papago.naver.com/
- Continual lifelong learning with neural networks: A review. Neural networks 113 (2019), 54–71.
- Sideguide: a large-scale sidewalk dataset for guiding impaired people. In 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 10022–10029.
- Towards robotic assistants in nursing homes: Challenges and results. Robotics and autonomous systems 42, 3-4 (2003), 271–281.
- Learning transferable visual models from natural language supervision. In International conference on machine learning. PMLR, 8748–8763.
- Recent advances in robot learning from demonstration. Annual review of control, robotics, and autonomous systems 3 (2020), 297–330.
- The health and social status of guide dog owners and other visually impaired adults in Scotland. Visual Impairment Research 1, 2 (1999), 95–109.
- Travelling with a Guide Dog: Experiences of People with Vision Impairment. Sustainability 13, 5 (2021), 2840.
- Unitree Robotics. 2023. Unitree Go2 (Pre-order) – UnitreeRobotics. https://shop.unitree.com/collections/frontpage/products/unitree-go2?variant=45119174377705
- Occupational Safety and Health Administration. 2000. 1917.120 - Fixed stairways. — Occupational Safety and Health Administration. https://www.osha.gov/laws-regs/regulations/standardnumber/1917/1917.120
- Katherine Standish Schneider. 2005. Practice Report: The Winding Valley of Grief: When a Dog Guide Retires or Dies. Journal of Visual Impairment & Blindness 99, 6 (2005), 368–370.
- Social Security. 2010. Social Security Act §1614. https://www.ssa.gov/OP_Home/ssact/title16b/1614.htm
- Ving: Learning open-world navigation with visual goals. In 2021 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 13215–13222.
- Lm-nav: Robotic navigation with large pre-trained models of language, vision, and action. In Conference on Robot Learning. PMLR, 492–504.
- Designing the user interface: strategies for effective human-computer interaction. Pearson.
- Multimodal sensing and intuitive steering assistance improve navigation and mobility for people with impaired vision. Science robotics 6, 59 (2021), eabg6594.
- Learning to navigate sidewalks in outdoor environments. IEEE Robotics and Automation Letters 7, 2 (2022), 3906–3913.
- NoMaD: Goal Masked Diffusion Policies for Navigation and Exploration. arXiv preprint arXiv:2310.07896 (2023).
- Scalability in perception for autonomous driving: Waymo open dataset. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 2446–2454.
- Guide dog robot. Autonomous mobile robots: Control, planning, and architecture (1984), 360–367.
- Study of guide dog (seeing eye) robot (I). Bulletin of Mechanical Engineering Laboratory (Japan) 32 (1978).
- The University of Tokyo Tachi Laboratory. 2023. Tachi_Lab - Guide Dog Robot (MELDOG). https://tachilab.org/en/projects/meldog.html
- Flying guide dog: Walkable path discovery for the visually impaired utilizing drones and transformer-based semantic segmentation. In 2021 IEEE International Conference on Robotics and Biomimetics (ROBIO). IEEE, 1123–1128.
- Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971 (2023).
- Puppy In Training. 2017. How Much Does A Guide Dog Cost? https://puppyintraining.com/how-much-does-a-guide-dog-cost/
- Michael Tucker. 1984. Eyes That Lead: The Story of Guide Dogs for the Blind (1st. ed.). Howell Book House.
- Iwan Ulrich and Johann Borenstein. 2001. The GuideCane-applying mobile robot technologies to assist the visually impaired. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans 31, 2 (2001), 131–136.
- Visual impairment and blindness in adults in the United States: demographic and geographic variations from 2015 to 2050. JAMA ophthalmology 134, 7 (2016), 802–809.
- Attention is all you need. Advances in neural information processing systems 30 (2017).
- Smart cane: Assistive cane for visually-impaired people. arXiv preprint arXiv:1110.5156 (2011).
- Image as a Foreign Language: BEiT Pretraining for Vision and Vision-Language Tasks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 19175–19186.
- Lorraine Whitmarsh. 2005. The benefits of guide dog ownership. Visual impairment research 7, 1 (2005), 27–42.
- Foundations of orientation and mobility. Vol. 1. American Foundation for the Blind.
- Cindy Wiggett-Barnard and Henry Steel. 2008. The experience of owning a guide dog. Disability and Rehabilitation 30, 14 (2008), 1014–1026.
- ” Pray before you step out” describing personal and situational blind navigation behaviors. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility. 1–8.
- Mei Ling Wong. 2006. Perceptions of guide dog users on their dogs’ impact on their lives. Ph. D. Dissertation. Pacific University Stockton, CA, USA.
- Robotic guide dog: Leading a human with leash-guided hybrid physical interaction. In 2021 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 11470–11476.
- Xiaomi. [n. d.]. Xiaomi United States. Retrieved July 25, 2023 from https://www.mi.com/us
- Bdd100k: A diverse driving dataset for heterogeneous multitask learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 2636–2645.
- Hapticrein: Design and development of an interactive haptic rein for a guidance robot. In Computers Helping People with Special Needs: 16th International Conference, ICCHP 2018, Linz, Austria, July 11-13, 2018, Proceedings, Part II 16. Springer, 94–101.
- Towards Robust Robot 3D Perception in Urban Environments: The UT Campus Object Dataset. arXiv preprint arXiv:2309.13549 (2023).
- ”I am the follower, also the boss”: Exploring Different Levels of Autonomy and Machine Forms of Guiding Robots for the Visually Impaired. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–22.
- Zero-shot object goal visual navigation. In 2023 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2025–2031.
- MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models. arXiv preprint arXiv:2304.10592 (2023).