Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
134 tokens/sec
GPT-4o
10 tokens/sec
Gemini 2.5 Pro Pro
47 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Investigating the Day-to-Day Experiences of Users with Traumatic Brain Injury with Conversational Agents (2309.01012v2)

Published 2 Sep 2023 in cs.HC

Abstract: Traumatic brain injury (TBI) can cause cognitive, communication, and psychological challenges that profoundly limit independence in everyday life. Conversational Agents (CAs) can provide individuals with TBI with cognitive and communication support, although little is known about how they make use of CAs to address injury-related needs. In this study, we gave nine adults with TBI an at-home CA for four weeks to investigate use patterns, challenges, and design requirements, focusing particularly on injury-related use. The findings revealed significant gaps between the current capabilities of CAs and accessibility challenges faced by TBI users. We also identified 14 TBI-related activities that participants engaged in with CAs. We categorized those activities into four groups: mental health, cognitive activities, healthcare and rehabilitation, and routine activities. Design implications focus on accessibility improvements and functional designs of CAs that can better support the day-to-day needs of people with TBI.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (76)
  1. ”Siri Talks at You”: An Empirical Investigation of Voice-Activated Personal Assistant (VAPA) Usage by Individuals Who Are Blind. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (Galway, Ireland) (ASSETS ’18). Association for Computing Machinery, New York, NY, USA, 249–258. https://doi.org/10.1145/3234695.3236344
  2. Ubiquitous Work Assistant: Synchronizing a Stationary and a Wearable Conversational Agent to Assist Knowledge Work. In 2022 Symposium on Human-Computer Interaction for Work. 1–9.
  3. Cognitive rehabilitation post traumatic brain injury: a systematic review for emerging use of virtual reality technology. Journal of Clinical Neuroscience 66 (2019), 209–219.
  4. Conversational Agents: Goals, Technologies, Vision and Challenges. Sensors 21, 24 (2021), 8448.
  5. Music, Search, and IoT: How People (Really) Use Voice Assistants. ACM Trans. Comput.-Hum. Interact. 26, 3, Article 17 (apr 2019), 28 pages. https://doi.org/10.1145/3311956
  6. Karen A Baikie and Kay Wilhelm. 2005. Emotional and physical health benefits of expressive writing. Advances in psychiatric treatment 11, 5 (2005), 338–346.
  7. Assumptions Checked: How Families Learn About and Use the Echo Dot. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 1, Article 3 (mar 2020), 23 pages. https://doi.org/10.1145/3380993
  8. Communication Breakdowns Between Families and Alexa. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300473
  9. Understanding the Long-Term Use of Smart Speaker Assistants. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 3, Article 91 (sep 2018), 24 pages. https://doi.org/10.1145/3264901
  10. Patient-reported problem areas in chronic traumatic brain injury. Journal of Head Trauma Rehabilitation 37, 5 (2022), E336–E345.
  11. Voice-Enabled Intelligent Virtual Agents for People With Amnesia: Systematic Review. JMIR aging 5, 2 (2022), e32473.
  12. Virginia Braun and Victoria Clarke. 2012. Thematic analysis. American Psychological Association.
  13. John Brooke et al. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 4–7.
  14. Sparks of artificial general intelligence: Early experiments with gpt-4. arXiv preprint arXiv:2303.12712 (2023).
  15. Storytelling as an intervention in traumatic brain injury rehabilitation: a scoping review. Disability and rehabilitation (2022), 1–15.
  16. Conversational agents in health care: scoping review and conceptual analysis. Journal of medical Internet research 22, 8 (2020), e17158.
  17. Mymemory: A mobile memory assistant for people with traumatic brain injury. International Journal of Human-Computer Studies 117 (2018), 4–19.
  18. ”Nobody Speaks That Fast!” An Empirical Study of Speech Rate in Conversational Agents for People with Vision Impairments. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376569
  19. What Makes a Good Conversation? Challenges in Designing Truly Conversational Agents. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300705
  20. Natalie V Covington and Melissa C Duff. 2021. Heterogeneity is a hallmark of traumatic brain injury, not a limitation: A new perspective on study design in rehabilitation research. American journal of speech-language pathology 30, 2S (2021), 974–985.
  21. Traumatic brain injury as a chronic disease: insights from the United States Traumatic Brain Injury Model Systems Research Program. The Lancet Neurology (2023).
  22. Automatic detection of cognitive impairment in elderly people using an entertainment chatbot with Natural Language Processing capabilities. Journal of Ambient Intelligence and Humanized Computing (2022), 1–16.
  23. Patterns of community integration 2-5 years post-discharge from brain injury rehabilitation. Brain Injury 15, 9 (2001), 747–762.
  24. Narrative storytelling as both an advocacy tool and a therapeutic process: Perspectives of adult storytellers with acquired brain injury. Neuropsychological Rehabilitation (2019).
  25. Aase W Engberg and Thomas W Teasdale. 2004. Psychosocial outcome following traumatic brain injury in adults: A long-term population-based follow-up. Brain injury 18, 6 (2004), 533–545.
  26. Lars Evald. 2015. Prospective memory rehabilitation using smartphones in patients with TBI: What do participants report? Neuropsychological rehabilitation 25, 2 (2015), 283–297.
  27. Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial. JMIR mental health 4, 2 (2017), e7785.
  28. Jonathan Grudin and Richard Jacques. 2019. Chatbots, Humbots, and the Quest for Artificial General Intelligence. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3290605.3300439
  29. Prevalence of medical and psychiatric comorbidities following traumatic brain injury. The Journal of head trauma rehabilitation 34, 4 (2019), E1.
  30. Portable electronic devices as memory and organizational aids after traumatic brain injury: a consumer survey study. The journal of head trauma rehabilitation 19, 5 (2004), 351–365.
  31. Use of a portable voice organizer to remember therapy goals in traumatic brain injury rehabilitation: a within-subjects trial. The Journal of head trauma rehabilitation 17, 6 (2002), 556–570.
  32. Anchored Audio Sampling: A Seamless Method for Exploring Children’s Thoughts During Deployment Studies. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300238
  33. Traumatic brain injury (TBI) 10? 20 years later: a comprehensive outcome study of psychiatric symptomatology, cognitive abilities and psychosocial functioning. Brain injury 15, 3 (2001), 189–209.
  34. Eva Hudlicka. 2013. Virtual training and coaching of health behavior: example from mindfulness meditation training. Patient education and counseling 92, 2 (2013), 160–166.
  35. Epidemiology of severe traumatic brain injury. Journal of neurosurgical sciences 62, 5 (2018), 535–541.
  36. Understanding the Benefits and Challenges of Deploying Conversational AI Leveraging Large Language Models for Public Health Intervention. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–16.
  37. A comprehensive picture of 4-year outcome of severe brain injuries. Results from the PariS-TBI study. Annals of physical and rehabilitation medicine 59, 2 (2016), 100–106.
  38. Sunyoung Kim and Abhishek Choudhury. 2021. Exploring older adults’ perception and use of smart speaker-based voice assistants: A longitudinal study. Computers in Human Behavior 124 (2021), 106914. https://doi.org/10.1016/j.chb.2021.106914
  39. Bar Lambez and Eli Vakil. 2021. The effectiveness of memory remediation strategies after traumatic brain injury: Systematic review and meta-analysis. Annals of physical and rehabilitation medicine 64, 5 (2021), 101530.
  40. Subjective complaints versus neuropsychological test performance after moderate to severe head injury. Acta neurochirurgica 140, 3 (1998), 245–253.
  41. Experience of recovery and outcome following traumatic brain injury: a metasynthesis of qualitative research. Disability and rehabilitation 32, 12 (2010), 986–999.
  42. I can help you change! an empathic virtual agent delivers behavior change health interventions. ACM Transactions on Management Information Systems (TMIS) 4, 4 (2013), 1–28.
  43. Talk to me: Exploring user interactions with the Amazon Alexa. Journal of Librarianship and Information Science 51, 4 (2019), 984–997. https://doi.org/10.1177/0961000618759414 arXiv:https://doi.org/10.1177/0961000618759414
  44. Reporting mental health symptoms: breaking down barriers to care with virtual human interviewers. Frontiers in Robotics and AI 4 (2017), 51.
  45. Aris Malapaschas. 2020. Accessibility and acceptability of voice assistants for people with acquired brain injury. ACM SIGACCESS Accessibility and Computing 123 (2020), 1–1.
  46. Aris Malapaschas. 2021. Voice assistants for people with cognitive impairments due to acquired brain injury. Ph. D. Dissertation. University of Glasgow.
  47. Demographic Characteristics, Motivation and Perception of Change as Determinants of Memory Compensation Self-Reports After Acquired Brain Injury. Frontiers in Psychology 12 (2021).
  48. Investigating the accessibility of voice assistants with impaired users: mixed methods study. Journal of medical Internet research 22, 9 (2020), e18431.
  49. JL Mathias and KM Mansfield. 2005. Prospective and declarative memory problems following moderate and severe traumatic brain injury. Brain injury 19, 4 (2005), 271–282.
  50. Long-term neuropsychological outcome and loss of social autonomy after traumatic brain injury. Archives of physical medicine and rehabilitation 78, 12 (1997), 1316–1320.
  51. Skye McDonald and Helen Genova. 2021. The effect of severe traumatic brain injury on social cognition, emotion regulation, and mood. Handbook of clinical neurology 183 (2021), 235–260.
  52. Social communication following traumatic brain injury part 2: Identifying effective treatment ingredients. International Journal of Speech-Language Pathology 21, 2 (2019), 128–142. https://doi.org/10.1080/17549507.2019.1583281 arXiv:https://doi.org/10.1080/17549507.2019.1583281 PMID: 30955383.
  53. Wendy Moyle. 2019. The promise of technology in the future of dementia care. Nature Reviews Neurology 15, 6 (2019), 353–359.
  54. Language comprehension after mild traumatic brain injury: The role of speed. American Journal of Speech-Language Pathology 28, 4 (2019), 1479–1490.
  55. Avatar-based depression self-management technology: promising approach to improve depressive symptoms among young adults. Applied nursing research 26, 1 (2013), 45–48.
  56. Voice Interfaces in Everyday Life. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3174214
  57. Use of Intelligent Voice Assistants by Older Adults with Low Technology Use. ACM Trans. Comput.-Hum. Interact. 27, 4, Article 31 (sep 2020), 27 pages. https://doi.org/10.1145/3373759
  58. ”Accessibility Came by Accident”: Use of Voice-Controlled Intelligent Personal Assistants by People with Disabilities. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3174033
  59. Amanda Rabinowitz and George Collier. 2021. Development of a Conversational Agent for Promoting Increased Activity in Users with Traumatic Brain Injury. Archives of Physical Medicine and Rehabilitation 102, 10 (2021), e83.
  60. Development of RehaBot—a conversational agent for promoting rewarding activities in users with traumatic brain injury. Journal of head trauma rehabilitation 37, 3 (2022), 144–151.
  61. Embodied conversational agents for patients with dementia: Thematic literature analysis. JMIR mHealth and uHealth 9, 7 (2021), e25381.
  62. Rachael Rietdijk. 2013. Training communication partners of people with severe traumatic brain injury improves everyday conversations: A multicenter single blind clinical trial. J Rehabil Med 45 (2013), 637–645.
  63. How inhibition relates to impulsivity after moderate to severe traumatic brain injury. Journal of the International Neuropsychological Society 19, 8 (2013), 890–898.
  64. Tam Sakirin and Rachid Ben Said. 2023. User preferences for ChatGPT-powered conversational interfaces versus traditional methods. Mesopotamian Journal of Computer Science 2023 (2023), 24–31.
  65. Amazon Science. 2022. Alexa Prize SocialBot Grand Challenge. https://www.amazon.science/alexa-prize/socialbot-grand-challenge. [Online; accessed 15-Sep-2022].
  66. ”Hey Alexa, What’s Up?”: A Mixed-Methods Studies of In-Home Conversational Agent Usage. In Proceedings of the 2018 Designing Interactive Systems Conference (Hong Kong, China) (DIS ’18). Association for Computing Machinery, New York, NY, USA, 857–868. https://doi.org/10.1145/3196709.3196772
  67. Sensitivity to noise following a mild traumatic brain injury: a longitudinal study. Journal of Head Trauma Rehabilitation 36, 5 (2021), E289–E301.
  68. Evidence-based practice for the use of external aids as a memory compensation technique. Journal of Medical Speech-Language Pathology 15, 1 (2007), xv–xv.
  69. Social communication following traumatic brain injury part I: State-of-the-art review of assessment tools. International Journal of Speech-Language Pathology 21, 2 (2019), 115–127. https://doi.org/10.1080/17549507.2019.1583280 arXiv:https://doi.org/10.1080/17549507.2019.1583280 PMID: 30957561.
  70. Association between cognitive performance and functional outcome following traumatic brain injury: a longitudinal multilevel examination. Neuropsychology 26, 5 (2012), 604.
  71. Graham Teasdale and Bryan Jennett. 1974. Assessment of coma and impaired consciousness: a practical scale. The Lancet 304, 7872 (1974), 81–84.
  72. INCOG recommendations for management of cognition following traumatic brain injury, part IV: Cognitive communication. The Journal of head trauma rehabilitation 29, 4 (2014), 353–368.
  73. Eli Vakil. 2005. The effect of moderate to severe traumatic brain injury (TBI) on different aspects of memory: a selective review. Journal of clinical and experimental neuropsychology 27, 8 (2005), 977–1021.
  74. The impact of voice assistant home devices on people with disabilities: A longitudinal study. Technological Forecasting and Social Change 184 (2022), 121961.
  75. Impact of traumatic brain injury on participation in leisure activities. Archives of physical medicine and rehabilitation 91, 9 (2010), 1357–1362.
  76. Empowering dyads of older adults with mild cognitive impairment and their care partners using conversational agents. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–15.
Citations (4)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now