Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
149 tokens/sec
GPT-4o
9 tokens/sec
Gemini 2.5 Pro Pro
47 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

"It's the only thing I can trust": Envisioning Large Language Model Use by Autistic Workers for Communication Assistance (2403.03297v1)

Published 5 Mar 2024 in cs.HC

Abstract: Autistic adults often experience stigma and discrimination at work, leading them to seek social communication support from coworkers, friends, and family despite emotional risks. LLMs are increasingly considered an alternative. In this work, we investigate the phenomenon of LLM use by autistic adults at work and explore opportunities and risks of LLMs as a source of social communication advice. We asked 11 autistic participants to present questions about their own workplace-related social difficulties to (1) a GPT-4-based chatbot and (2) a disguised human confederate. Our evaluation shows that participants strongly preferred LLM over confederate interactions. However, a coach specializing in supporting autistic job-seekers raised concerns that the LLM was dispensing questionable advice. We highlight how this divergence in participant and practitioner attitudes reflects existing schisms in HCI on the relative privileging of end-user wants versus normative good and propose design considerations for LLMs to center autistic experiences.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (98)
  1. [n. d.]. Blind - The #1 Tech Career Community — teamblind.com. https://www.teamblind.com/. [Accessed 05-Apr-2023].
  2. [n. d.]. Reddit - Dive into anything — reddit.com. https://www.reddit.com/r/autism/comments/12tk9ps/chatgpt_is_a_gamechanger_for_people_on_the/. [Accessed 13-06-2023].
  3. Hala Annabi. 2018. The Untold Story: The Masked Experiences of Women with Autism Working in IT. (2018).
  4. Hala Annabi and Jill Locke. 2019. A theoretical framework for investigating the context for creating employment success in information technology for individuals with autism. Journal of Management & Organization 25, 4 (2019), 499–515.
  5. American Psychiatric Association. and American Psychiatric Association. 2013. Diagnostic and statistical manual of mental disorders : DSM-5 (5th ed. ed.). American Psychiatric Association, Arlington, VA. xliv, 947 p. ; pages.
  6. Employment activities and experiences of adults with high-functioning autism and Asperger’s disorder. Journal of autism and developmental disorders 44, 10 (2014), 2440–2449.
  7. Shaowen Bardzell and Jeffrey Bardzell. 2011. Towards a feminist HCI methodology: social science, feminism, and HCI. In Proceedings of the SIGCHI conference on human factors in computing systems. 675–684.
  8. On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (Virtual Event, Canada) (FAccT ’21). Association for Computing Machinery, New York, NY, USA, 610–623. https://doi.org/10.1145/3442188.3445922
  9. On the dangers of stochastic parrots: Can language models be too big?. In Proceedings of the 2021 ACM conference on fairness, accountability, and transparency. 610–623.
  10. Barbara Bissonnette. 2013. Asperger’s Syndrome Workplace Survival Guide. Jessica Kingsley, London, England.
  11. Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (2006), 77–101.
  12. Simon Brisenden. 1986. Independent living and the medical model of disability. Disability, Handicap & Society 1, 2 (1986), 173–178.
  13. Sloane Burgess and Robert E Cimera. 2014. Employment outcomes of transition-aged adults with autism spectrum disorders: A state of the states report. American journal on intellectual and developmental disabilities 119, 1 (2014), 64–83.
  14. Social use of computer-mediated communication by adults on the autism spectrum. In Proceedings of the 2010 ACM conference on Computer supported cooperative work. 425–434.
  15. Dispensing with Humans in Human-Computer Interaction Research. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. 1–26.
  16. Beyond friendship: The spectrum of social participation of autistic adults. Journal of Autism and Developmental Disorders 53, 1 (2023), 424–437.
  17. Incivility in the workplace: Incidence and impact. Journal of Occupational Health Psychology 6, 1 (2001), 64–80. https://doi.org/10.1037/1076-8998.6.1.64
  18. Autistic adults’ views of their communication skills and needs. International journal of language & communication disorders 55, 5 (2020), 678–689.
  19. Joyce Davidson and Sophie Tamas. 2016. Autism and the ghost of gender. Emotion, Space and Society 19 (2016), 59–65.
  20. Yao Du and Felix Juefei-Xu. 2023. Generative AI for Therapy? Opportunities and Barriers for ChatGPT in Speech-Language Therapy. (2023).
  21. Interventions for improving employment outcomes for persons with autism spectrum disorders: A systematic review update. Campbell Systematic Reviews 17, 3 (July 2021). https://doi.org/10.1002/cl2.1185
  22. “I just want them to see me as… me”: Identity, community, and disclosure practices among college students on the autism spectrum. Autism in Adulthood 1, 4 (2019), 268–275.
  23. ” I wouldn’t say offensive but…”: Disability-Centered Perspectives on Large Language Models. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency. 205–216.
  24. Peter F Gerhardt and Ilene Lainer. 2011. Addressing the needs of adolescents and adults with autism: A crisis on the horizon. Journal of Contemporary Psychotherapy 41 (2011), 37–45.
  25. Parisa Ghanouni and Stephanie Quirke. 2023. Resilience and coping strategies in adults with autism spectrum disorder. Journal of Autism and Developmental Disorders 53, 1 (2023), 456–467.
  26. Deepak Giri and Erin Brady. 2023. Exploring outlooks towards generative AI-based assistive technologies for people with Autism. arXiv preprint arXiv:2305.09815 (2023).
  27. Video-Based Virtual Reality Technology for Autistic Users: An Emerging Technology Report. Technology, Knowledge and Learning 28, 2 (2023), 925–935.
  28. LaMPost: Design and Evaluation of an AI-assisted Email Writing Prototype for Adults with Dyslexia. In Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility. 1–18.
  29. Nico Grant. [n. d.]. Google Tests an A.I. Assistant That Offers Life Advice — nytimes.com. https://www.nytimes.com/2023/08/16/technology/google-ai-life-advice.html. [Accessed 09-09-2023].
  30. Assessing and teaching job-related social skills to adults with autism spectrum disorder. Journal of applied behavior analysis 52, 1 (2019), 150–172.
  31. Evaluating Large Language Models in Generating Synthetic HCI Research Data: a Case Study. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–19.
  32. Aimi Hamraie and Kelly Fritsch. 2019. Crip technoscience manifesto. Catalyst: Feminism, Theory, Technoscience 5, 1 (2019), 1–33.
  33. Barriers and facilitators to employment for adults with autism: A scoping review. Annals of International Occupational Therapy 1, 1 (2018), 31–40.
  34. Stumbling with their words, some people let AI do the talking. https://www.washingtonpost.com/technology/2022/12/10/chatgpt-ai-helps-written-communication/
  35. Benefits and risks: A systematic review of information and communication technology use by autistic people. Autism in Adulthood 3, 1 (2021), 72–84.
  36. Mobile video modeling for employment interviews for individuals with autism. Journal of Vocational Rehabilitation 43, 3 (2015), 275–287.
  37. “Always a glass ceiling.” Gender or autism; the barrier to occupational inclusion. Research in Autism Spectrum Disorders 56 (2018), 50–60.
  38. Research on technological interventions for young children with autism spectrum disorders: A scoping review. Review journal of autism and developmental disorders 8 (2021), 253–263.
  39. Philippa L Howard and Felicity Sedgewick. 2021. ‘Anything but the phone!’: Communication mode preferences in the autism community. Autism 25, 8 (2021), 2265–2278.
  40. Experiences of Support Following Autism Diagnosis in Adulthood. Journal of Autism and Developmental Disorders (2022), 1–14.
  41. Workplace success strategies for employees with autism spectrum disorder: A new frontier for human resource development. Human Resource Development Review 19, 2 (2020), 122–151.
  42. ChatGPT for good? On opportunities and challenges of large language models for education. Learning and individual differences 103 (2023), 102274.
  43. Which terms should be used to describe autism? Perspectives from the UK autism community. Autism 20, 4 (July 2015), 442–462. https://doi.org/10.1177/1362361315588200
  44. Social communication coaching smartglasses: Well tolerated in a diverse sample of children and adults with autism. JMIR mHealth and uHealth 5, 9 (2017), e8534.
  45. The advantages and challenges of neurodiversity employment in organizations. Journal of Management and Organization 25, 4 (2019), 453–463. https://doi.org/10.1017/jmo.2019.58
  46. Hanna Lagerqvist. 2020. “Seen it, enjoyed it, bye!”: Using and interacting on the Instagram platform from the perspective of autistic users.
  47. Illustrating reinforcement learning from human feedback (RLHF). https://huggingface.co/blog/rlhf
  48. Debra J. Leven. 2020. Invisible Social Identity in the Workplace. Ph. D. Dissertation. Northeastern University.
  49. Disclosure and workplace accommodations for people with autism: A systematic review. Disability and rehabilitation 43, 5 (2021), 597–610.
  50. Beatriz López. 2022. Commentary on Autism and the double-empathy problem: Implications for development and mental health. The British Journal of Developmental Psychology 40, 2 (2022), 368.
  51. What Do We Mean by “Accessibility Research”? A Literature Survey of Accessibility Papers in CHI and ASSETS from 1994 to 2019. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 371, 18 pages. https://doi.org/10.1145/3411764.3445412
  52. Disability Studies as a Source of Critical Inquiry for the Field of Assistive Technology. In Proceedings of the 12th International ACM SIGACCESS Conference on Computers and Accessibility (Orlando, Florida, USA) (ASSETS ’10). Association for Computing Machinery, New York, NY, USA, 3–10. https://doi.org/10.1145/1878803.1878807
  53. Deborah Marks. 1997. Models of disability. Disability and rehabilitation 19, 3 (1997), 85–91.
  54. Qualitative Data Analysis (4 ed.). SAGE Publications, Thousand Oaks, CA.
  55. Self-reported service needs and barriers reported by autistic adults: differences by gender identity. Research in Autism Spectrum Disorders 92 (2022), 101916.
  56. Damian EM Milton. 2012. On the ontological status of autism: The ‘double empathy problem’. Disability & society 27, 6 (2012), 883–887.
  57. GenAICHI: Generative AI and HCI. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. 1–7.
  58. Wasan Nagib and Robert Wilton. 2020. Gender matters in career exploration and job-seeking among adults with autism spectrum disorder: evidence from an online community. Disability and rehabilitation 42, 18 (2020), 2530–2541.
  59. An Expert Discussion on Employment in Autism. Autism in Adulthood 1, 3 (Sept. 2019), 162–169. https://doi.org/10.1089/aut.2019.29003.djn
  60. An ecosystem approach to employment and autism spectrum disorder. Journal of autism and developmental disorders 48, 1 (2018), 264–275.
  61. Career progression: Strategies used by self-advocates with ASD and their allies. In Generation A: Perspectives on Special Populations and International Research on Autism in the Workplace. Emerald Publishing Limited, 45–63.
  62. Mike Oliver. 2013. The social model of disability: Thirty years on. Disability & society 28, 7 (2013), 1024–1026.
  63. OpenAI. 2022. Introducing chatgpt. https://openai.com/blog/chatgpt
  64. OpenAI. 2023. GPT-4 Technical Report. https://doi.org/10.48550/ARXIV.2303.08774
  65. Training language models to follow instructions with human feedback. In Advances in Neural Information Processing Systems, S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh (Eds.), Vol. 35. Curran Associates, Inc., 27730–27744. https://proceedings.neurips.cc/paper_files/paper/2022/file/b1efde53be364a73914f58805a001731-Paper-Conference.pdf
  66. Sundar Pichai. 2023. An important next step on our ai journey. https://blog.google/technology/ai/bard-google-ai-search-updates/
  67. Christina H. Rebholz. 2012. Life in the Uncanny Valley: Workplace Issues for Knowledge Workers on the Autism Spectrum. Ph. D. Dissertation. Antioch University. http://aura.antioch.edu/etds/29
  68. The Design Space of Generative Models. arXiv e-prints (2023), arXiv–2304.
  69. Examining Bias in Screening Interviews Towards Individuals with Autism in the Tech Industry. ([n. d.]).
  70. Ghosts, mice, and robots: DisAppearing the autistic person. DisAppearing: Encounters in disability studies. Toronto: Canadian Scholars (2022), 93–105.
  71. National Autism Indicators Report: Transition into Young Adulthood. Life Course Outcomes Research Program (2015). https://doi.org/10.1007/s10803-010-1070-3
  72. Increasing communicative interactions of young children with autism using a voice output communication aid and naturalistic teaching. Journal of applied behavior analysis 31, 4 (1998), 561–578.
  73. Ralf W Schlosser and Rajinder K Koul. 2015. Speech output technologies in interventions for individuals with autism spectrum disorders: A scoping review. Augmentative and Alternative Communication 31, 4 (2015), 285–309.
  74. Viewpoints on Factors for Successful Employment for Adults with Autism Spectrum Disorder. PLOS ONE 10, 10 (Oct. 2015), e0139281. https://doi.org/10.1371/journal.pone.0139281
  75. Tom Shakespeare et al. 2006. The social model of disability. The disability studies reader 2 (2006), 197–204.
  76. Samantha Spengler. 2023. For Some Autistic People, ChatGPT Is a Lifeline — wired.com. https://www.wired.com/story/for-some-autistic-people-chatgpt-is-a-lifeline/. Accessed: 04 Jun 2023].
  77. Lucy Suchman. 2016. Organizing alignment: the case of bridge-building. In Knowing in organizations: a practice-based approach. Routledge, 187–203.
  78. Autism and Employment Challenges: The Double Empathy Problem and Perceptions of an Autistic Employee in the Workplace. Autism in Adulthood (2023).
  79. Autism, attachment, and alexithymia: Investigating emoji comprehension. International Journal of Human–Computer Interaction (2022), 1–14.
  80. Julie Lounds Taylor and Marsha Mailick Seltzer. 2010. Employment and Post-Secondary Educational Activities for Young Adults with Autism Spectrum Disorders During the Transition to Adulthood. Journal of Autism and Developmental Disorders 41, 5 (jul 2010), 566–574. https://doi.org/10.1007/s10803-010-1070-3
  81. Helpful or harmful? A scoping review of perceptions and outcomes of autism diagnostic disclosure to others. Research in Autism Spectrum Disorders 77 (2020), 101598.
  82. Katie Togher and Sarah Jay. 2023. Disclosing an autism diagnosis: A social identity approach. Autism Research (2023).
  83. u/ComprehensiveTime634. 2023. GPT for Interpreting Vague Instructions at Work. https://reddit.com/r/autism/comments/182zwme/gpt_for_interpreting_vague_instructions_at_work/. Accessed: 24 Nov 2023.
  84. u/hadleyajohnston. 2023. CHATGPT as a Tool for Autistics!! https://www.reddit.com/r/autism/comments/10wv1rl/chatgpt_as_a_tool_for_autistics/. Accessed: 8 Feb 2023.
  85. u/lilgreycat. 2023. What Do You Use Chatgpt For? https://www.reddit.com/r/autism/comments/13tlhop/what_do_you_use_chatgpt_for/. Accessed: 27 May 2023.
  86. u/SACBH. 2023. Chatgpt Is a Gamechanger for People on the Spectrum. https://reddit.com/r/autism/comments/12tk9ps/chatgpt_is_a_gamechanger_for_people_on_the/. Accessed: 21 Apr 2023.
  87. “The less I type, the better”: How AI Language Models can Enhance or Impede Communication for AAC Users. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–14.
  88. Design your life: user-initiated design of technology to empower autistic young adults. Journal of Enabling Technologies 16, 3 (2022), 172–188.
  89. Nick Walker. 2021. Neuroqueer heresies. Autonomous Press, Bondi Junction, NSW, Australia.
  90. Emmanuelle Walkowiak. 2021. Neurodiversity of the workforce and digital transformation: The case of inclusion of autistic workers at the workplace. Technological Forecasting and Social Change 168 (2021), 120739. https://doi.org/10.1016/j.techfore.2021.120739
  91. Employment and vocational skills among individuals with autism spectrum disorder: Predictors, impact, and interventions. Review Journal of Autism and Developmental Disorders 1 (2014), 266–275.
  92. Manhua Wang and Myounghoon Jeon. 2023. Assistive Technology for Adults on the Autism Spectrum: A Systematic Survey. International Journal of Human–Computer Interaction (2023), 1–20.
  93. Toward general design principles for generative AI applications. arXiv preprint arXiv:2301.05578 (2023).
  94. AI now report 2018. AI Now Institute at New York University New York.
  95. Counterventions: a reparative reflection on interventionist HCI. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–11.
  96. Andreas Witzel. 2000. The Problem-centered Interview. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research Vol 1 (2000), Methodical and Empirical Examples. https://doi.org/10.17169/FQS-1.1.1132
  97. Lian Zhang. 2018. Design and Applications of Intelligent Human-Computer Interaction Systems for Autism Spectrum Disorder intervention. Ph. D. Dissertation.
  98. Managing stress: the needs of autistic adults in video calling. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1–29.
Citations (10)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
Reddit Logo Streamline Icon: https://streamlinehq.com

Reddit

  1. “It’s the only thing I can trust”: Envisioning Large Language Model Use by Autistic Workers for Communication Assistance (4 points, 1 comment)