Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
97 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
44 tokens/sec
o3 Pro
5 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Appropriateness of LLM-equipped Robotic Well-being Coach Language in the Workplace: A Qualitative Evaluation (2401.14935v1)

Published 26 Jan 2024 in cs.HC and cs.RO

Abstract: Robotic coaches have been recently investigated to promote mental well-being in various contexts such as workplaces and homes. With the widespread use of LLMs, HRI researchers are called to consider language appropriateness when using such generated language for robotic mental well-being coaches in the real world. Therefore, this paper presents the first work that investigated the language appropriateness of robot mental well-being coach in the workplace. To this end, we conducted an empirical study that involved 17 employees who interacted over 4 weeks with a robotic mental well-being coach equipped with LLM-based capabilities. After the study, we individually interviewed them and we conducted a focus group of 1.5 hours with 11 of them. The focus group consisted of: i) an ice-breaking activity, ii) evaluation of robotic coach language appropriateness in various scenarios, and iii) listing shoulds and shouldn'ts for designing appropriate robotic coach language for mental well-being. From our qualitative evaluation, we found that a language-appropriate robotic coach should (1) ask deep questions which explore feelings of the coachees, rather than superficial questions, (2) express and show emotional and empathic understanding of the context, and (3) not make any assumptions without clarifying with follow-up questions to avoid bias and stereotyping. These results can inform the design of language-appropriate robotic coach to promote mental well-being in real-world contexts.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (37)
  1. A. J. Thirunavukarasu, D. S. J. Ting, K. Elangovan, L. Gutierrez, T. F. Tan, and D. S. W. Ting, “Large language models in medicine,” Nature medicine, vol. 29, no. 8, pp. 1930–1940, 2023.
  2. M. M. Amin, E. Cambria, and B. W. Schuller, “Will affective computing emerge from foundation models and general artificial intelligence? a first evaluation of chatgpt,” IEEE Intelligent Systems, vol. 38, no. 2, pp. 15–23, 2023.
  3. C. Zhang, J. Chen, J. Li, Y. Peng, and Z. Mao, “Large language models for human-robot interaction: A review,” Biomimetic Intelligence and Robotics, p. 100131, 2023.
  4. M. Spitale, M. Axelsson, and H. Gunes, “Robotic mental well-being coaches for the workplace: An in-the-wild study on form,” in Proceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction, 2023, pp. 301–310.
  5. N. I. Abbasi, M. Spitale, J. Anderson, T. Ford, P. B. Jones, and H. Gunes, “Can robots help in the evaluation of mental wellbeing in children? an empirical study,” in 2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN).   IEEE, 2022, pp. 1459–1466.
  6. M. Spitale, S. Silleresi, F. Garzotto, and M. J. Matarić, “Using socially assistive robots in speech-language therapy for children with language impairments,” International Journal of Social Robotics, pp. 1–18, 2023.
  7. B. Scassellati, H. Admoni, and M. Matarić, “Robots for use in autism research,” Annual review of biomedical engineering, vol. 14, pp. 275–294, 2012.
  8. F. Carros, J. Meurer, D. Löffler, D. Unbehaun, S. Matthies, I. Koch, R. Wieching, D. Randall, M. Hassenzahl, and V. Wulf, “Exploring human-robot interaction with the elderly: results from a ten-week case study in a care home,” in Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 2020, pp. 1–12.
  9. S. Jeong, L. Aymerich-Franch, S. Alghowinem, R. W. Picard, C. L. Breazeal, and H. W. Park, “A robotic companion for psychological well-being: A long-term investigation of companionship and therapeutic alliance,” in Proceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction, 2023, pp. 485–494.
  10. S. Jeong, L. Aymerich-Franch, K. Arias, S. Alghowinem, A. Lapedriza, R. Picard, H. W. Park, and C. Breazeal, “Deploying a robotic positive psychology coach to improve college students’ psychological well-being,” User Modeling and User-Adapted Interaction, vol. 33, no. 2, pp. 571–615, 2023.
  11. M. Spitale, M. Axelsson, N. Kara, and H. Gunes, “Longitudinal evolution of coachees’ behavioural responses to interaction ruptures in robotic positive psychology coaching,” 2023.
  12. H. Liu, Y. Zhu, K. Kato, I. Kondo, T. Aoyama, and Y. Hasegawa, “Llm-based human-robot collaboration framework for manipulation tasks,” arXiv preprint arXiv:2308.14972, 2023.
  13. C. H. Song, J. Wu, C. Washington, B. M. Sadler, W.-L. Chao, and Y. Su, “Llm-planner: Few-shot grounded planning for embodied agents with large language models,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 2998–3009.
  14. W. Huang, P. Abbeel, D. Pathak, and I. Mordatch, “Language models as zero-shot planners: Extracting actionable knowledge for embodied agents,” in International Conference on Machine Learning.   PMLR, 2022, pp. 9118–9147.
  15. Y. Cui, S. Karamcheti, R. Palleti, N. Shivakumar, P. Liang, and D. Sadigh, “No, to the right: Online language corrections for robotic manipulation via shared autonomy,” in Proceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction, 2023, pp. 93–101.
  16. M. Spitale, M. Axelsson, and H. Gunes, “Vita,” in XX, 2023, p. XX.
  17. G. Wang, Y. Xie, Y. Jiang, A. Mandlekar, C. Xiao, Y. Zhu, L. Fan, and A. Anandkumar, “Voyager: An open-ended embodied agent with large language models,” arXiv preprint arXiv:2305.16291, 2023.
  18. M. Karabacak and K. Margetis, “Embracing large language models for medical applications: Opportunities and challenges,” Cureus, vol. 15, no. 5, 2023.
  19. Y. Cho, M. Kim, S. Kim, O. Kwon, R. D. Kwon, Y. Lee, and D. Lim, “Evaluating the efficacy of interactive language therapy based on llm for high-functioning autistic adolescent psychological counseling,” arXiv preprint arXiv:2311.09243, 2023.
  20. J. Cabrera, M. S. Loyola, I. Magaña, and R. Rojas, “Ethical dilemmas, mental health, artificial intelligence, and llm-based chatbots,” in International Work-Conference on Bioinformatics and Biomedical Engineering.   Springer, 2023, pp. 313–326.
  21. R. Yang, T. F. Tan, W. Lu, A. J. Thirunavukarasu, D. S. W. Ting, and N. Liu, “Large language models in health care: Development, applications, and challenges,” Health Care Science, vol. 2, no. 4, pp. 255–263, 2023.
  22. A. Brohan, Y. Chebotar, C. Finn, K. Hausman, A. Herzog, D. Ho, J. Ibarz, A. Irpan, E. Jang, R. Julian, et al., “Do as i can, not as i say: Grounding language in robotic affordances,” in Conference on Robot Learning.   PMLR, 2023, pp. 287–318.
  23. T. Onorati, Á. Castro-González, J. C. del Valle, P. Díaz, and J. C. Castillo, “Creating personalized verbal human-robot interactions using llm with the robot mini,” in International Conference on Ubiquitous Computing and Ambient Intelligence.   Springer, 2023, pp. 148–159.
  24. M. Axelsson, M. Spitale, and H. Gunes, “Robotic coaches delivering group mindfulness practice at a public cafe,” in Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction, 2023.
  25. M. Spitale and H. Gunes, “Affective robotics for wellbeing: A scoping review,” in 2022 10th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACII-W).   IEEE, 2022.
  26. I. P. Bodala, N. Churamani, and H. Gunes, “Teleoperated robot coaching for mindfulness training: A longitudinal study,” in 2021 30th IEEE International Conference on Robot & Human Interactive Communication (RO-MAN).   IEEE, 2021, pp. 939–944.
  27. K. Matheus, M. Vázquez, and B. Scassellati, “A social robot for´ anxiety reduction via deep breathing,” in 2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN).   IEEE, 2022, pp. 89–94.
  28. Z. Shi, H. Chen, A.-M. Velentza, S. Liu, N. Dennler, A. O’Connell, and M. Mataric, “Evaluating and personalizing user-perceived quality of text-to-speech voices for delivering mindfulness meditation with different physical embodiments,” in Proceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction, 2023, pp. 516–524.
  29. S. Jeong, S. Alghowinem, L. Aymerich-Franch, K. Arias, A. Lapedriza, R. Picard, H. W. Park, and C. Breazeal, “A robotic positive psychology coach to improve college students’ wellbeing,” in 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN).   IEEE, 2020, pp. 187–194.
  30. M. Spitale, S. Okamoto, M. Gupta, H. Xi, and M. J. Matarić, “Socially assistive robots as storytellers that elicit empathy,” ACM Transactions on Human-Robot Interaction (THRI), vol. 11, no. 4, pp. 1–29, 2022.
  31. M. Resende, W. Busch, and R. Pereira, “The three waves of hci: A perspective from social sciences,” in Proceedings of the I Workshop Culturas, Alteridades e Participações em IHC (CAPAihc 2017), Workshop integrante do XVI Simpósio Brasileiro sobre Fatores Humanos em Sistemas Computacionais (IHC 2017), Joinville, SC, Brazil, vol. 23, 2017.
  32. S. Parkinson, V. Eatough, J. Holmes, E. Stapley, and N. Midgley, “Framework analysis: a worked example of a study exploring young people’s experiences of depression,” Qualitative research in psychology, vol. 13, no. 2, pp. 109–129, 2016.
  33. L. M. Vowels, “Are chatbots the new relationship experts? insights from three studies,” 2023.
  34. P. Limna, T. Kraiwanit, K. Jangjarat, P. Klayklung, and P. Chocksathaporn, “The use of chatgpt in the digital era: Perspectives on chatbot implementation,” Journal of Applied Learning and Teaching, vol. 6, no. 1, 2023.
  35. A. Belkhir and F. Sadat, “Beyond information: Is chatgpt empathetic enough?” in Proceedings of the 14th International Conference on Recent Advances in Natural Language Processing, 2023, pp. 159–169.
  36. A. Ajlouni, A. Almahaireh, and F. Whaba, “Students’ perception of using chatgpt in counseling and mental health education: The benefits and challenges,” International Journal of Emerging Technologies in Learning (iJET), vol. 18, no. 20, pp. 199–218, 2023.
  37. Y. Cao, L. Zhou, S. Lee, L. Cabello, M. Chen, and D. Hershcovich, “Assessing cross-cultural alignment between chatgpt and human societies: An empirical study,” arXiv preprint arXiv:2303.17466, 2023.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (3)
  1. Micol Spitale (26 papers)
  2. Minja Axelsson (9 papers)
  3. Hatice Gunes (73 papers)
Citations (3)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets