Papers
Topics
Authors
Recent
2000 character limit reached

From Words and Exercises to Wellness: Farsi Chatbot for Self-Attachment Technique (2310.09362v3)

Published 13 Oct 2023 in cs.HC and cs.LG

Abstract: In the wake of the post-pandemic era, marked by social isolation and surging rates of depression and anxiety, conversational agents based on digital psychotherapy can play an influential role compared to traditional therapy sessions. In this work, we develop a voice-capable chatbot in Farsi to guide users through Self-Attachment (SAT), a novel, self-administered, holistic psychological technique based on attachment theory. Our chatbot uses a dynamic array of rule-based and classification-based modules to comprehend user input throughout the conversation and navigates a dialogue flowchart accordingly, recommending appropriate SAT exercises that depend on the user's emotional and mental state. In particular, we collect a dataset of over 6,000 utterances and develop a novel sentiment-analysis module that classifies user sentiment into 12 classes, with accuracy above 92%. To keep the conversation novel and engaging, the chatbot's responses are retrieved from a large dataset of utterances created with the aid of Farsi GPT-2 and a reinforcement learning approach, thus requiring minimal human annotation. Our chatbot also offers a question-answering module, called SAT Teacher, to answer users' questions about the principles of Self-Attachment. Finally, we design a cross-platform application as the bot's user interface. We evaluate our platform in a ten-day human study with N=52 volunteers from the non-clinical population, who have had over 2,000 dialogues in total with the chatbot. The results indicate that the platform was engaging to most users (75%), 72% felt better after the interactions, and 74% were satisfied with the SAT Teacher's performance.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (75)
  1. Perceptions and Opinions of Patients About Mental Health Chatbots: Scoping Review. J Med Internet Res 23, 1 (01 2021).
  2. Persian Emotion Detection using ParsBERT and Imbalanced Data Handling Approaches. arXiv preprint arXiv:2211.08029 (2022).
  3. Arabic chatbot technologies: A scoping review. Computer Methods and Programs in Biomedicine Update 2 (2022), 100057. https://doi.org/10.1016/j.cmpbup.2022.100057
  4. An Empathetic AI Coach for Self-Attachment Therapy. In 2021 IEEE Third International Conference on Cognitive Machine Intelligence (CogMI). 78–87. https://doi.org/10.1109/CogMI52975.2021.00019
  5. Prevalence of Symptoms of Anxiety Among Residents of Kabul During Pandemic of COVID-19: A Report from Capital of Afghanistan. Neuropsychiatr Dis Treat 17 (Aug. 2021), 2841–2846.
  6. PeQA: A Massive Persian Question-Answering and Chatbot Dataset. In 2022 12th International Conference on Computer and Knowledge Engineering (ICCKE). IEEE, 392–397.
  7. Prevalence and associated factors of depression, anxiety and stress among coronavirus disease 2019 (COVID-19) patients in Herat, Afghanistan. Glob Health J 6, 2 (June 2022), 85–90.
  8. Unique challenges to control the spread of COVID-19 in the Middle East. Journal of Infection and Public Health 13, 9 (2020), 1247–1250. https://doi.org/10.1016/j.jiph.2020.06.034
  9. Persian Language Understanding in Task-Oriented Dialogue System for Online Shopping. In 2020 11th International Conference on Information and Knowledge Technology (IKT). IEEE, 79–84.
  10. When the social becomes non-human: young people’s perception of social support in chatbots social support in chatbots. In (2021).
  11. Assessing the usability of a chatbot for mental health care. In Internet Science: INSCI 2018 International Workshops, St. Petersburg, Russia, October 24–26, 2018, Revised Selected Papers 5. Springer, 121–132.
  12. David Cittern and Abbas Edalat. 2017. A neural model of empathic states in attachment-based psychotherapy. Computational Psychiatry (Cambridge, Mass.) 1 (2017), 132.
  13. Intrinsic and extrinsic motivators of attachment under active inference. PloS one 13, 4 (2018), e0193955.
  14. Unsupervised cross-lingual representation learning at scale. arXiv preprint arXiv:1911.02116 (2019).
  15. Alison Darcy. 2023. Why Generative AI Is Not Yet Ready for Mental Healthcare. Retrieved October 09, 2023 from https://woebothealth.com/why-generative-ai-is-not-yet-ready-for-mental-healthcare/
  16. Attitudes of Children, Adolescents, and Their Parents Toward Digital Health Interventions: Scoping Review. J Med Internet Res 25 (2 May 2023), e43102. https://doi.org/10.2196/43102
  17. The COVID-19 pandemic’s true death toll in Iran after two years: an interrupted time series analysis of weekly all-cause mortality data. BMC Public Health 23, 442 (2023).
  18. Abbas Edalat. 2015. Introduction to self-attachment and its neural basis. In 2015 International Joint Conference on Neural Networks (IJCNN). IEEE, 1–8. https://doi.org/10.1109/IJCNN.2015.7280780
  19. Abbas Edalat. 2017. Self-attachment: A Holistic Approach to Computational Psychiatry. In Comput. Neurology and Psychiatry, Péter Érdi, Basabdatta Sen Bhattacharya, and Amy L. Cochran (Eds.). Springer International Publishing, Cham, 273–314.
  20. A Pilot Study to Evaluate the Efficacy of Self-Attachment to Treat Chronic Anxiety and/or Depression in Iranian Women. International Journal of Environmental Research and Public Health 19, 11 (2022). https://doi.org/10.3390/ijerph19116376
  21. A pilot study to evaluate the efficacy of self-attachment to treat chronic anxiety and/or depression in Iranian women. International Journal of Environmental Research and Public Health 19, 11 (2022), 6376.
  22. Proof of Concept for Efficacy of VR-based Self-Attachment Intervention in a Non-Clinical Population. https://doi.org/10.31234/osf.io/wqzfx
  23. Therapist empathy and client outcome: An updated meta-analysis. Psychotherapy 55, 4 (2018), 399.
  24. ParsBERT: Transformer-based Model for Persian Language Understanding. Neural Processing Letters 53, 6 (oct 2021), 3831–3847. https://doi.org/10.1007/s11063-021-10528-4
  25. Faiza Farhat. 2023. ChatGPT as a complementary mental health resource: a boon or a bane. Annals of Biomedical Engineering (2023), 1–4.
  26. Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial. JMIR mental health 4, 2 (2017), e7785.
  27. Effectiveness of digital psychological interventions for mental health problems in low-income and middle-income countries: a systematic review and meta-analysis. Lancet Psychiatry 7, 10 (2020), 851–864.
  28. Asbjørn Følstad and Petter Brandtzaeg. 2020. Users’ experiences with chatbots: findings from a questionnaire study. Quality and User Experience 5, 3 (2020), 1–14.
  29. Acceptance and Expectations of Medical Experts, Students, and Patients Toward Electronic Mental Health Apps: Cross-Sectional Quantitative and Qualitative Survey Study. JMIR Mental Health 6, 11 (11 2019).
  30. Low-Resource Adaptation of Open-Domain Generative Chatbots. In Proceedings of the Second DialDoc Workshop on Document-grounded Dialogue and Conversational Question Answering. Association for Computational Linguistics, Dublin, Ireland, 23–30. https://doi.org/10.18653/v1/2022.dialdoc-1.3
  31. Usability evaluation of an immersive virtual reality platform for self-attachment psychotherapy. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM.
  32. UK GOV. 2024-01-15. Feasibility study. https://www.gov.uk/guidance/feasibility-study
  33. Christine Grové. 2021. Co-developing a mental health and wellbeing chatbot with and for young people. Frontiers in psychiatry 11 (2021), 606041.
  34. Stefan Harrer. 2023. Attention is not all you need: the complicated case of ethically using large language models in healthcare and medicine. eBioMedicine 90 (2023), 104512. https://doi.org/10.1016/j.ebiom.2023.104512
  35. Development of NLP-integrated intelligent web system for E-mental health. Computational and mathematical methods in medicine 2021 (2021).
  36. A mobile application for mental health care during covid-19 pandemic: Development and usability evaluation with system usability scale. In Computational Intelligence in Information Systems: Proceedings of the Computational Intelligence in Information Systems Conference (CIIS 2020). Springer, 33–42.
  37. Development and usability testing of a chatbot to promote mental health services use among individuals with eating disorders following screening. Int J Eat Disord 55, 9 (Sept. 2022), 1229–1244.
  38. Survey of Hallucination in Natural Language Generation. ACM Comput. Surv. 55, 12, Article 248 (mar 2023), 38 pages. https://doi.org/10.1145/3571730
  39. PersianQuAD: The Native Question Answering Dataset for the Persian Language. IEEE Access 10 (2022), 26045–26057. https://doi.org/10.1109/ACCESS.2022.3157289
  40. Chatbots to Support Young Adults’ Mental Health: An Exploratory Study of Acceptability. ACM Trans. Interact. Intell. Syst. 12, 2, Article 11 (jul 2022), 39 pages. https://doi.org/10.1145/3485874
  41. Debra A Dunstan Laura H Clark, Jennifer L Hudson and Gavin I Clark. 2018. Capturing the Attitudes of Adolescent Males’ Towards Computerised Mental Health Help-Seeking. Australian Psychologist 53, 5 (2018), 416–426. https://doi.org/10.1111/ap.12341
  42. A Multilingual Virtual Guide for Self-Attachment Technique. In 2022 IEEE 4th International Conference on Cognitive Machine Intelligence (CogMI). 107–116. https://doi.org/10.1109/CogMI56440.2022.00025
  43. Using AI chatbots to provide self-help depression interventions for university students: A randomized trial of effectiveness. Internet Interventions 27 (2022), 100495. https://doi.org/10.1016/j.invent.2022.100495
  44. Excess deaths associated with the Iranian COVID-19 epidemic: A province-level analysis. Int J Infect Dis 107 (2021), 101–115.
  45. Effectiveness of a multimodal digital psychotherapy platform for adult depression: a naturalistic feasibility study. JMIR mHealth and uHealth 7, 1 (2019), e10948.
  46. ParsVQA-Caps: A Benchmark for Visual Question Answering and Image Captioning in Persian. In WiNLP 2023 @EMNLP.
  47. Amir Moghanibashi-Mansourieh. 2020. Assessing the anxiety level of Iranian general population during COVID-19 outbreak. Asian Journal of Psychiatry 51 (2020), 102076. https://doi.org/10.1016/j.ajp.2020.102076
  48. OpenAI. 2022. ChatGPT: Optimizing Language Models for Dialogue. OpenAI Blog (2022). https://openai.com/blog/chatgpt/
  49. Neophytos Polydorou and Abbas Edalat. 2021a. An interactive VR platform with emotion recognition for self-attachment intervention. EAI Endorsed Transactions on Pervasive Health and Technology 7, 29 (9 2021). https://doi.org/10.4108/eai.14-9-2021.170951
  50. Neophytos Polydorou and Abbas Edalat. 2021b. An interactive VR platform with emotion recognition for self-attachment intervention. EAI Endorsed Transactions on Pervasive Health and Technology 7, 29 (2021).
  51. Towards Empathetic Open-domain Conversation Models: A New Benchmark and Dataset. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Florence, Italy, 5370–5381. https://doi.org/10.18653/v1/P19-1534
  52. Prevalence of Anxiety and Depression in the Iranian General Population during the COVID-19 Pandemic: A Web-Based Cross-Sectional Study. Iran J Psychiatry 17, 2 (2022), 230–239.
  53. The Iranian Corona Stress Study: Psychological Impacts of COVID-19 Pandemic in an Iranian Population. Int J Prev Med 13, 129 (Oct. 2022).
  54. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347 (2017).
  55. Ali Shahedi and Sanaz Seyedin. 2023. ChatParse: A New Application for Persian Bourse Chatbot. International Journal of Information & Communication Technology Research (2251-6107) 15, 2 (2023).
  56. The mental health impact of COVID-19 outbreak: a Nationwide Survey in Iran. Int J Ment Health Syst 15, 19 (2021).
  57. Mehrnoush Shamsfard. 2019. Challenges and Opportunities in Processing Low Resource Languages: A study on Persian. In International Conference Language Technologies for All (LT4All).
  58. Systematic review and meta-analysis of the effectiveness of chatbots on lifestyle behaviours. npj Digital Medicine 6, 118 (2023).
  59. Brian Spooner. 2012. 4. Persian, Farsi, Dari, Tajiki: language names and language policies. In Language policy and language conflict in Afghanistan and its neighbors. Brill, 89–117.
  60. Stephanie Strassel and Jennifer Tracey. 2016. LORELEI Language Packs: Data, Tools, and Resources for Technology Development in Low Resource Languages. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC’16). European Language Resources Association (ELRA), Portorož, Slovenia, 3273–3280. https://aclanthology.org/L16-1521
  61. MeDiaQA: A Question Answering Dataset on Medical Dialogues. ArXiv abs/2108.08074 (2021). https://api.semanticscholar.org/CorpusID:237194607
  62. Hooshvare Team. 2021. ParsGPT2, a Persian version of GPT2. https://github.com/hooshvare/parsgpt.
  63. Community based system dynamic as an approach for understanding and acting on messy problems: a case study for global mental health intervention in Afghanistan. Confl Health 10, 25 (2016).
  64. COVID-19 Excess Mortality Collaborators. Estimating excess mortality due to the COVID-19 pandemic: a systematic analysis of COVID-19-related mortality, 2020-21. Lancet 399, 10334 (March 2022), 1513–1536.
  65. Michael Weightman. 2020a. Digital psychotherapy as an effective and timely treatment option for depression and anxiety disorders: Implications for rural and remote practice. Journal of International Medical Research 48, 6 (2020).
  66. Michael Weightman. 2020b. Digital psychotherapy as an effective and timely treatment option for depression and anxiety disorders: Implications for rural and remote practice. Journal of International Medical Research 48, 6 (2020), 0300060520928686. https://doi.org/10.1177/0300060520928686
  67. Michael Weightman. 2020c. Digital psychotherapy as an effective and timely treatment option for depression and anxiety disorders: Implications for rural and remote practice. Journal of international medical research 48, 6 (2020), 0300060520928686.
  68. Gernot Windfuhr. 2009. The Iranian Languages. Psychology Press.
  69. World Health Organization. [n. d.]. COVID-19 pandemic triggers 25% increase in prevalence of anxiety and depression worldwide. https://www.who.int/news/item/02-03-2022-covid-19-pandemic-triggers-25-increase-in-prevalence-of-anxiety-and-depression-worldwide Accessed 8 Oct 2023.
  70. Mental Health Chatbot for Young Adults With Depressive Symptoms During the COVID-19 Pandemic: Single-Blind, Three-Arm Randomized Controlled Trial. J Med Internet Res 24, 11 (Nov. 2022).
  71. A Hybrid Retrieval-Generation Neural Conversation Model. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management (Beijing, China) (CIKM ’19). Association for Computing Machinery, New York, NY, USA, 1341–1350. https://doi.org/10.1145/3357384.3357881
  72. Emotion recognition in persian speech using deep neural networks. 2021 11th International Conference on Computer Engineering and Knowlege (ICCKE) (2021), 374–378.
  73. Potential Mobile Health Applications for Improving the Mental Health of the Elderly: A Systematic Review. Clin Interv Aging 18 (Sept. 2023), 1523–1534.
  74. Red teaming ChatGPT via Jailbreaking: Bias, Robustness, Reliability and Toxicity. arXiv preprint arXiv:2301.12867 (2023).
  75. Fine-tuning language models from human preferences. arXiv preprint arXiv:1909.08593 (2019).

Summary

We haven't generated a summary for this paper yet.

Whiteboard

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 2 tweets with 1 like about this paper.