Papers
Topics
Authors
Recent
Search
2000 character limit reached

MindfulDiary: Harnessing Large Language Model to Support Psychiatric Patients' Journaling

Published 8 Oct 2023 in cs.HC, cs.AI, and cs.CL | (2310.05231v2)

Abstract: In the mental health domain, LLMs offer promising new opportunities, though their inherent complexity and low controllability have raised questions about their suitability in clinical settings. We present MindfulDiary, a mobile journaling app incorporating an LLM to help psychiatric patients document daily experiences through conversation. Designed in collaboration with mental health professionals (MHPs), MindfulDiary takes a state-based approach to safely comply with the experts' guidelines while carrying on free-form conversations. Through a four-week field study involving 28 patients with major depressive disorder and five psychiatrists, we found that MindfulDiary supported patients in consistently enriching their daily records and helped psychiatrists better empathize with their patients through an understanding of their thoughts and daily contexts. Drawing on these findings, we discuss the implications of leveraging LLMs in the mental health domain, bridging the technical feasibility and their integration into clinical settings.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (60)
  1. An overview of the features of chatbots in mental health: A scoping review. International Journal of Medical Informatics 132 (2019), 103978. https://doi.org/10.1016/j.ijmedinf.2019.103978
  2. An overview of the features of chatbots in mental health: A scoping review. International Journal of Medical Informatics 132 (2019), 103978.
  3. Perceptions and opinions of patients about mental health chatbots: scoping review. Journal of medical Internet research 23, 1 (2021), e17828.
  4. Use of patient-generated health data across healthcare settings: implications for health systems. JAMIA open 3, 1 (2020), 70–76.
  5. Building a role specified open-domain dialogue system leveraging large-scale language models. arXiv preprint arXiv:2205.00176 (2022).
  6. Andrew L Beam and Isaac S Kohane. 2016. Translating artificial intelligence into clinical care. Jama 316, 22 (2016), 2368–2369.
  7. Aaron T Beck. 1979. Cognitive therapy and the emotional disorders. Penguin.
  8. Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77–101.
  9. Language models are few-shot learners. Advances in neural information processing systems 33 (2020), 1877–1901.
  10. Natural language processing in mental health applications using non-clinical texts. Natural Language Engineering 23, 5 (2017), 649–685.
  11. Assessing the usability of a chatbot for mental health care. In Internet Science: INSCI 2018 International Workshops, St. Petersburg, Russia, October 24–26, 2018, Revised Selected Papers 5. Springer, 121–132.
  12. Integrating patient-generated health data into clinical care settings or clinical decision-making: lessons learned from project healthdesign. JMIR human factors 3, 2 (2016), e5919.
  13. Patient generated health data use in clinical practice: a systematic review. Nursing Outlook 67, 4 (2019), 311–330.
  14. What can natural language processing do for clinical decision support? Journal of biomedical informatics 42, 5 (2009), 760–772.
  15. Daniel A Donnelly and Edward J Murray. 1991. Cognitive and emotional changes in written essays and therapy interviews. Journal of Social and Clinical psychology 10, 3 (1991), 334–350.
  16. Chat with Bots Intelligently: A Critical Review & Analysis. 2019 International Conference on Advances in Computing, Communication and Control (ICAC3) 00 (2019), 1–6. https://doi.org/10.1109/icac347590.2019.9036844
  17. Faiza Farhat. 2023. ChatGPT as a complementary mental health resource: a boon or a bane. Annals of Biomedical Engineering (2023), 1–4.
  18. Patient-generated health data: dimensions, challenges, and open questions. Foundations and Trends® in Human–Computer Interaction 13, 3 (2020), 165–297.
  19. Delivering Cognitive Behavior Therapy to Young Adults With Symptoms of Depression and Anxiety Using a Fully Automated Conversational Agent (Woebot): A Randomized Controlled Trial. JMIR Mental Health 4, 2 (2017), e19. https://doi.org/10.2196/mental.7785
  20. Using psychological artificial intelligence (Tess) to relieve symptoms of depression and anxiety: randomized controlled trial. JMIR mental health 5, 4 (2018), e9782.
  21. Glen O. Gabbard and Holly Crisp-Han. 2017. The Early Career Psychiatrist and the Psychotherapeutic Identity. Academic Psychiatry 41, 1 (2017), 30–34. https://doi.org/10.1007/s40596-016-0627-7
  22. Sparks: Inspiration for Science Writing using Language Models. Designing Interactive Systems Conference (2022), 1002–1019. https://doi.org/10.1145/3532106.3533533
  23. Artificial Intelligence for Mental Health and Mental Illnesses: an Overview. Current Psychiatry Reports 21, 11 (2019), 116. https://doi.org/10.1007/s11920-019-1094-0
  24. An Empathy-Driven, Conversational Artificial Intelligence Agent (Wysa) for Digital Mental Well-Being: Real-World Data Evaluation Mixed-Methods Study. JMIR mHealth and uHealth 6, 11 (2018), e12106. https://doi.org/10.2196/12106
  25. Sidney H Kennedy. 2022. Core symptoms of major depressive disorder: relevance to diagnosis and treatment. Dialogues in clinical neuroscience (2022).
  26. Can a Machine Tend to Teenagers’ Emotional Needs? A Study with Conversational Agents. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI EA ’18). Association for Computing Machinery, New York, NY, USA, 1–6. https://doi.org/10.1145/3170427.3188548
  27. Diane M. Korngiebel and Sean D. Mooney. 2021. Considering the possibilities and pitfalls of Generative Pre-trained Transformer 3 (GPT-3) in healthcare delivery. npj Digital Medicine 4, 1 (2021), 93. https://doi.org/10.1038/s41746-021-00464-x
  28. The PHQ-9: validity of a brief depression severity measure. Journal of general internal medicine 16, 9 (2001), 606–613.
  29. The Levels of Emotional Awareness Scale: A cognitive-developmental measure of emotion. Journal of personality assessment 55, 1-2 (1990), 124–134.
  30. Minchul Lee. 2022. Kiwi, Korean Intelligent Word Identifier. https://doi.org/10.5281/zenodo.7041425
  31. Designing a Chatbot as a Mediator for Promoting Deep Self-Disclosure to a Real Mental Health Professional. Proc. ACM Hum.-Comput. Interact. 4, CSCW1, Article 31 (may 2020), 27 pages. https://doi.org/10.1145/3392836
  32. ”I Hear You, I Feel You”: Encouraging Deep Self-Disclosure through a Chatbot. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376175
  33. Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing. Comput. Surveys 55, 9 (2023), 1–35.
  34. How patient-generated health data and patient-reported outcomes affect patient–clinician relationships: A systematic review. Health Informatics Journal 26, 4 (2020), 2689–2706. https://doi.org/10.1177/1460458220928184
  35. TableChat: mobile food journaling to facilitate family support for healthy eating. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (2018), 1–28.
  36. A multimodal investigation of emotional responding in alexithymia. Cognition and emotion 18, 6 (2004), 741–766.
  37. Understanding the Benefits and Challenges of Using Large Language Model-based Conversational Agents for Mental Well-being Support. arXiv (2023). https://doi.org/10.48550/arxiv.2307.15810 arXiv:2307.15810
  38. Artificial intelligence in clinical decision support: challenges for evaluating AI and practical implications. Yearbook of medical informatics 28, 01 (2019), 128–134.
  39. Cognitive impairment in major depression. European journal of pharmacology 626, 1 (2010), 83–86.
  40. Impact of guidance on intervention adherence in computerised interventions for mental health problems: a meta-analysis. Psychological Medicine 52, 2 (2022), 229–240. https://doi.org/10.1017/S0033291721004621
  41. Understanding Mental Health Clinicians’ Perceptions and Concerns Regarding Using Passive Patient-Generated Health Data for Clinical Decision-Making: Qualitative Semistructured Interview Study. JMIR Formative Research 7, 1 (2023), e47380.
  42. Using patient-generated health data from mobile technologies for diabetes self-management support: provider perspectives from an academic medical center. Journal of diabetes science and technology 8, 1 (2014), 74–82.
  43. Ekkehard Othmer and Sieglinde C Othmer. 2002a. The clinical interview using DSM-IV-TR: Vol 1: Fundamentals. American Psychiatric Publishing, Inc.
  44. Ekkehard Othmer and Sieglinde C Othmer. 2002b. The clinical interview using DSM-IV-TR: Vol. 2: The difficult patient. American Psychiatric Publishing, Inc.
  45. “I wrote as if I were telling a story to someone I knew.”: Designing Chatbot Interactions for Expressive Writing in Mental Health. Designing Interactive Systems Conference 2021 (2021), 926–941. https://doi.org/10.1145/3461778.3462143
  46. James W Pennebaker and Janel D Seagal. 1999. Forming a story: The health benefits of narrative. Journal of clinical psychology 55, 10 (1999), 1243–1254.
  47. Language models are unsupervised multitask learners. OpenAI blog 1, 8 (2019), 9.
  48. Recipes for Building an Open-Domain Chatbot. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume. Association for Computational Linguistics, Online, 300–325. https://doi.org/10.18653/v1/2021.eacl-main.24
  49. Peter Salovey and John D Mayer. 1990. Emotional intelligence. Imagination, cognition and personality 9, 3 (1990), 185–211.
  50. Patient-generated health data. RTI International, April 813 (2012), 814.
  51. Deep learning in medical image analysis. Annual review of biomedical engineering 19 (2017), 221–248.
  52. How do you feel? Using natural language processing to automatically rate emotion in psychotherapy. Behavior Research Methods 53, 5 (2021), 2069–2082. https://doi.org/10.3758/s13428-020-01531-z
  53. Designing Human-Centered AI for Mental Health: Developing Clinically Relevant Applications for Online CBT Treatment. ACM Transactions on Computer-Human Interaction (2022). https://doi.org/10.1145/3564752
  54. Cheryl Travers. 2011. Unveiling a reflective diary methodology for exploring the lived experiences of stress and coping. Journal of Vocational Behavior 79, 1 (2011), 204–216. https://doi.org/10.1016/j.jvb.2010.11.007
  55. Philip M. Ullrich and Susan K. Lutgendorf. 2002. Journaling about stressful events: Effects of cognitive processing and emotional expression. Annals of Behavioral Medicine 24, 3 (2002), 244–250. https://doi.org/10.1207/s15324796abm2403_10
  56. Attention is all you need. Advances in neural information processing systems 30 (2017).
  57. An Evaluation of Generative Pre-Training Model-based Therapy Chatbot for Caregivers. arXiv (2021). https://doi.org/10.48550/arxiv.2107.13115 arXiv:2107.13115
  58. Clinician perspectives and design implications in using patient-generated health data to improve mental health practices: mixed methods study. JMIR formative research 4, 8 (2020), e18123.
  59. AI Chains: Transparent and Controllable Human-AI Interaction by Chaining Large Language Model Prompts. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 385, 22 pages. https://doi.org/10.1145/3491102.3517582
  60. Sharing patient-generated data in clinical practices: an interview study. In AMIA Annual Symposium Proceedings, Vol. 2016. American Medical Informatics Association, 1303.
Citations (20)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Summarize

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up

Tweets

Sign up for free to view the 2 tweets with 2 likes about this paper.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up for Free