Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
102 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

What Makes Digital Support Effective? How Therapeutic Skills Affect Clinical Well-Being (2312.10775v1)

Published 17 Dec 2023 in cs.HC

Abstract: Online mental health support communities have grown in recent years for providing accessible mental and emotional health support through volunteer counselors. Despite millions of people participating in chat support on these platforms, the clinical effectiveness of these communities on mental health symptoms remains unknown. Furthermore, although volunteers receive some training based on established therapeutic skills studied in face-to-face environments such as active listening and motivational interviewing, it remains understudied how the usage of these skills in this online context affects people's mental health status. In our work, we collaborate with one of the largest online peer support platforms and use both natural language processing and machine learning techniques to measure how one-on-one support chats affect depression and anxiety symptoms. We measure how the techniques and characteristics of support providers, such as using affirmation, empathy, and past experience on the platform, affect support-seekers' mental health changes. We find that online peer support chats improve both depression and anxiety symptoms with a statistically significant but relatively small effect size. Additionally, support providers' techniques such as emphasizing the autonomy of the client lead to better mental health outcomes. However, we also found that some behaviors (e.g. persuading) are actually harmful to depression and anxiety outcomes. Our work provides key understanding for mental health care in the online setting and designing training systems for online support providers.

View on arXiv
Definition Search Book Streamline Icon: https://streamlinehq.com
References (107)
  1. Steven J Ackerman and Mark J Hilsenroth. 2003. A review of therapist characteristics and techniques positively impacting the therapeutic alliance. Clin. Psychol. Rev. 23, 1 (Feb. 2003), 1–33.
  2. Large-scale Analysis of Counseling Conversations: An Application of Natural Language Processing to Mental Health. Trans Assoc Comput Linguist 4 (2016), 463–476.
  3. Timothy R Apodaca and Richard Longabaugh. 2009. Mechanisms of change in motivational interviewing: a review and preliminary evaluation of the evidence. Addiction 104, 5 (2009), 705–715.
  4. Validation of PHQ-2 and PHQ-9 to screen for major depression in the primary care population. Ann. Fam. Med. 8, 4 (2010), 348–353.
  5. Peter C Austin. 2011a. An introduction to propensity score methods for reducing the effects of confounding in observational studies. Multivariate behavioral research 46, 3 (2011), 399–424.
  6. Peter C Austin. 2011b. Optimal caliper widths for propensity-score matching when estimating differences in means and differences in proportions in observational studies. Pharmaceutical statistics 10, 2 (2011), 150–161.
  7. Kurt D Baker and Mike Ray. 2011. Online counseling: The good, the bad, and the possibilities. Couns. Psychol. Q. 24, 4 (Dec. 2011), 341–346.
  8. Current theoretical models of generalized anxiety disorder (GAD): conceptual review and treatment implications. J. Anxiety Disord. 23, 8 (Dec. 2009), 1011–1023.
  9. Seeking support on facebook: a content analysis of breast cancer groups. J. Med. Internet Res. 13, 1 (Feb. 2011), e16.
  10. James F Boswell and Louis G Castonguay. 2007. Psychotherapy training: Suggestions for core ingredients and future research. Psychotherapy 44, 4 (Dec. 2007), 378–383.
  11. Acceptability and feasibility of using digital technology to train community practitioners to deliver a family-based intervention for adolescents with drug use disorders during the COVID-19 pandemic. Addict Behav Rep 14 (Dec. 2021), 100357.
  12. Who is the” human” in human-centered machine learning: The case of predicting mental health from social media. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1–32.
  13. Stevie Chancellor and Munmun De Choudhury. 2020. Methods in predictive techniques for mental health status on social media: a critical review. NPJ digital medicine 3, 1 (2020), 43.
  14. Yixin Chen and Yang Xu. 2021. Exploring the Effect of Social Support and Empathy on User Engagement in Online Mental Health Communities. Int. J. Environ. Res. Public Health 18, 13 (June 2021).
  15. Understanding Client Support Strategies to Improve Clinical Outcomes in an Online Mental Health Intervention. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–16.
  16. Jacob Cohen. 2013. Statistical power analysis for the behavioral sciences. Academic press.
  17. Are All Successful Communities Alike? Characterizing and Predicting the Success of Online Communities. In The World Wide Web Conference (San Francisco, CA, USA) (WWW ’19). Association for Computing Machinery, New York, NY, USA, 318–328.
  18. How Does Therapy Harm? A Model of Adverse Process Using Task Analysis in the Meta-Synthesis of Service Users’ Experience. Front. Psychol. 10 (March 2019), 347.
  19. Short-term mood repair through art-making: Positive emotion is more effective than venting. Motiv. Emot. 32, 4 (Dec. 2008), 288–295.
  20. Mental Health. Our World in Data (Aug. 2021).
  21. Munmun De Choudhury and Sushovan De. 2014. Mental Health Discourse on reddit: Self-Disclosure, Social Support, and Anonymity. ICWSM 8, 1 (May 2014), 71–80.
  22. Munmun De Choudhury and Emre Kıcıman. 2017. The Language of Social Support in Social Media and its Effect on Suicidal Ideation Risk. Proc Int AAAI Conf Weblogs Soc Media 2017 (May 2017), 32–41.
  23. Prevalence, severity, and unmet need for treatment of mental disorders in the World Health Organization World Mental Health Surveys. JAMA 291, 21 (June 2004), 2581–2590.
  24. Engagement with online mental health interventions: an exploratory clinical study of a treatment for depression. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI ’12). Association for Computing Machinery, New York, NY, USA, 1421–1430.
  25. Mitchell Dowling and Debra Rickwood. 2013. Online Counseling and Therapy for Mental Health Problems: A Systematic Review of Individual Synchronous Interventions Using Chat. J. Technol. Hum. Serv. 31, 1 (Jan. 2013), 1–21.
  26. The impacts of problem gambling on concerned significant others accessing web-based counselling. Addictive behaviors 39, 8 (2014), 1253–1257.
  27. Russell K Elleven and Jeff Allen. 2004. Applying technology to online counseling: Suggestions for the beginning e-therapist. Journal of Instructional Psychology 31 (2004), 223–226.
  28. How Trust Is Formed in Online Health Communities: A Process Perspective. Communications of the Association for Information Systems 34, 1 (2014), 28.
  29. Anna Fang and Haiyi Zhu. 2022. Matching for Peer Support: Exploring Algorithmic Matching for Online Mental Health Communities. Proc. ACM Hum.-Comput. Interact. 6, CSCW2 (Nov. 2022), 1–37.
  30. Celia B Fisher and Matthew Oransky. 2008. Informed consent to psychotherapy: Protecting the dignity and respecting the autonomy of patients. Journal of clinical psychology 64, 5 (2008), 576–588.
  31. Ruben Fukkink. 2011. Peer counseling in an online chat service: a content analysis of social support. Cyberpsychol. Behav. Soc. Netw. 14, 4 (April 2011), 247–251.
  32. Ruben G Fukkink and Jo MA Hermanns. 2009. Children’s experiences with chat support and telephone support. Journal of Child Psychology and Psychiatry 50, 6 (2009), 759–766.
  33. Individual Peer Support: A Qualitative Study of Mechanisms of Its Effectiveness. Community Ment. Health J. 51, 4 (May 2015), 445–452.
  34. Using chat and text technologies to answer sexual and reproductive health questions: Planned Parenthood pilot study. Journal of Medical Internet Research 15, 9 (2013), e203.
  35. Crisis text-line interventions: Evaluation of texters’ perceptions of effectiveness. Suicide Life Threat. Behav. 52, 3 (June 2022), 583–595.
  36. Online social networking by patients with diabetes: a qualitative evaluation of communication with Facebook. J. Gen. Intern. Med. 26, 3 (March 2011), 287–292.
  37. Investigating Support Seeking from Peers for Pregnancy in Online Health Communities. Proc. ACM Hum.-Comput. Interact. 1, CSCW (Dec. 2017), 1–19.
  38. Social networking sites and our lives’. Pew Internet Research Centre. June 16 2011.
  39. Dilys Haner and Debra Pepler. 2016. “Live Chat” clients at kids help phone: Individual characteristics and problem topics. Journal of the Canadian Academy of Child and Adolescent Psychiatry 25, 3 (2016), 138.
  40. Clara E Hill. 2020. Helping skills: Facilitating exploration, insight, and action, 5th ed. 5 (2020), 485.
  41. Topic model for identifying suicidal ideation in Chinese microblog. https://aclanthology.org/Y15-1064.pdf. Accessed: 2023-5-15.
  42. Jina Huh. 2015. Clinical Questions in Online Health Communities: The Case of “See your doctor” Threads. CSCW Conf Comput Support Coop Work 2015 (2015), 1488–1499.
  43. Clayton Hutto and Eric Gilbert. 2014. Vader: A parsimonious rule-based model for sentiment analysis of social media text. In Proceedings of the international AAAI conference on web and social media, Vol. 8. 216–225.
  44. The role of empathy in therapy and the physician-patient relationship. Forsch. Komplementmed. 19, 5 (Oct. 2012), 252–257.
  45. I Kawachi and L F Berkman. 2001. Social ties and mental health. J. Urban Health 78, 3 (Sept. 2001), 458–467.
  46. Eileen Kennedy-Moore and Jeanne C Watson. 2001. How and When Does Emotional Expression Help? Rev. Gen. Psychol. 5, 3 (Sept. 2001), 187–212.
  47. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Arch. Gen. Psychiatry 62, 6 (June 2005), 593–602.
  48. Culture and social support. Am. Psychol. 63, 6 (Sept. 2008), 518–526.
  49. The PHQ-9: validity of a brief depression severity measure. J. Gen. Intern. Med. 16, 9 (Sept. 2001), 606–613.
  50. Kroenke Kurt and Spitzer Robert L. 2002. The PHQ-9: A New Depression Diagnostic and Severity Measure. Psychiatr. Ann. 32, 9 (Sept. 2002), 509–515.
  51. Taisa Kushner and Amit Sharma. 2020. Bursts of Activity: Temporal Patterns of Help-Seeking and Support in Online Mental Health Forums. In Proceedings of The Web Conference 2020 (Taipei, Taiwan) (WWW ’20). Association for Computing Machinery, New York, NY, USA, 2906–2912.
  52. Translating knowledge into practice: using simulation to enhance mental health competence through social work education. Soc. Work Educ. 39, 3 (April 2020), 329–349.
  53. The influence of technology delivery mode on intervention outcomes: Analysis of a theory-based sexual health program. Journal of Medical Internet Research 20, 8 (2018), e10398.
  54. Detecting and monitoring depression with a two-item questionnaire (PHQ-2). J. Psychosom. Res. 58, 2 (Feb. 2005), 163–171.
  55. Measuring depression outcome with a brief self-report instrument: sensitivity to change of the Patient Health Questionnaire (PHQ-9). J. Affect. Disord. 81, 1 (July 2004), 61–66.
  56. Responsiveness of the PHQ-9 to Psychopharmacological Depression Treatment. Psychosomatics 47, 1 (2006), 62–67.
  57. A Meta-Analysis of Motivational Interviewing: Twenty-Five Years of Empirical Studies. Res. Soc. Work Pract. 20, 2 (March 2010), 137–160.
  58. A meta-analysis of motivational interviewing process: Technical, relational, and conditional process models of change. Journal of consulting and clinical psychology 86, 2 (2018), 140.
  59. The technical hypothesis of motivational interviewing: a meta-analysis of MI’s key causal model. J. Consult. Clin. Psychol. 82, 6 (Dec. 2014), 973–983.
  60. The technical hypothesis of motivational interviewing: A meta-analysis of MI’s key causal model. Journal of consulting and clinical psychology 82, 6 (2014), 973.
  61. Gabriela Marcu and Jina Huh-Yoo. 2023. Attachment-Informed Design: Digital Interventions That Build Self-Worth, Relationships, and Community in Support of Mental Health. (2023).
  62. Life transitions and online health communities: reflecting on adoption, use, and disengagement. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing (Baltimore, Maryland, USA) (CSCW ’14). Association for Computing Machinery, New York, NY, USA, 1491–1501.
  63. Work-integrated learning and the importance of peer support and sense of belonging. Education + Training 60, 1 (Jan. 2017), 39–53.
  64. William R Miller and Stephen Rollnick. 2012. Motivational Interviewing: Helping People Change. Guilford Press.
  65. Barriers to mental health treatment: results from the National Comorbidity Survey Replication. Psychol. Med. 41, 8 (Aug. 2011), 1751–1761.
  66. The Motivational Interviewing Treatment Integrity Code (MITI 4): Rationale, Preliminary Reliability and Validity. J. Subst. Abuse Treat. 65 (June 2016), 36–42.
  67. National survey of psychotherapy training in psychiatry, psychology, and social work. Arch. Gen. Psychiatry (2006).
  68. John C Norcross and Michael J Lambert. 2018. Psychotherapy relationships that work III. Psychotherapy 55, 4 (Dec. 2018), 303–315.
  69. John C Norcross and Michael J Lambert. 2019. Psychotherapy Relationships that Work: Volume 1: Evidence-Based Therapist Contributions. Oxford University Press.
  70. John C Norcross and Bruce E Wampold. 2011. Evidence-based therapy relationships: research conclusions and clinical practices. Psychotherapy 48, 1 (March 2011), 98–102.
  71. The Assessment of Active Listening Skills in Helpline Volunteers. Stress, Trauma, and Crisis 7, 1 (Jan. 2004), 61–76.
  72. James W Pennebaker. 2012. Opening Up: The Healing Power of Expressing Emotions. Guilford Press.
  73. Predicting Counselor Behaviors in Motivational Interviewing Encounters. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers. Association for Computational Linguistics, Valencia, Spain, 1128–1137.
  74. What Makes a Good Counselor? Learning to Distinguish between High-quality and Low-quality Counseling Conversations. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Florence, Italy, 926–935.
  75. Efficacy of peer support interventions for depression: a meta-analysis. Gen. Hosp. Psychiatry 33, 1 (2011), 29–36.
  76. Screening for anxiety disorders with the GAD-7 and GAD-2: a systematic review and diagnostic metaanalysis. Gen. Hosp. Psychiatry 39 (March 2016), 24–31.
  77. Offline Digital Education for Postregistration Health Professions: Systematic Review and Meta-Analysis by the Digital Health Education Collaboration. J. Med. Internet Res. 21, 4 (April 2019), e12968.
  78. Online peer to peer support: Qualitative analysis of UK and US open mental health Facebook groups. Digit Health 6 (Dec. 2020), 2055207620979209.
  79. Anoushka Rassau and Lucius Arco. 2003. Effects Of Chat-Based On-Line Cognitive Behavior Therapy On Study Related Behavior And Anxiety. Behav. Cogn. Psychother. 31, 3 (July 2003), 377–381.
  80. Derek Richards and Noemi Viganó. 2013. Online counseling: a narrative and critical review of the literature. J. Clin. Psychol. 69, 9 (Sept. 2013), 994–1011.
  81. Simone Rodda and Dan I Lubman. 2014. Characteristics of gamblers using a national online counselling service for problem gambling. Journal of Gambling Studies 30 (2014), 277–289.
  82. Individual peer support: A qualitative study of mechanisms of its effectiveness. mental health journal (2015).
  83. Validity of the GAD-7 scale as an outcome measure of disability in patients with generalized anxiety disorders in primary care. J. Affect. Disord. 128, 3 (Feb. 2011), 277–286.
  84. Koustuv Saha and Amit Sharma. 2020. Causal Factors of Effective Psychosocial Outcomes in Online Mental Health Communities. ICWSM 14 (May 2020), 590–601.
  85. Michael J Scheel. 2011. Client common factors represented by client motivation and autonomy. The Counseling Psychologist 39, 2 (2011), 276–285.
  86. Integrating human support into behavioral intervention technologies: The efficiency model of support. Clinical Psychology: Science and Practice 24, 1 (2017), 27.
  87. Modeling motivational interviewing strategies on an online peer-to-peer counseling platform. Proc. ACM Hum. Comput. Interact. 6, CSCW2 (Nov. 2022), 1–24.
  88. Human–AI collaboration enables more empathic conversations in text-based peer-to-peer mental health support. Nature Machine Intelligence 5, 1 (2023), 46–57.
  89. A Computational Approach to Understanding Empathy Expressed in Text-Based Mental Health Support. (Sept. 2020). arXiv:2009.08441 [cs.CL]
  90. Eva Sharma and Munmun De Choudhury. 2018. Mental Health Support and its Relationship to Linguistic Accommodation in Online Communities. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18, Paper 641). Association for Computing Machinery, New York, NY, USA, 1–13.
  91. Cecilia H Solano. 1986. People Without Friends: Loneliness and Its Alternatives. In Friendship and Social Interaction, Valerian J Derlega and Barbara A Winstead (Eds.). Springer New York, New York, NY, 227–246.
  92. Influence of Therapist and Client Behaviors on Therapy Alliance. Contemp. Fam. Ther. 27, 1 (March 2005), 19–35.
  93. Social support: Conceptualization, measurement, and implications for mental health. Res. Community Ment. Health 3 (1983), 67–111.
  94. Shall I call, text, post it online or just tell it face-to-face? How and why Flemish adolescents choose to share their emotions on- or offline. Journal of Children and Media 12, 1 (Jan. 2018), 81–97.
  95. Support matching and satisfaction in an online breast cancer support community. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 1625–1634.
  96. Derick T Wade and Peter W Halligan. 2017. The biopsychosocial model of illness: a model whose time has come. , 995–1004 pages.
  97. Bruce E Wampold and Christoph Flückiger. 2023. The alliance in mental health care: conceptualization, evidence and clinical applications. World Psychiatry 22, 1 (Feb. 2023), 25–41.
  98. Tracking Depression Dynamics in College Students Using Mobile Phone and Wearable Sensing. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 1 (March 2018), 1–26.
  99. Metrics for Peer Counseling: Triangulating Success Outcomes for Online Therapy Platforms. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23, Article 483). Association for Computing Machinery, New York, NY, USA, 1–17.
  100. To stay or leave? the relationship of emotional and informational support to commitment in online health support groups. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work (Seattle, Washington, USA) (CSCW ’12). Association for Computing Machinery, New York, NY, USA, 833–842.
  101. Barry Wellman and University of Toronto. Centre for Urban and Community Studies. 2001. Does the Internet Increase, Decrease, Or Supplement Social Capital? : Social Networks, Participation, and Community Commitment. Centre for Urban and Community Studies, University of Toronto.
  102. Raymond Witte and G Susan Mosley-Howard. 2014. Mental Health Practice in Today’s Schools: Issues and Interventions. Springer Publishing Company.
  103. Jeffrey M Wooldridge. 2015. Introductory Econometrics: A Modern Approach. Cengage Learning.
  104. Commitment of Newcomers and Old-timers to Online Health Support Communities. Proc SIGCHI Conf Hum Factor Comput Syst 2017 (May 2017), 6363–6375.
  105. Learning to become a volunteer counselor: Lessons from a peer-to-peer mental health community. Proc. ACM Hum. Comput. Interact. 6, CSCW2 (Nov. 2022), 1–24.
  106. Justine Zhang and Cristian Danescu-Niculescu-Mizil. 2020. Balancing Objectives in Counseling Conversations: Advancing Forwards or Looking Backwards. (May 2020). arXiv:2005.04245 [cs.CL]
  107. Finding Your Voice: The Linguistic Development of Mental Health Counselors. (June 2019). arXiv:1906.07194 [cs.CL]
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (7)
  1. Anna Fang (5 papers)
  2. Wenjie Yang (24 papers)
  3. Raj Sanjay Shah (18 papers)
  4. Yash Mathur (7 papers)
  5. Diyi Yang (151 papers)
  6. Haiyi Zhu (46 papers)
  7. Robert Kraut (6 papers)
Citations (4)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now