Understanding Client Reactions in Online Mental Health Counseling (2306.15334v1)
Abstract: Communication success relies heavily on reading participants' reactions. Such feedback is especially important for mental health counselors, who must carefully consider the client's progress and adjust their approach accordingly. However, previous NLP research on counseling has mainly focused on studying counselors' intervention strategies rather than their clients' reactions to the intervention. This work aims to fill this gap by developing a theoretically grounded annotation framework that encompasses counselors' strategies and client reaction behaviors. The framework has been tested against a large-scale, high-quality text-based counseling dataset we collected over the past two years from an online welfare counseling platform. Our study shows how clients react to counselors' strategies, how such reactions affect the final counseling outcomes, and how counselors can adjust their strategies in response to these reactions. We also demonstrate that this study can help counselors automatically predict their clients' states.
- Large-scale analysis of counseling conversations: An application of natural language processing to mental health. Transactions of the Association for Computational Linguistics, 4:463–476.
- Depression detection by analyzing social media posts of user. In 2019 IEEE International Conference on Signal Processing, Information, Communication & Systems (SPICSCON), pages 13–17.
- Evrinomy Avdi and Eugenie Georgaca. 2007. Discourse analysis and psychotherapy: A critical review. European Journal of Psychotherapy and Counselling, 9(2):157–176.
- Observing dialogue in therapy: Categorizing and forecasting behavioral codes. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 5599–5611, Florence, Italy. Association for Computational Linguistics.
- Observation of client resistance. Behavior Therapy, 15(2):144–155.
- The working alliance: A flagship for the “scientist-practitioner” model in psychotherapy. Counseling based on process research: Applying what we know, pages 81–131.
- Revisiting pre-trained models for Chinese natural language processing. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings, pages 657–668, Online. Association for Computational Linguistics.
- A computational approach to politeness with application to social factors. CoRR, abs/1306.6078.
- Robyn Dawes. 2009. House of cards. Simon and Schuster.
- Working alliance predicts psychotherapy outcome even while controlling for prior symptom improvement. Psychotherapy Research, 24(2):146–159.
- Joseph L Fleiss. 1971. Measuring nominal scale agreement among many raters. Psychological bulletin, 76(5):378.
- A deep learning approach to modeling empathy in addiction counseling. Commitment, 111:21.
- Machine learning and natural language processing in psychotherapy research: Alliance as example use case. Journal of counseling psychology, 67(4):438.
- Do psychotherapists improve with time and experience? a longitudinal analysis of outcomes in a clinical setting. Journal of counseling psychology, 63(1):1.
- Don’t stop pretraining: Adapt language models to domains and tasks. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 8342–8360, Online. Association for Computational Linguistics.
- On the state of social media data for mental health research. ArXiv, abs/2011.05233.
- Robert Hatcher. 1999. Therapists’ views of treatment alliance and collaboration in therapy. Psychotherapy Research, 9(4):405–423.
- Client behavior in counseling and therapy sessions: Development of a pantheoretical measure. Journal of Counseling Psychology.
- Clara E Hill. 2009. Helping skills: Facilitating, exploration, insight, and action. American Psychological Association.
- Is training effective? a study of counseling psychology doctoral trainees in a psychodynamic/interpersonal training clinic. Journal of Counseling Psychology, 62(2):184.
- Clara E Hill and Emilie Y Nakayama. 2000. Client-centered therapy: Where has it been and where is it going? a comment on hathaway (1948). Journal of Clinical Psychology, 56(7):861–875.
- A guide to conducting consensual qualitative research. The counseling psychologist, 25(4):517–572.
- Adam O Horvath and Leslie S Greenberg. 1994. The working alliance: Theory, research, and practice, volume 173. John Wiley & Sons.
- Dirk Hovy and Diyi Yang. 2021. The importance of modeling social factors of language: Theory and practice. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2021, Online, June 6-11, 2021, pages 588–602. Association for Computational Linguistics.
- Challenges in building intelligent open-domain dialog systems. ACM Transactions on Information Systems (TOIS), 38(3):1–32.
- Identifying therapist conversational actions across diverse psychotherapeutic approaches. In Proceedings of the Sixth Workshop on Computational Linguistics and Clinical Psychology, pages 12–23, Minneapolis, Minnesota. Association for Computational Linguistics.
- Joseph Lee Rodgers and W Alan Nicewander. 1988. Thirteen ways to look at the correlation coefficient. The American Statistician, 42(1):59–66.
- Mikael Leiman and William B. Stiles. 2001. Dialogical sequence analysis and the zone of proximal development as conceptual enhancements to the assimilation model: The case of jan revisited. Psychotherapy Research, 11(3):311–330.
- Towards automated real-time evaluation in text-based counseling.
- Towards emotional support dialog systems. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 3469–3483, Online. Association for Computational Linguistics.
- Niklas Luhmann. 1981. The improbability of communication. International Social Science Journal, 33(1):122–132.
- Which helper behaviors and intervention styles are related to better short-term outcomes in telephone crisis intervention? results from a silent monitoring study of calls to the us 1–800-suicide network. Suicide and Life-Threatening Behavior, 37(3):308–321.
- John C Norcross. 2010. The therapeutic relationship. The heart and soul of change: Delivering what works in therapy, pages 113–141.
- Conversation model fine-tuning for classifying client utterances in counseling dialogues. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pages 1448–1459, Minneapolis, Minnesota. Association for Computational Linguistics.
- Conversation model fine-tuning for classifying client utterances in counseling dialogues.
- Automatic differentiation in PyTorch. In 31st Conference on Neural Information Processing Systems (NIPS).
- Jiaxin Pei and David Jurgens. 2020. Quantifying intimacy in language. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, EMNLP 2020, Online, November 16-20, 2020, pages 5307–5326. Association for Computational Linguistics.
- Predicting counselor behaviors in motivational interviewing encounters. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers, pages 1128–1137, Valencia, Spain. Association for Computational Linguistics.
- What makes a good counselor? learning to distinguish between high-quality and low-quality counseling conversations. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 926–935.
- How collaboration in therapy becomes therapeutic: The therapeutic collaboration coding system. Psychology and Psychotherapy: Theory, Research and Practice, 86(3):294–314.
- Carl R Rogers. 1957. The necessary and sufficient conditions of therapeutic personality change. Journal of consulting psychology, 21(2):95.
- James Shanteau. 1992. Competence in experts: The role of task characteristics. Organizational behavior and human decision processes, 53(2):252–266.
- Towards facilitating empathic conversations in online mental health support: A reinforcement learning approach. In WWW ’21: The Web Conference 2021, Virtual Event / Ljubljana, Slovenia, April 19-23, 2021, pages 194–205. ACM / IW3C2.
- A computational approach to understanding empathy expressed in text-based mental health support. arXiv preprint arXiv:2009.08441.
- Psyqa: A chinese dataset for generating long counseling text for mental health support. arXiv preprint arXiv:2106.01702.
- Recursive neural networks for coding therapist and patient behavior in motivational interviewing. In Proceedings of the 2nd Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality, pages 71–79, Denver, Colorado. Association for Computational Linguistics.
- Jenny Thomas. 1983. Cross-cultural pragmatic failure. Applied linguistics, 4(2):91–112.
- Terence J Tracey and Anna M Kokotovic. 1989. Factor structure of the working alliance inventory. Psychological Assessment: A journal of consulting and clinical psychology, 1(3):207.
- Expertise in psychotherapy: An elusive goal? American Psychologist, 69(3):218.
- Persuasion for good: Towards a personalized persuasive dialogue system for social good. arXiv preprint arXiv:1906.06725.
- Towards low-resource real-time assessment of empathy in counselling. In Proceedings of the Seventh Workshop on Computational Linguistics and Clinical Psychology: Improving Access, pages 204–216, Online. Association for Computational Linguistics.
- Inferring social media users’ mental health status from multimodal information. In International Conference on Language Resources and Evaluation.
- Justine Zhang and Cristian Danescu-Niculescu-Mizil. 2020. Balancing objectives in counseling conversations: Advancing forwards or looking backwards. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 5276–5289, Online. Association for Computational Linguistics.
- Finding your voice: The linguistic development of mental health counselors. arXiv preprint arXiv:1906.07194.
- Emotional chatting machine: Emotional conversation generation with internal and external memory. In Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence and Thirtieth Innovative Applications of Artificial Intelligence Conference and Eighth AAAI Symposium on Educational Advances in Artificial Intelligence, AAAI’18/IAAI’18/EAAI’18. AAAI Press.
- Anqi Li (70 papers)
- Lizhi Ma (8 papers)
- Yaling Mei (1 paper)
- Hongliang He (20 papers)
- Shuai Zhang (319 papers)
- Huachuan Qiu (12 papers)
- Zhenzhong Lan (56 papers)