Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
166 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

COMPASS: Computational Mapping of Patient-Therapist Alliance Strategies with Language Modeling (2402.14701v2)

Published 22 Feb 2024 in cs.CL, cs.AI, cs.HC, cs.LG, and q-bio.NC

Abstract: The therapeutic working alliance is a critical factor in predicting the success of psychotherapy treatment. Traditionally, working alliance assessment relies on questionnaires completed by both therapists and patients. In this paper, we present COMPASS, a novel framework to directly infer the therapeutic working alliance from the natural language used in psychotherapy sessions. Our approach utilizes advanced LLMs to analyze transcripts of psychotherapy sessions and compare them with distributed representations of statements in the working alliance inventory. Analyzing a dataset of over 950 sessions covering diverse psychiatric conditions including anxiety, depression, schizophrenia, and suicidal tendencies, we demonstrate the effectiveness of our method in providing fine-grained mapping of patient-therapist alignment trajectories and offering interpretability for clinical psychiatry and in identifying emerging patterns related to the condition being treated. By employing various deep learning-based topic modeling techniques in combination with prompting generative LLMs, we analyze the topical characteristics of different psychiatric conditions and their evolution at a turn-level resolution. This combined framework enhances the understanding of therapeutic interactions, enabling timely feedback for therapists regarding the quality of therapeutic relationships and providing interpretable insights to improve the effectiveness of psychotherapy.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (41)
  1. Edward S Bordin. The generalizability of the psychoanalytic concept of the working alliance. Psychotherapy: Theory, research & practice, 16(3):252, 1979.
  2. Bruce E Wampold. How important are the common factors in psychotherapy? an update. World Psychiatry, 14(3):270–277, 2015.
  3. Adam O Horvath. An exploratory study of the working alliance: Its measurement and relationship to therapy outcome. PhD thesis, University of British Columbia, 1981.
  4. From eliza to xiaoice: challenges and opportunities with social chatbots. Frontiers of Information Technology & Electronic Engineering, 19(1):10–26, 2018.
  5. M Tmáš ZEMČÍK. A brief history of chatbots. DEStech Transactions on Computer Science and Engineering, 10, 2019.
  6. Evidence-based practice of cognitive-behavioral therapy. Guilford publications, 2018.
  7. The relationship between interpersonal problems, therapeutic alliance, and outcomes following group and individual cognitive behaviour therapy. Journal of affective disorders, 157:25–32, 2014.
  8. Hazel Fernandes. Therapeutic alliance in cognitive behavioural therapy in child and adolescent mental health-current trends and future challenges. Frontiers in psychology, 12:610874, 2022.
  9. Natural language processing in psychiatry: the promises and perils of a transformative approach. The British Journal of Psychiatry, pages 1–3, 2022.
  10. Deep annotation of therapeutic working alliance in psychotherapy. In International Workshop on Health Intelligence. Springer, 2023.
  11. Working alliance transformer for psychotherapy dialogue classification. arXiv preprint arXiv:2210.15603, 2022.
  12. Neural topic modeling of psychotherapy sessions. In International Workshop on Health Intelligence. Springer, 2023.
  13. Baihan Lin. Voice2alliance: automatic speaker diarization and quality assurance of conversational alignment. In INTERSPEECH, 2022.
  14. Factor structure of the working alliance inventory. Psychological Assessment: A journal of consulting and clinical psychology, 1(3):207, 1989.
  15. Relation of the therapeutic alliance with outcome and other variables: a meta-analytic review. Journal of consulting and clinical psychology, 68(3):438, 2000.
  16. Alexander Street. counseling and psychotherapy transcripts series, 2023.
  17. Beyond lda: exploring supervised topic modeling for depression-related language in twitter. In Proceedings of the 2nd workshop on computational linguistics and clinical psychology: from linguistic signal to clinical reality, pages 99–107, 2015.
  18. Synonym, topic model and predicate-based query expansion for retrieving clinical documents. In AMIA Annual Symposium Proceedings, volume 2012, page 1050. American Medical Informatics Association, 2012.
  19. ndexing by latent semantic analysis. Journal of the American society for information science, 41(6):391–407, 1990.
  20. Distributed representations of sentences and documents. In International conference on machine learning, pages 1188–1196. PMLR, 2014.
  21. Sentence-bert: Sentence embeddings using siamese bert-networks. arXiv preprint arXiv:1908.10084, 2019.
  22. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805, 2018.
  23. The working alliance: Theory, research, and practice, volume 173. John Wiley & Sons, 1994.
  24. Attention is all you need. Advances in neural information processing systems, 30, 2017.
  25. Long short-term memory. Neural computation, 9(8):1735–1780, 1997.
  26. Neural variational inference for text processing. In International conference on machine learning, pages 1727–1736. PMLR, 2016.
  27. Topic modeling in embedding spaces. Transactions of the Association for Computational Linguistics, 8:439–453, 2020.
  28. Optimizing semantic coherence in topic models. In Proceedings of the 2011 conference on empirical methods in natural language processing, pages 262–272, 2011.
  29. Anomalies in language as a biomarker for schizophrenia. Current opinion in psychiatry, 33(3):212–218, 2020.
  30. Modeling dialogues with hashcode representations: A nonparametric approach. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 34, pages 3970–3979, 2020.
  31. Baihan Lin. Knowledge management system with nlp-assisted annotations: A brief survey and outlook. In CIKM Workshops, 2022.
  32. Stories from survivors: Privacy & security practices when coping with intimate partner abuse. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pages 2189–2201, 2017.
  33. Baihan Lin. Computational inference in cognitive science: Operational, societal and ethical considerations. arXiv preprint arXiv:2210.13526, 2022.
  34. Artificial intelligence for mental health and mental illnesses: an overview. Current psychiatry reports, 21(11):1–18, 2019.
  35. Machine learning, statistical learning and the future of biological research in psychiatry. Psychological medicine, 46(12):2455–2465, 2016.
  36. Can ai help reduce disparities in general medical and mental health care? AMA journal of ethics, 21(2):167–179, 2019.
  37. Sarah Carr. ‘ai gone mental’: engagement and ethics in data-driven technology for mental health, 2020.
  38. Discovering discrete latent topics with neural variational inference. In International Conference on Machine Learning, pages 2410–2419. PMLR, 2017.
  39. Topic modeling with wasserstein autoencoders. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 6345–6381, 2019.
  40. Neural topic modeling with bidirectional adversarial training. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 340–350, 2020.
  41. Exploring the space of topic coherence measures. In Proceedings of the eighth ACM international conference on Web search and data mining, pages 399–408, 2015.
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now