2000 character limit reached
Training Models to Generate, Recognize, and Reframe Unhelpful Thoughts (2307.02768v1)
Published 6 Jul 2023 in cs.CL
Abstract: Many cognitive approaches to well-being, such as recognizing and reframing unhelpful thoughts, have received considerable empirical support over the past decades, yet still lack truly widespread adoption in self-help format. A barrier to that adoption is a lack of adequately specific and diverse dedicated practice material. This work examines whether current LLMs can be leveraged to both produce a virtually unlimited quantity of practice material illustrating standard unhelpful thought patterns matching specific given contexts, and generate suitable positive reframing proposals. We propose PATTERNREFRAME, a novel dataset of about 10k examples of thoughts containing unhelpful thought patterns conditioned on a given persona, accompanied by about 27k positive reframes. By using this dataset to train and/or evaluate current models, we show that existing models can already be powerful tools to help generate an abundance of tailored practice material and hypotheses, with no or minimal additional model training required.
- Aaron T. Beck. 1963. Thinking and Depression: I. Idiosyncratic Content and Cognitive Distortions. Archives of General Psychiatry.
- Aaron T. Beck. 1976. Cognitive therapy and the emotional disorders. international universities press.
- A review of human evaluation for style transfer. In Proceedings of the 1st Workshop on Natural Language Generation, Evaluation, and Metrics (GEM 2021). Association for Computational Linguistics.
- D.D. Burns. 1980. Feeling Good: The New Mood Therapy. A Signet book.
- Controlled neural sentence-level reframing of news articles. In Findings of the Association for Computational Linguistics: EMNLP 2021.
- CLPsych 2015 shared task: Depression and PTSD on Twitter. In Proceedings of the 2nd Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality.
- Plug and play language models: A simple approach to controlled text generation.
- Why cognitive behavioral therapy is the current gold standard of psychotherapy. Frontiers in Psychiatry.
- Hierarchical neural story generation. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).
- Assessing population-level symptoms of anxiety, depression, and suicide risk in real time using NLP applied to social media data. In Proceedings of the Fourth Workshop on Natural Language Processing and Computational Social Science.
- Paul Gilbert. 2010. An introduction to compassion focused therapy in cognitive behavior therapy. International Journal of Cognitive Therapy.
- Integrating positive psychology into counseling: Why and (when appropriate) how. Journal of Counseling & Development.
- Online cbt i: Bridging the gap between eliza and modern online cbt treatment packages. Behaviour Change, 26(4):245–253.
- The efficacy of cognitive behavioral therapy: A review of meta-analyses. Cognitive therapy and research.
- PAIR: Planning and iterative refinement in pre-trained transformers for long text generation. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP).
- MentalBERT: Publicly available pretrained language models for mental healthcare. In Proceedings of the Thirteenth Language Resources and Evaluation Conference.
- How can we know what language models know? Transactions of the Association for Computational Linguistics.
- Detection of mental health from Reddit via deep contextualized representations. In Proceedings of the 11th International Workshop on Health Text Mining and Information Analysis.
- Ctrl: A conditional transformer language model for controllable generation.
- Diederik P. Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. CoRR, abs/1412.6980.
- The power of scale for parameter-efficient prompt tuning. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing.
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.
- A diversity-promoting objective function for neural conversation models. In Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies.
- Xiang Lisa Li and Percy Liang. 2021. Prefix-tuning: Optimizing continuous prompts for generation. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers).
- Chin-Yew Lin. 2004. ROUGE: A package for automatic evaluation of summaries. In Text Summarization Branches Out. Association for Computational Linguistics.
- Data boost: Text data augmentation through reinforcement learning guided conditional generation. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP).
- Roberta: A robustly optimized bert pretraining approach.
- S. Lloyd. 1982. Least squares quantization in pcm. IEEE Transactions on Information Theory, 28(2):129–137.
- Controllable sentence simplification. In Proceedings of the Twelfth Language Resources and Evaluation Conference.
- Reducing conversational agents’ overconfidence through linguistic calibration. Transactions of the Association for Computational Linguistics, 10:857–872.
- Margot Mieskes and Andreas Stiegelmayr. 2018. Preparing data from psychotherapy for natural language processing. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018).
- ParlAI: A dialog research software platform. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 79–84. ACL.
- Quantifying the language of schizophrenia in social media. In Proceedings of the 2nd Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality.
- Demographic stability on mechanical turk despite covid-19. Trends in cognitive sciences, 24(9):678–680.
- Training language models to follow instructions with human feedback.
- Towards preemptive detection of depression and anxiety in Twitter. In Proceedings of the Fifth Social Media Mining for Health Applications Workshop & Shared Task.
- Bleu: A method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting on Association for Computational Linguistics.
- Rafał Poświata and Michał Perełkiewicz. 2022. OPI@LT-EDI-ACL2022: Detecting signs of depression from social media text using RoBERTa pre-trained language models. In Proceedings of the Second Workshop on Language Technology for Equality, Diversity and Inclusion.
- Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer. Journal of Machine Learning Research.
- Sudha Rao and Joel Tetreault. 2018. Dear sir or madam, may I introduce the GYAFC dataset: Corpus, benchmarks and metrics for formality style transfer. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers). Association for Computational Linguistics.
- D. Robertson. 2012. Build Your Resilience: CBT, mindfulness and stress management to survive and thrive in any situation. Teach Yourself.
- Deep learning for language understanding of mental health concepts derived from cognitive behavioural therapy. In Proceedings of the Ninth International Workshop on Health Text Mining and Information Analysis.
- Tailor: Generating and perturbing text with semantic controls. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 3194–3213.
- Predictive linguistic features of schizophrenia. In Proceedings of the 6th Joint Conference on Lexical and Computational Semantics (*SEM 2017).
- Timo Schick and Hinrich Schütze. 2021a. Exploiting cloze-questions for few-shot text classification and natural language inference. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume.
- Timo Schick and Hinrich Schütze. 2021b. Few-shot text generation with natural language instructions. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing.
- The concept and definition of low intensity cognitive behaviour therapy. Behaviour Research and Therapy, 138:103803.
- Sagarika Shreevastava and Peter Foltz. 2021. Detecting cognitive distortions from patient-therapist interactions. In Proceedings of the Seventh Workshop on Computational Linguistics and Clinical Psychology: Improving Access. Association for Computational Linguistics.
- Language models that seek for knowledge: Modular search & generation for dialogue and prompt completion.
- Chris Williams. 2001. Use of written cognitive behaviour therapy self-help materials to treat depression. Advances in Psychiatric Treatment, 7.
- Detecting linguistic traces of depression in topic-restricted text: Attending to self-stigmatized depression with NLP. In Proceedings of the First International Workshop on Language Cognition and Computational Models.
- MEGATRON-CNTRL: Controllable story generation with external knowledge using large-scale language models. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP).
- Personalizing dialogue agents: I have a dog, do you have pets too? In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics.
- Bertscore: Evaluating text generation with bert. In International Conference on Learning Representations.
- Fine-tuning language models from human preferences.
- Inducing positive perspectives with text reframing. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics.