Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
119 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Knowledge-enhanced Memory Model for Emotional Support Conversation (2310.07700v1)

Published 11 Oct 2023 in cs.CL

Abstract: The prevalence of mental disorders has become a significant issue, leading to the increased focus on Emotional Support Conversation as an effective supplement for mental health support. Existing methods have achieved compelling results, however, they still face three challenges: 1) variability of emotions, 2) practicality of the response, and 3) intricate strategy modeling. To address these challenges, we propose a novel knowledge-enhanced Memory mODEl for emotional suppoRt coNversation (MODERN). Specifically, we first devise a knowledge-enriched dialogue context encoding to perceive the dynamic emotion change of different periods of the conversation for coherent user state modeling and select context-related concepts from ConceptNet for practical response generation. Thereafter, we implement a novel memory-enhanced strategy modeling module to model the semantic patterns behind the strategy categories. Extensive experiments on a widely used large-scale dataset verify the superiority of our model over cutting-edge baselines.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (43)
  1. Ching-Wen Chang and Fang-pei Chen. 2021. Relationships of family emotional support and negative family interactions with the quality of life among chinese people with mental illness and the mediating effect of internalized stigma. Psychiatric Quarterly, 92(1):375–387.
  2. Emphi: Generating empathetic responses with human-like intents. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 1063–1074. ACL.
  3. Improving multi-turn emotional support dialogue generation with lookahead strategy planning. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, pages 3014–3026. ACL.
  4. Dynamic tracking of state anxiety via multi-modal data and machine learning. Frontiers in psychiatry, 13.
  5. Emotional support received moderates academic stress and mental well-being in a sample of afghan university students amid covid-19. International Journal of Social Psychiatry, 68(8):1748–1755.
  6. J.O. Greene and B.R. Burleson. 2003. Handbook of Communication and Social Interaction Skills. American Psychological Association.
  7. Andrew C. High and Keli Ryan Steuber. 2014. An examination of support (in)adequacy: Types, sources, and consequences of social support among infertile women. Communication Monographs, 81.
  8. Clara E Hill. 2009. Helping skills: Facilitating, exploration, insight, and action. American Psychological Association.
  9. Stylized data-to-text generation: A case study in the e-commerce domain. ACM Trans. Inf. Syst.
  10. Emp-rft: Empathetic response generation via recognizing feature transitions between utterances. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 4118–4128. ACL.
  11. Alon Lavie and Abhaya Agarwal. 2007. METEOR: An automatic metric for MT evaluation with high levels of correlation with human judgments. In Proceedings of the Second Workshop on Statistical Machine Translation, pages 228–231, Prague, Czech Republic. Association for Computational Linguistics.
  12. BART: denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. In Proceedings of the Annual Meeting of the Association for Computational Linguistics, pages 7871–7880. ACL.
  13. Empdg: Multi-resolution interactive empathetic dialogue generation. In Proceedings of the International Conference on Computational Linguistics, pages 4454–4466. International Committee on Computational Linguistics.
  14. Knowledge bridging for empathetic dialogue generation. In The Conference on Artificial Intelligence, Conference on Innovative Applications of Artificial Intelligence, The Symposium on Educational Advances in Artificial Intelligence, pages 10993–11001. AAAI Press.
  15. Chin-Yew Lin. 2004. Rouge: A package for automatic evaluation of summaries. In Text summarization branches out, pages 74–81.
  16. Moel: Mixture of empathetic listeners. In Proceedings of the Conference on Empirical Methods in Natural Language Processing and the International Joint Conference on Natural Language Processing, pages 121–132. ACL.
  17. Bingjie Liu and S Shyam Sundar. 2018. Should machines express sympathy and empathy? experiments with a health advice chatbot. Cyberpsychology, Behavior, and Social Networking, 21(10):625–636.
  18. Towards emotional support dialog systems. In Proceedings of the Annual Meeting of the Association for Computational Linguistics and the International Joint Conference on Natural Language Processing, pages 3469–3483. ACL.
  19. Towards less generic responses in neural conversation models: A statistical re-weighting method. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 2769–2774, Brussels, Belgium. Association for Computational Linguistics.
  20. Empathetic dialogue generation with pre-trained roberta-gpt2 and external knowledge. In Conversational AI for Natural Human-Centric Interaction International Workshop on Spoken Dialogue System Technology, volume 943 of Lecture Notes in Electrical Engineering, pages 67–81. Springer.
  21. Ilya Loshchilov and Frank Hutter. 2017. Fixing weight decay regularization in adam. CoRR, abs/1711.05101.
  22. MIME: mimicking emotions for empathetic response generation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, pages 8968–8979. ACL.
  23. Saif M. Mohammad. 2018. Obtaining reliable human ratings of valence, arousal, and dominance for 20, 000 english words. In Proceedings of the Annual Meeting of the Association for Computational Linguistics, pages 174–184. ACL.
  24. Bleu: a method for automatic evaluation of machine translation. In Proceedings of the Annual Meeting of the Association for Computational Linguistics, pages 311–318. ACL.
  25. Greater professional empathy leads to higher agreement about decisions made in the consultation. Patient Education and Counseling, 96(2):144–150.
  26. Pytorch: An imperative style, high-performance deep learning library. In Advances in Neural Information Processing Systems: Annual Conference on Neural Information Processing Systems, pages 8024–8035.
  27. Control globally, understand locally: A global-to-local hierarchical graph network for emotional support conversation. In Proceedings of the International Joint Conference on Artificial Intelligence, pages 4324–4330. ijcai.org.
  28. FADO: feedback-aware double controlling network for emotional support conversation. Knowledge-Based Systems, 264:110340.
  29. Towards empathetic open-domain conversation models: A new benchmark and dataset. In Proceedings of the Conference of the Association for Computational Linguistics, pages 5370–5381. ACL.
  30. William J Reynolds and Brain Scott. 1999. Empathy: a crucial component of the helping relationship. Journal of psychiatric and mental health nursing, 6(5):363–370.
  31. Recipes for building an open-domain chatbot. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, pages 300–325, Online. Association for Computational Linguistics.
  32. Lei Shen and Yang Feng. 2020. CDL: curriculum dual learning for emotion-controllable response generation. In Proceedings of the Annual Meeting of the Association for Computational Linguistics, pages 556–566. ACL.
  33. Learning structured output representation using deep conditional generative models. In Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems, pages 3483–3491.
  34. Conceptnet 5.5: An open multilingual graph of general knowledge. In Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, pages 4444–4451. AAAI Press.
  35. MISC: A mixed strategy-aware model integrating COMET for emotional support conversation. In Proceedings of the Annual Meeting of the Association for Computational Linguistics, pages 308–319. ACL.
  36. Attention is all you need. In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems, pages 5998–6008.
  37. Cider: Consensus-based image description evaluation. In Conference on Computer Vision and Pattern Recognition, pages 4566–4575. IEEE.
  38. Why do neural dialog systems generate short and meaningless replies? a comparison between dialog and translation. In International Conference on Acoustics, Speech and Signal Processing, pages 7290–7294. IEEE.
  39. Huggingface’s transformers: State-of-the-art natural language processing. CoRR, abs/1910.03771.
  40. Poke: Prior knowledge enhanced emotional support conversation with latent variable. CoRR, abs/2210.12640.
  41. DIALOGPT : Large-scale generative pre-training for conversational response generation. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, pages 270–278, Online. Association for Computational Linguistics.
  42. CoMAE: A multi-factor hierarchical framework for empathetic response generation. In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pages 813–824, Online. Association for Computational Linguistics.
  43. Emotional chatting machine: Emotional conversation generation with internal and external memory. In Proceedings of the AAAI Conference on Artificial Intelligence, the innovative Applications of Artificial Intelligence, and the AAAI Symposium on Educational Advances in Artificial Intelligence, pages 730–739. AAAI Press.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (5)
  1. Mengzhao Jia (12 papers)
  2. Qianglong Chen (25 papers)
  3. Liqiang Jing (21 papers)
  4. Dawei Fu (5 papers)
  5. Renyu Li (3 papers)
Citations (3)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now