Emotion Analysis in NLP: Trends, Gaps and Roadmap for Future Directions (2403.01222v2)
Abstract: Emotions are a central aspect of communication. Consequently, emotion analysis (EA) is a rapidly growing field in NLP. However, there is no consensus on scope, direction, or methods. In this paper, we conduct a thorough review of 154 relevant NLP publications from the last decade. Based on this review, we address four different questions: (1) How are EA tasks defined in NLP? (2) What are the most prominent emotion frameworks and which emotions are modeled? (3) Is the subjectivity of emotions considered in terms of demographics and cultural factors? and (4) What are the primary NLP applications for EA? We take stock of trends in EA and tasks, emotion frameworks used, existing datasets, methods, and applications. We then discuss four lacunae: (1) the absence of demographic and cultural aspects does not account for the variation in how emotions are perceived, but instead assumes they are universally experienced in the same manner; (2) the poor fit of emotion categories from the two main emotion theories to the task; (3) the lack of standardized EA terminology hinders gap identification, comparison, and future goals; and (4) the absence of interdisciplinary research isolates EA from insights in other fields. Our work will enable more focused research into EA and a more holistic approach to modeling emotions in NLP.
- Text-based emotion detection: Advances, challenges, and opportunities. Engineering Reports, 2(7):e12189.
- Hassan Alhuzali and Sophia Ananiadou. 2021. SpanEmo: Casting multi-label emotion classification as span-prediction. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, pages 1573–1584, Online. Association for Computational Linguistics.
- Uncovering values: Detecting latent moral content from natural language with explainable and non-trained methods. In Proceedings of Deep Learning Inside Out (DeeLIO 2022): The 3rd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures, pages 33–41, Dublin, Ireland and Online. Association for Computational Linguistics.
- Multimodal language analysis in the wild: CMU-MOSEI dataset and interpretable dynamic fusion graph. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 2236–2246, Melbourne, Australia. Association for Computational Linguistics.
- Proceedings of the 12th Workshop on Computational Approaches to Subjectivity, Sentiment & Social Media Analysis. Association for Computational Linguistics, Dublin, Ireland.
- Lisa Feldman Barrett. 2017. How emotions are made: The secret life of the brain. Pan Macmillan.
- We need to consider disagreement in evaluation. In Proceedings of the 1st Workshop on Benchmarking: Past, Present and Future, pages 15–21, Online. Association for Computational Linguistics.
- Emily M. Bender and Batya Friedman. 2018. Data statements for natural language processing: Toward mitigating system bias and enabling better science. Transactions of the Association for Computational Linguistics, 6:587–604.
- GoodNewsEveryone: A corpus of news headlines annotated with emotions, semantic roles, and reader perception. In Proceedings of the Twelfth Language Resources and Evaluation Conference, pages 1554–1566, Marseille, France. European Language Resources Association.
- Michael Brady. 2018. Emotion: The Basics. Routledge.
- A time series analysis of emotional loading in central bank statements. In Proceedings of the Second Workshop on Economics and Natural Language Processing, pages 16–21, Hong Kong. Association for Computational Linguistics.
- IEMOCAP: Interactive emotional dyadic motion capture database. Language resources and evaluation, 42:335–359.
- Sue Campbell. 1994. Being dismissed: The politics of emotional expression. Hypatia, 9(3):46–65.
- Lea Canales and Patricio Martínez-Barco. 2014. Emotion detection from text: A survey. In Proceedings of the Workshop on Natural Language Processing in the 5th Information Systems Research Working Days (JISIC), pages 37–43, Quito, Ecuador. Association for Computational Linguistics.
- SemEval-2019 task 3: EmoContext contextual emotion detection in text. In Proceedings of the 13th International Workshop on Semantic Evaluation, pages 39–48, Minneapolis, Minnesota, USA. Association for Computational Linguistics.
- All-in-one: A deep attentive multi-task learning framework for humour, sarcasm, offensive, motivation, and sentiment on memes. In Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing, pages 281–290, Suzhou, China. Association for Computational Linguistics.
- Sentiment and emotion help sarcasm? a multi-task learning framework for multi-modal sarcasm, sentiment and emotion analysis. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 4351–4360, Online. Association for Computational Linguistics.
- RED v2: Enhancing RED dataset for multi-label emotion detection. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 1392–1399, Marseille, France. European Language Resources Association.
- Emotion recognition based on psychological components in guided narratives for emotion regulation. In Proceedings of the 7th Joint SIGHUM Workshop on Computational Linguistics for Cultural Heritage, Social Sciences, Humanities and Literature, pages 72–81, Dubrovnik, Croatia. Association for Computational Linguistics.
- Alba Curry and Amanda Cercas Curry. 2022. Computer says" no": The case against empathetic conversational ai. arXiv preprint arXiv:2212.10983.
- Dealing with disagreements: Looking beyond the majority vote in subjective annotations. Transactions of the Association for Computational Linguistics, 10:92–110.
- Luna De Bruyne. 2023. The paradox of multilingual emotion detection. In Proceedings of the 13th Workshop on Computational Approaches to Subjectivity, Sentiment, & Social Media Analysis, pages 458–466, Toronto, Canada. Association for Computational Linguistics.
- Paul Ekman and Wallace V. Friesen. 1981. The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding, pages 57–106. De Gruyter Mouton, Berlin, Boston.
- Emotion detection: A technology review. In Proceedings of the XVIII International Conference on Human Computer Interaction, Interacción ’17, New York, NY, USA. Association for Computing Machinery.
- COSMIC: COmmonSense knowledge for eMotion identification in conversations. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 2470–2481, Online. Association for Computational Linguistics.
- COMMA-DEER: COmmon-sense aware multimodal multitask approach for detection of emotion and emotional reasoning in conversations. In Proceedings of the 29th International Conference on Computational Linguistics, pages 6978–6990, Gyeongju, Republic of Korea. International Committee on Computational Linguistics.
- Emotion detection in email customer care. In Proceedings of the NAACL HLT 2010 Workshop on Computational Approaches to Analysis and Generation of Emotion in Text, pages 10–16, Los Angeles, CA. Association for Computational Linguistics.
- PO-EMO: Conceptualization, annotation, and modeling of aesthetic emotions in German and English poetry. In Proceedings of the Twelfth Language Resources and Evaluation Conference, pages 1652–1663, Marseille, France. European Language Resources Association.
- ICON: Interactive conversational memory network for multimodal emotion detection. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 2594–2604, Brussels, Belgium. Association for Computational Linguistics.
- Appraisal theories for emotion classification in text. In Proceedings of the 28th International Conference on Computational Linguistics, pages 125–138, Barcelona, Spain (Online). International Committee on Computational Linguistics.
- DialogueCRN: Contextual reasoning networks for emotion recognition in conversations. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 7042–7052, Online. Association for Computational Linguistics.
- Tatsuya Ide and Daisuke Kawahara. 2022. Building a dialogue corpus annotated with expressed and experienced emotions. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop, pages 21–30, Dublin, Ireland. Association for Computational Linguistics.
- MuSE: a multimodal dataset of stressed emotion. In Proceedings of the Twelfth Language Resources and Evaluation Conference, pages 1499–1510, Marseille, France. European Language Resources Association.
- Bettina Judd. 2019. Sapphire as praxis: Toward a methodology of anger. Feminist Studies, 45(1):178–208.
- WRIME: A new dataset for emotional intensity estimation with subjective and objective annotations. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 2095–2104, Online. Association for Computational Linguistics.
- Hamed Khanpour and Cornelia Caragea. 2018. Fine-grained emotion detection in health-related online posts. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 1160–1166, Brussels, Belgium. Association for Computational Linguistics.
- Evgeny Kim and Roman Klinger. 2018a. A survey on sentiment and emotion analysis for computational literary studies. arXiv preprint arXiv:1808.03137.
- Evgeny Kim and Roman Klinger. 2018b. Who feels what and why? annotation of a literature corpus with semantic roles of emotions. In Proceedings of the 27th International Conference on Computational Linguistics, pages 1345–1359, Santa Fe, New Mexico, USA. Association for Computational Linguistics.
- IEST: WASSA-2018 implicit emotions shared task. In Proceedings of the 9th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, pages 31–42, Brussels, Belgium. Association for Computational Linguistics.
- A review on text-based emotion detection–techniques, applications, datasets, and future directions. arXiv preprint arXiv:2205.03235.
- A review on text-based emotion detection - techniques, applications, datasets, and future directions. ArXiv, abs/2205.03235.
- Universal joy a data set and results for classifying emotions across languages. In Proceedings of the Eleventh Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, pages 62–75, Online. Association for Computational Linguistics.
- Richard S Lazarus. 1991. Progress on a cognitive-motivational-relational theory of emotion. American psychologist, 46(8):819.
- Joosung Lee and Wooin Lee. 2022. CoMPM: Context modeling with speaker’s pre-trained memory tracking for emotion recognition in conversation. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 5669–5679, Seattle, United States. Association for Computational Linguistics.
- DailyDialog: A manually labelled multi-turn dialogue dataset. In Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 986–995, Taipei, Taiwan. Asian Federation of Natural Language Processing.
- DENS: A dataset for multi-class emotion analysis. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 6293–6298, Hong Kong, China. Association for Computational Linguistics.
- DialogueEIN: Emotion interaction network for dialogue affective analysis. In Proceedings of the 29th International Conference on Computational Linguistics, pages 684–693, Gyeongju, Republic of Korea. International Committee on Computational Linguistics.
- SwahBERT: Language model of Swahili. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 303–313, Seattle, United States. Association for Computational Linguistics.
- Swahbert: Language model of swahili. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 303–313.
- Sentiment and emotion based representations for fake reviews detection. In Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2019), pages 750–757, Varna, Bulgaria. INCOMA Ltd.
- SemEval-2018 task 1: Affect in tweets. In Proceedings of the 12th International Workshop on Semantic Evaluation, pages 1–17, New Orleans, Louisiana. Association for Computational Linguistics.
- Saif M. Mohammad. 2021. Chapter 11 - sentiment analysis: Automatically detecting valence, emotions, and other affectual states from text. In Herbert L. Meiselman, editor, Emotion Measurement (Second Edition), second edition edition, pages 323–379. Woodhead Publishing.
- Saif M. Mohammad. 2022. Ethics sheet for automatic emotion recognition and sentiment analysis. Computational Linguistics, 48(2):239–278.
- Are they different? affect, feeling, emotion, sentiment, and opinion detection in text. IEEE Transactions on Affective Computing, 5(2):101–111.
- Ashritha R Murthy and KM Anil Kumar. 2021. A review of different approaches for detecting emotion from text. In IOP Conference Series: Materials Science and Engineering, volume 1110, page 012009. IOP Publishing.
- The evolution of sentiment analysis—a review of research topics, venues, and top cited papers. Computer Science Review, 27:16–32.
- I miss you babe: Analyzing emotion dynamics during COVID-19 pandemic. In Proceedings of the Fourth Workshop on Natural Language Processing and Computational Social Science, pages 41–49, Online. Association for Computational Linguistics.
- StudEmo: A non-aggregated review dataset for personalized emotion recognition. In Proceedings of the 1st Workshop on Perspectivist Approaches to NLP @LREC2022, pages 46–55, Marseille, France. European Language Resources Association.
- Proceedings of the Third Workshop on Computational Modeling of People’s Opinions, Personality, and Emotion’s in Social Media. Association for Computational Linguistics, Barcelona, Spain (Online).
- Emily Öhman. 2020. Emotion annotation: Rethinking emotion categorization. In DHN post-proceedings, pages 134–144.
- The ecological fallacy in annotation: Modelling human label variation goes beyond sociodemographics.
- The cognitive structure of emotion. Contemporary Sociology, 18.
- Dimensional emotion detection from categorical emotion. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 4367–4380, Online and Punta Cana, Dominican Republic. Association for Computational Linguistics.
- Rosalind W Picard. 2000. Affective computing. MIT press.
- Barbara Plank. 2022. The “problem” of human label variation: On ground truth in data, modeling and evaluation. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 10671–10682, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
- Natural language inference prompts for zero-shot emotion classification in text across corpora. In Proceedings of the 29th International Conference on Computational Linguistics, pages 6805–6817, Gyeongju, Republic of Korea. International Committee on Computational Linguistics.
- EmoEvent: A multilingual emotion corpus based on different events. In Proceedings of the Twelfth Language Resources and Evaluation Conference, pages 1492–1498, Marseille, France. European Language Resources Association.
- Robert Plutchik. 1982. A psychoevolutionary theory of emotions. Social Science Information, 21(4-5):529–553.
- MELD: A multimodal multi-party dataset for emotion recognition in conversations. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 527–536, Florence, Italy. Association for Computational Linguistics.
- Ira J Roseman. 1991. Appraisal determinants of discrete emotions. Cognition & Emotion, 5(3):161–200.
- Two contrasting data annotation paradigms for subjective NLP tasks. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 175–190, Seattle, United States. Association for Computational Linguistics.
- James A Russell and Albert Mehrabian. 1977. Evidence for a three-factor theory of emotions. Journal of Research in Personality, 11(3):273–294.
- Emotion detection from text and speech: a survey. Soc. Netw. Anal. Min., 8(1):28:1–28:26.
- Findings of the shared task on emotion analysis in Tamil. In Proceedings of the Second Workshop on Speech and Language Technologies for Dravidian Languages, pages 279–285, Dublin, Ireland. Association for Computational Linguistics.
- Emotion recognition and detection methods: A comprehensive survey. Journal of Artificial Intelligence and Systems, 2(1):53–79.
- Andrea Scarantino and Ronald de Sousa. 2021. Emotion. In Edward N. Zalta, editor, The Stanford Encyclopedia of Philosophy, Summer 2021 edition. Metaphysics Research Lab, Stanford University.
- Klaus R. Scherer. 1999. Appraisal Theory, chapter 30. John Wiley & Sons, Ltd.
- A sentiment and emotion annotated dataset for bitcoin price forecasting based on Reddit posts. In Proceedings of the Fourth Workshop on Financial Technology and Natural Language Processing (FinNLP), pages 203–210, Abu Dhabi, United Arab Emirates (Hybrid). Association for Computational Linguistics.
- Unimodal approaches for emotion recognition: A systematic review. Cognitive Systems Research, 77:94–109.
- Craig A Smith and Phoebe C Ellsworth. 1985. Patterns of cognitive appraisal in emotion. Journal of personality and social psychology, 48(4):813.
- Identifying emotions in code mixed hindi-english tweets. In Proceedings of the WILDRE-6 Workshop within the 13th Language Resources and Evaluation Conference, pages 35–41.
- Emotion analysis and detection during COVID-19. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 6938–6947, Marseille, France. European Language Resources Association.
- APPReddit: a corpus of Reddit posts annotated for appraisal. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 3809–3818, Marseille, France. European Language Resources Association.
- Carlo Strapparava and Rada Mihalcea. 2008. Learning to identify emotions in text. In Proceedings of the 2008 ACM symposium on Applied computing, pages 1556–1560.
- Dimensional modeling of emotions in text with appraisal theories: Corpus creation, annotation reliability, and prediction. Computational Linguistics, 49(1):1–72.
- Crowdsourcing and validating event-focused emotion corpora for German and English. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 4005–4011, Florence, Italy. Association for Computational Linguistics.
- Emotion-infused models for explainable psychological stress detection. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 2895–2909, Online. Association for Computational Linguistics.
- Jonathan Turner. 2000. On the origins of human emotions: A sociological inquiry into the evolution of human affect. Stanford University Press.
- Current state of text sentiment analysis from opinion to emotion mining. ACM Computing Surveys, 50(2).
- Samira Zad and Mark Finlayson. 2020. Systematic evaluation of a framework for unsupervised emotion recognition for narrative text. In Proceedings of the First Joint Workshop on Narrative Understanding, Storylines, and Events, pages 26–37, Online. Association for Computational Linguistics.
- Sayyed M. Zahiri and Jinho D. Choi. 2017. Emotion detection on tv show transcripts with sequence-based convolutional neural networks. In AAAI Workshops.
- Why do you feel this way? summarizing triggers of emotions in social media posts. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 9436–9453, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
- M3ED: Multi-modal multi-scene multi-label emotional dialogue database. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 5699–5710, Dublin, Ireland. Association for Computational Linguistics.
- Knowledge-enriched transformer for emotion detection in textual conversations. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 165–176, Hong Kong, China. Association for Computational Linguistics.