Transformer based neural networks for emotion recognition in conversations (2405.11222v1)
Abstract: This paper outlines the approach of the ISDS-NLP team in the SemEval 2024 Task 10: Emotion Discovery and Reasoning its Flip in Conversation (EDiReF). For Subtask 1 we obtained a weighted F1 score of 0.43 and placed 12 in the leaderboard. We investigate two distinct approaches: Masked LLMing (MLM) and Causal LLMing (CLM). For MLM, we employ pre-trained BERT-like models in a multilingual setting, fine-tuning them with a classifier to predict emotions. Experiments with varying input lengths, classifier architectures, and fine-tuning strategies demonstrate the effectiveness of this approach. Additionally, we utilize Mistral 7B Instruct V0.2, a state-of-the-art model, applying zero-shot and few-shot prompting techniques. Our findings indicate that while Mistral shows promise, MLMs currently outperform them in sentence-level emotion classification.
- Language models are few-shot learners.
- Unsupervised cross-lingual representation learning at scale. CoRR, abs/1911.02116.
- GoEmotions: A Dataset of Fine-Grained Emotions. In 58th Annual Meeting of the Association for Computational Linguistics (ACL).
- Bert: Pre-training of deep bidirectional transformers for language understanding.
- Paul Ekman. 1992. An argument for basic emotions. Cognition and Emotion, 6(3–4):169–200.
- Mistral 7B. arXiv preprint arXiv:2310.06825.
- Mixtral of experts.
- SOLAR 10.7B: Scaling large language models with simple yet effective depth up-scaling.
- Semeval 2024 – task 10: Emotion discovery and reasoning its flip in conversation (ediref). In Proceedings of the 2024 Annual Conference of the North American Chapter of the Association for Computational Linguistics. Association for Computational Linguistics.
- Discovering emotion and reasoning its flip in multi-party conversations using masked memory network and transformer.
- Discovering emotion and reasoning its flip in multi-party conversations using masked memory network and transformer. Knowledge-Based Systems, 240:108112.
- How to fine-tune bert for text classification?
- Claudiu Creanga (5 papers)
- Liviu P. Dinu (23 papers)