EmoTwiCS: A Corpus for Modelling Emotion Trajectories in Dutch Customer Service Dialogues on Twitter (2310.06536v1)
Abstract: Due to the rise of user-generated content, social media is increasingly adopted as a channel to deliver customer service. Given the public character of these online platforms, the automatic detection of emotions forms an important application in monitoring customer satisfaction and preventing negative word-of-mouth. This paper introduces EmoTwiCS, a corpus of 9,489 Dutch customer service dialogues on Twitter that are annotated for emotion trajectories. In our business-oriented corpus, we view emotions as dynamic attributes of the customer that can change at each utterance of the conversation. The term `emotion trajectory' refers therefore not only to the fine-grained emotions experienced by customers (annotated with 28 labels and valence-arousal-dominance scores), but also to the event happening prior to the conversation and the responses made by the human operator (both annotated with 8 categories). Inter-annotator agreement (IAA) scores on the resulting dataset are substantial and comparable with related research, underscoring its high quality. Given the interplay between the different layers of annotated information, we perform several in-depth analyses to investigate (i) static emotions in isolated tweets, (ii) dynamic emotions and their shifts in trajectory, and (iii) the role of causes and response strategies in emotion trajectories. We conclude by listing the advantages and limitations of our dataset, after which we give some suggestions on the different types of predictive modelling tasks and open research questions to which EmoTwiCS can be applied. The dataset is available upon request and will be made publicly available upon acceptance of the paper.
- Bradley MM, Lang PJ (1994) Measuring emotion: the self-assessment manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry 25(1):49 – 59
- Clavel C, Callejas Z (2016) Sentiment Analysis: From Opinion Mining to Human-Agent Interaction. IEEE Transactions on Affective Computing 7(1):74–93
- Cowen AS, Keltner D (2017) Self-report captures 27 distinct categories of emotion bridged by continuous gradients. Proceedings of the National Academy of Sciences 114(38):E7900–E7909
- Deloitte Digital (2019) Digital CRM 2.0: Building customer relationships in the digital landscape
- Einwiller SA, Steilen S (2015) Handling complaints on social network sites – An analysis of complaints and complaint responses on Facebook and Twitter pages of large US companies. Public Relations Review 41(2):195–204
- Ekman P (1992) An argument for basic emotions. Cognition and Emotion 6(3-4):169–200
- Gallaugher J, Ransbotham S (2010) Social Media and Customer Dialog Management at Starbucks. MIS Quarterly Executive 9(4):197–212
- Hamilton R, Sodeman WA (2020) The questions we ask: Opportunities and challenges for using big data analytics to strategically manage human capital resources. Business Horizons 63(1):85–95
- Hossain MM, Suchy NJ (2013) Influence of customer satisfaction on loyalty: a study on mobile telecommunication industry. Journal of Social Sciences 9(2):73–80
- Krippendorff K (2004) Content Analysis: An Introduction to Its Methodology, 2nd edn. SAGE Publications
- Landis JR, Koch GG (1977) The Measurement of Observer Agreement for Categorical Data. Biometrics 33(1):159–174
- Leary T (1957) Interpersonal Diagnosis of Personality: A Functional Theory and Methodology for Personality Evaluation. Ronald Press
- Li S, Deng W (2020) Deep Facial Expression Recognition: A Survey. IEEE Transactions on Affective Computing
- Liu B (2012) Sentiment Analysis and Opinion Mining. Synthesis Lectures on Human Language Technologies 5(1):1–167
- Mehrabian A, Russell JA (1974) An Approach to Environmental Psychology. The MIT Press
- Picard RW (1997) Affective Computing. The MIT Press
- Rafaeli A, Sutton RI (1987) Expression of Emotion as Part of the Work Role. The Academy of Management Review 12(1):23–37
- Simon F (2013) The influence of empathy in complaint handling: Evidence of gratitudinal and transactional routes to loyalty. Journal of Retailing and Consumer Services 20(6):599–608
- Skerry AE, Saxe R (2015) Neural representations of emotion are organized around abstract event features. Current Biology 25(15):1945–1954
- van Noort G, Willemsen LM (2012) Online Damage Control: The Effects of Proactive Versus Reactive Webcare Interventions in Consumer-generated and Brand-generated Platforms. Journal of Interactive Marketing 26(3):131–140
Sponsor
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.