Affective-NLI: Towards Accurate and Interpretable Personality Recognition in Conversation (2404.02589v1)
Abstract: Personality Recognition in Conversation (PRC) aims to identify the personality traits of speakers through textual dialogue content. It is essential for providing personalized services in various applications of Human-Computer Interaction (HCI), such as AI-based mental therapy and companion robots for the elderly. Most recent studies analyze the dialog content for personality classification yet overlook two major concerns that hinder their performance. First, crucial implicit factors contained in conversation, such as emotions that reflect the speakers' personalities are ignored. Second, only focusing on the input dialog content disregards the semantic understanding of personality itself, which reduces the interpretability of the results. In this paper, we propose Affective Natural Language Inference (Affective-NLI) for accurate and interpretable PRC. To utilize affectivity within dialog content for accurate personality recognition, we fine-tuned a pre-trained LLM specifically for emotion recognition in conversations, facilitating real-time affective annotations for utterances. For interpretability of recognition results, we formulate personality recognition as an NLI problem by determining whether the textual description of personality labels is entailed by the dialog content. Extensive experiments on two daily conversation datasets suggest that Affective-NLI significantly outperforms (by 6%-7%) state-of-the-art approaches. Additionally, our Flow experiment demonstrates that Affective-NLI can accurately recognize the speaker's personality in the early stages of conversations by surpassing state-of-the-art methods with 22%-34%.
- S. D’Alfonso, “Ai in mental health,” Current Opinion in Psychology, vol. 36, pp. 112–117, 2020.
- D. Yang, E.-S. Oh, and Y. Wang, “Hybrid physical education teaching and curriculum design based on a voice interactive artificial intelligence educational robot,” Sustainability, vol. 12, no. 19, p. 8000, 2020.
- J. G. Kahambing, “Chatgpt, public health communication and ’intelligent patient companionship’,” Journal of public health, p. fdad028, 2023.
- R. C.-S. Chang, H.-P. Lu, and P. Yang, “Stereotypes or golden rules? exploring likable voice traits of social robots as active aging companions for tech-savvy baby boomers in taiwan,” Computers in Human Behavior, vol. 84, pp. 194–210, 2018.
- N. Srinarong and J. Mongkolnavin, “A development of personality recognition model from conversation voice in call center context,” in The 12th International Conference on Advances in Information Technology, 2021, pp. 1–5.
- S. Fatahi, H. Moradi, and L. Kashani-Vahid, “A survey of personality and learning styles models applied in virtual environments with emphasis on e-learning environments,” Artificial Intelligence Review, vol. 46, no. 3, pp. 413–429, 2016.
- P. T. Costa and R. R. McCrae, “Normal personality assessment in clinical practice: The neo personality inventory.” Psychological assessment, vol. 4, no. 1, p. 5, 1992.
- J. Feist and G. Feist, “J.(2008). theories of personality,” 2012.
- E. A. Rissola, S. A. Bahrainian, and F. Crestani, “Personality recognition in conversations using capsule neural networks,” in IEEE/WIC/ACM International Conference on Web Intelligence, 2019, pp. 180–187.
- H. Jiang, X. Zhang, and J. D. Choi, “Automatic text-based personality recognition on monologues and multiparty dialogues using attentive networks and contextual embeddings (student abstract),” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, no. 10, 2020, pp. 13 821–13 822.
- Y. Chen, W. Fan, X. Xing, J. Pang, M. Huang, W. Han, Q. Tie, and X. Xu, “Cped: A large-scale chinese personalized and emotional dialogue dataset for conversational ai,” arXiv preprint arXiv:2205.14727, 2022.
- Z. Wen, J. Cao, Y. Yang, H. Wang, R. Yang, and S. Liu, “Desprompt: Personality-descriptive prompt tuning for few-shot personality recognition,” Information Processing & Management, vol. 60, no. 5, p. 103422, 2023.
- A. Mehrabian, “Relationships among three general approaches to personality description,” The journal of Psychology, vol. 129, no. 5, pp. 565–581, 1995.
- ——, “Analysis of the big-five personality factors in terms of the pad temperament model,” Australian journal of Psychology, vol. 48, no. 2, pp. 86–92, 1996.
- G. Saucier and L. R. Goldberg, “Evidence for the big five in analyses of familiar english personality adjectives,” European journal of Personality, vol. 10, no. 1, pp. 61–77, 1996.
- S. Roccas, L. Sagiv, S. H. Schwartz, and A. Knafo, “The big five personality factors and personal values,” Personality and social psychology bulletin, vol. 28, no. 6, pp. 789–801, 2002.
- T. Bickmore and J. Cassell, “Relational agents: a model and implementation of building user trust,” in Proceedings of the SIGCHI conference on Human factors in computing systems, 2001, pp. 396–403.
- J. W. Pennebaker, M. E. Francis, and R. J. Booth, “Linguistic inquiry and word count: Liwc 2001,” Mahway: Lawrence Erlbaum Associates, vol. 71, no. 2001, p. 2001, 2001.
- M. R. Mehl, S. D. Gosling, and J. W. Pennebaker, “Personality in its natural habitat: Manifestations and implicit folk theories of personality in daily life.” Journal of personality and social psychology, vol. 90, no. 5, p. 862, 2006.
- F. Mairesse and M. Walker, “Automatic recognition of personality in conversation,” in Proceedings of the Human Language Technology Conference of the NAACL, Companion Volume: Short Papers, 2006, pp. 85–88.
- J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “Bert: Pre-training of deep bidirectional transformers for language understanding,” arXiv preprint arXiv:1810.04805, 2018.
- J. Hu, L. Shen, and G. Sun, “Squeeze-and-excitation networks,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 7132–7141.
- F. Iacobelli, A. J. Gill, S. Nowson, and J. Oberlander, “Large scale personality classification of bloggers,” in international conference on affective computing and intelligent interaction. Springer, 2011, pp. 568–577.
- A. Souri, S. Hosseinpour, and A. M. Rahmani, “Personality classification based on profiles of social networks’ users and the five-factor model of personality,” Human-centric Computing and Information Sciences, vol. 8, no. 1, pp. 1–15, 2018.
- Y. Ji, W. Wu, H. Zheng, Y. Hu, X. Chen, and L. He, “Is chatgpt a good personality recognizer? a preliminary study,” 2023.
- H. Rao, C. Leung, and C. Miao, “Can chatgpt assess human personalities? a general evaluation framework,” 2023.
- D. Watson and L. A. Clark, “On traits and temperament: General and specific factors of emotional experience and their relation to the five-factor model,” Journal of personality, vol. 60, no. 2, pp. 441–476, 1992.
- M.-J. Han, C.-H. Lin, and K.-T. Song, “Robotic emotional expression generation based on mood transition and personality model,” IEEE Transactions on Cybernetics, vol. 43, no. 4, pp. 1290–1303, 2013.
- Z. Wen, J. Cao, R. Yang, S. Liu, and J. Shen, “Automatically select emotion for response via personality-affected emotion transition,” in Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, 2021, pp. 5010–5020.
- J. Broekens, B. Hilpert, S. Verberne, K. Baraka, P. Gebhard, and A. Plaat, “Fine-grained affective processing capabilities emerging from large language models,” in 2023 11th International Conference on Affective Computing and Intelligent Interaction (ACII). IEEE, 2023, pp. 1–8.
- M. M. Amin, R. Mao, E. Cambria, and B. W. Schuller, “A wide evaluation of chatgpt on affective computing tasks,” 2023.
- X. Gu, K. M. Yoo, and J.-W. Ha, “Dialogbert: Discourse-aware response generation via learning to recover and rank utterances,” arXiv preprint arXiv:2012.01775, 2020.
- T. Kim and P. Vossen, “Emoberta: Speaker-aware emotion recognition in conversation with roberta,” arXiv preprint arXiv:2108.12009, 2021.
- T. Wolf, L. Debut, V. Sanh, J. Chaumond, C. Delangue, A. Moi, P. Cistac, T. Rault, R. Louf, M. Funtowicz et al., “Huggingface’s transformers: State-of-the-art natural language processing,” arXiv preprint arXiv:1910.03771, 2019.
- L. R. Goldberg and G. Saucier, “So what do you propose we use instead? a reply to block.” 1995.
- P. Quaglio, “Television dialogue: The sitcom friends vs. natural conversation. amsterdam, nl,” 2009.
- Y. Liu, M. Ott, N. Goyal, J. Du, M. Joshi, D. Chen, O. Levy, M. Lewis, L. Zettlemoyer, and V. Stoyanov, “Roberta: A robustly optimized bert pretraining approach,” arXiv preprint arXiv:1907.11692, 2019.
- C. Raffel, N. Shazeer, A. Roberts, K. Lee, S. Narang, M. Matena, Y. Zhou, W. Li, and P. J. Liu, “Exploring the limits of transfer learning with a unified text-to-text transformer,” The Journal of Machine Learning Research, vol. 21, no. 1, pp. 5485–5551, 2020.
- H. Touvron, T. Lavril, G. Izacard, X. Martinet, M.-A. Lachaux, T. Lacroix, B. Rozière, N. Goyal, E. Hambro, F. Azhar et al., “Llama: Open and efficient foundation language models,” arXiv preprint arXiv:2302.13971, 2023.
- X. Liu, K. Ji, Y. Fu, W. Tam, Z. Du, Z. Yang, and J. Tang, “P-tuning: Prompt tuning can be comparable to fine-tuning across scales and tasks,” in Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2022, pp. 61–68.
- D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980, 2014.
- R. R. McCrae and P. T. Costa, “Validation of the five-factor model of personality across instruments and observers.” Journal of personality and social psychology, vol. 52, no. 1, p. 81, 1987.
- L. R. Goldberg, “The structure of phenotypic personality traits.” American psychologist, vol. 48, no. 1, p. 26, 1993.
- L. P. Naumann, S. Vazire, P. J. Rentfrow, and S. D. Gosling, “Personality judgments based on physical appearance,” Personality and social psychology bulletin, vol. 35, no. 12, pp. 1661–1671, 2009.
- M. M. LATHA, V. L. CHAITANYA, and M. S. DEVI, “By face gesture validating the personality of a person.”
- X. Shui, Y. Chen, X. Hu, F. Wang, and D. Zhang, “Personality in daily life: Multi-situational physiological signals reflect big-five personality traits,” IEEE Journal of Biomedical and Health Informatics, 2023.
- Zhiyuan Wen (11 papers)
- Jiannong Cao (73 papers)
- Yu Yang (213 papers)
- Ruosong Yang (8 papers)
- Shuaiqi Liu (12 papers)