Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
162 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Silver-Tongued and Sundry: Exploring Intersectional Pronouns with ChatGPT (2405.08238v1)

Published 13 May 2024 in cs.HC, cs.AI, and cs.CL

Abstract: ChatGPT is a conversational agent built on a LLM. Trained on a significant portion of human output, ChatGPT can mimic people to a degree. As such, we need to consider what social identities ChatGPT simulates (or can be designed to simulate). In this study, we explored the case of identity simulation through Japanese first-person pronouns, which are tightly connected to social identities in intersectional ways, i.e., intersectional pronouns. We conducted a controlled online experiment where people from two regions in Japan (Kanto and Kinki) witnessed interactions with ChatGPT using ten sets of first-person pronouns. We discovered that pronouns alone can evoke perceptions of social identities in ChatGPT at the intersections of gender, age, region, and formality, with caveats. This work highlights the importance of pronoun use for social identity simulation, provides a language-based methodology for culturally-sensitive persona development, and advances the potential of intersectional identities in intelligent agents.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (95)
  1. AI-based chatbots in customer service and their effects on user compliance. Electronic Markets 31, 2 (2021), 427–445.
  2. Decolonial pathways: Our manifesto for a decolonizing agenda in HCI research and design. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–9.
  3. Neuroticism and facial emotion recognition in healthy adults. Early Intervention in Psychiatry 10, 2 (2016), 160–164.
  4. Social anxiety and the interpretation of morphed facial expressions following exclusion and inclusion. Journal of Behavior Therapy and Experimental Psychiatry 66 (2020), 101511.
  5. Is man the measure of all things? A social cognitive account of androcentrism. Personality and Social Psychology Review 23, 4 (2019), 307–331.
  6. Based on billions of words on the internet, people=men. Science Advances 8, 13 (2022), eabm2463.
  7. Andrew Balmer. 2023. A sociological conversation with ChatGPT about AI ethics, affect and reflexivity. Sociology 57, 5 (2023), 1249–1258.
  8. Shaowen Bardzell. 2010. Feminist HCI: Taking Stock and Outlining an Agenda for Design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI ’10). Association for Computing Machinery, New York, NY, USA, 1301–1310. https://doi.org/10.1145/1753326.1753521
  9. Hilary Bergen et al. 2016. ‘I’d blush if I could’: Digital assistants, disembodied cyborgs and the problem of gender. Word and text, a journal of literary studies and linguistics 6, 01 (2016), 95–113.
  10. Man is to computer programmer as woman is to homemaker? Debiasing word embeddings. Advances in Neural Information Processing Systems (NeurIPS) 29 (2016), 9 pages.
  11. Gendered or neutral? Considering the language of HCI. In Proceedings of the 41st Graphics Interface Conference (Halifax, Nova Scotia, Canada) (GI ’15). Canadian Information Processing Society, CAN, 163–170.
  12. Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (2006), 77–101.
  13. Why should we gender? The effect of robot gendering and occupational stereotypes on human trust and perceived competency. In Proceedings of the 2020 ACM/IEEE international conference on human-robot interaction. ACM/IEEE, New York, NY, USA, 13–21.
  14. Joy Buolamwini and Timnit Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on Fairness, Accountability and Transparency (ACM FAccT). PMLR, ACM, New York, NY, USA, 77–91.
  15. Donn Byrne. 1969. Attitudes and attraction. In Advances in Experimental Social Psychology. Vol. 4. Elsevier, Amsterdam, The Netherlands, 35–89.
  16. Deborah Cameron and Don Kulick. 2003. Language and sexuality. Cambridge University Press, Cambridge, UK.
  17. Performance evaluation bias: A comparative study on the role of financial fixation, similarity-to-self and likeability. Advances in accounting 30, 1 (2014), 9–17.
  18. J. Elliott Casal and Matthew Kessler. 2023. Can linguists distinguish between ChatGPT/AI and human writing?: A study of research ethics and academic publishing. Research Methods in Applied Linguistics 2, 3 (2023), 100068.
  19. On measuring gender bias in translation of gender-neutral pronouns. In Proceedings of the First Workshop on Gender Bias in Natural Language Processing. Association for Computational Linguistics, Florence, Italy, 173–181. https://doi.org/10.18653/v1/W19-3824
  20. Sarah Ciston. 2019. Intersectional AI is essential: Polyvocal, multimodal, experimental methods to save artificial intelligence. Journal of Science and Technology of the Arts 11, 2 (2019), 3–8.
  21. Patricia Hill Collins. 2022. Black Feminist Thought: Knowledge, Consciousness, and the Politics of Empowerment. Routledge, Milton Park, Abingdon-on-Thames, Oxfordshire, England, UK.
  22. Andrew M. Colman. 2009. Effect Size. https://www.oxfordreference.com/display/10.1093/acref/9780199534067.001.0001/acref-9780199534067-e-9112
  23. Miruna-Valeria Craiut and Ioana Raluca Iancu. 2022. Is technology gender neutral? A systematic literature review on gender stereotypes attached to artificial intelligence. Human Technology 18, 3 (2022), 297–315.
  24. Kimberlé Williams Crenshaw. 2013. Mapping the margins: Intersectionality, identity politics, and violence against women of color. In The public nature of private violence. Routledge, Milton Park, Abingdon-on-Thames, Oxfordshire, England, UK, 93–118.
  25. Evaluations of an artificial intelligence instructor’s voice: Social Identity Theory in human-robot interactions. Computers in Human Behavior 90 (2019), 357–362.
  26. Claus-Peter H. Ernst and Nils Herm-Stapelberg. 2020. The impact of gender stereotyping on the perceived likability of virtual assistants. In AMCIS 2020 Procedings. Association for Information Systems, Atlanta, GA, USA, 4 pages. https://aisel.aisnet.org/amcis2020/cognitive_in_is/cognitive_in_is/4
  27. Friederike Eyssel and Frank Hegel. 2012. (S) he’s got the look: Gender stereotyping of robots. Journal of Applied Social Psychology 42, 9 (2012), 2213–2230.
  28. Positive versus negative valence: Asymmetries in attitude formation and generalization as fundamental individual differences. In Advances in Experimental Social Psychology. Vol. 51. Elsevier, Amsterdam, The Netherlands, 97–146.
  29. Batya Friedman and Helen Nissenbaum. 1996. Bias in Computer Systems. ACM Trans. Inf. Syst. 14, 3 (jul 1996), 330–347. https://doi.org/10.1145/230538.230561
  30. Marginalized populations and research ethics online. In CSCW Workshop on Ethics for Studying Sociotechnical Systems in a Big Data World (CSCW ’15, Vol. 5. ACM, New York, NY, US, 5 pages.
  31. The priming effect in task design research. Journal of Management 14, 1 (1988), 33–39.
  32. The weirdest people in the world? Behavioral and Brain Sciences 33, 2-3 (2010), 61–83.
  33. The cognitive tenacity of self-directed ageism. Trends in Cognitive Sciences 27, 8 (2023), 713–725.
  34. Mie Hiramoto. 2013. Hey, you’re a girl?: Gendered expressions in the popular anime, Cowboy Bebop. Multilingua-Journal of Cross-Cultural and Interlanguage Communication 32, 1 (2013), 51–78.
  35. Hiroaki Hirano. 1994. Anti-Heterosexism. Pandora Books, Norfolk, England. https://ci.nii.ac.jp/ncid/BN10961187
  36. Sachiko Ide. 1990. How and why do women speak more politely in Japanese. Aspects of Japanese women’s language 63 (1990), 79.
  37. Sachiko Ide. 1997. 女性語の世界. 明治書院, Tokyo, Japan. https://ci.nii.ac.jp/ncid/BA34315753
  38. Sachiko Ide and Kishiko Ueno. 2012. Honorifics and address terms. In Pragmatics of Society, Gisle Andersen and Boston Karin Aijmer, Berlin (Eds.). De Gruyter Mouton, The Hague, Netherlands, Chapter 14, 439–470. https://doi.org/doi:10.1515/9783110214420.439
  39. Using Intersectional Representation & Embodied Identification in Standard Video Game Play to Reduce Societal Biases. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 446, 18 pages. https://doi.org/10.1145/3411764.3445161
  40. Algorithmic folk theories and identity: How TikTok users co-produce knowledge of identity and engage in algorithmic resistance. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (2021), 1–44.
  41. ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences 103 (2023), 102274.
  42. Satoshi Kinsui. 2003. ヴァーチャル日本語役割語の謎. 岩波書店, Tokyo, Japan. https://ci.nii.ac.jp/ncid/BA60610309
  43. Yomohide Kinuhata and Chang soo Yang. 2007. 役割語としての「軍隊語」の成立. In 役割語研究の地平. くろしお出版, Tokyo, Japan, 37–44.
  44. Mieko Kobayashi. 2013. 役割語における 「差別」 を考える. ことば 34 (2013), 88–102.
  45. Yukari Kumadaki. 2006. Language and Gender: Gender Distinctions in English and Japanese. Fukuoka University Review of Literature & Humanities 38, 1 (2006), 215–229.
  46. Shigeko Kumagai. 2010. 方言の歴史 : 若い女性が東北方言を使いにくいわけ. In ジェンダーで学ぶ言語学. 世界思想社, Kyoto, Japan, 50–65. "https://ci.nii.ac.jp/ncid/BB01773396
  47. Risa Kumamoto. 2020. 被差別部落女性の主体性形成に関する研究 (Research on the Subjectivity Formation of Buraku Women). Buraku Liberation Publishing House, Osaka, Japan. https://doi.org/10.24729/00002550
  48. Neha Kumar and Naveena Karusala. 2019. Intersectional computing. Interactions 26, 2 (2019), 50–54.
  49. That robot is not for me: Addressing stereotypes of aging in assistive robot design. In 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). IEEE, IEEE, New York, NY, USA, 312–317.
  50. How WEIRD is CHI?. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 143, 14 pages. https://doi.org/10.1145/3411764.3445488
  51. Using ChatGPT in Education: Human Reflection on GPT’s Self-Reflection. Societies 13, 8 (2023), 196.
  52. ChatGPT: The next frontier in academic writing for cardiologists or a Pandora’s box of ethical dilemmas. European Heart Journal Open 3, 2 (2023), oead007.
  53. Claire Maree. 2007. 発話者の言語ストラテジーとしてのネゴシエーション(切りぬける・交渉・談判・掛け合い)行為の研究. ひつじ研究叢書, Vol. ５２. ひつじ書房, Tokyo, Japan. https://ci.nii.ac.jp/ncid/BA81400315
  54. Nicola Marsden and Monika Pröbster. 2019. Personas and identity: Looking at multiple identities to inform the construction of personas. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–14.
  55. Patrizia Marti and Stefano Varlaro. 2023. Speculating gender in conversational interfaces. In IASDR 2023: Life-Changing Design. Design Research Society, United Kingdom, 16 pages. https://doi.org/10.21606/iasdr.2023.394
  56. Ashley E. Martin and Malia F. Mason. 2023. Hey Siri, I love you: People feel more attached to gendered technology. Journal of Experimental Social Psychology 104 (2023), 104402.
  57. N.H. McGloin and Sachiko Ide. 1990. Aspects of Japanese Women’s Language. くろしお出版, Tokyo, Japan.
  58. Ayumi Miyazaki. 2016. Japanese Junior High School Students’ Metapragmatic Commentaries: Shifting Gendered Language Ideologies. Japanese Journal of Language in Society 19, 1 (2016), 135–150. https://doi.org/10.19024/jajls.19.1_135.
  59. Procheta Nag and Özge Nilay Yalçın. 2020. Gender stereotypes in virtual agents. In Proceedings of the 20th ACM International conference on intelligent virtual agents. ACM, New York, NY, USA, 1–8.
  60. Momoko Nakamura. 2007. Sex and Japanese: Woman and man constructed by language. NHK Books, Tokyo, Japan. https://ci.nii.ac.jp/ncid/BA83498773
  61. Momoko Nakamura. 2014. Gender, language and ideology: A genealogy of Japanese women’s language. Vol. 58. John Benjamins Publishing Company, Amsterdam, The Netherlands.
  62. Momoko Nakamura. 2020. The formation of a sociolinguistic style in translation: Cool and informal non-Japanese masculinity. Gender & Language 14, 3 (2020), 244–262.
  63. Momoko Nakamura. 2022. Feminist approaches to Japanese language, gender, and sexuality. In Handbook of Japanese Sociolinguistics, Yoshiyuki Asahi, Mayumi Usami, and Fumio Inoue (Eds.). Vol. 8. Walter de Gruyter GmbH & Co KG, Berlin, Germany, Chapter 9, 271–292.
  64. Are machines gender neutral? Gender-stereotypic responses to computers with voices. Journal of Applied Social Psychology 27, 10 (1997), 864–876.
  65. Tsunao Ogino. 2007. 最近の東京近辺の学生の自称詞の傾向. 計量国語学会機関誌 25, 8 (2007), 371–374. https://cir.nii.ac.jp/crid/1520290883446905344
  66. Ruth Oldenziel. 1999. Making technology masculine: Men, women and modern machines in America, 1870-1945. Amsterdam University Press, Amsterdam, The Netherlands.
  67. Models of (Often) Ambivalent Robot Stereotypes: Content, Structure, and Predictors of Robots’ Age and Gender Stereotypes. In Proceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction. ACM/IEEE, New York, NY, USA, 428–436.
  68. ”Alexa is My New BFF”: Social Roles, User Satisfaction, and Personification of the Amazon Echo. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI EA ’17). Association for Computing Machinery, New York, NY, USA, 2853–2859. https://doi.org/10.1145/3027063.3053246
  69. Diogo Rato and Rui Prada. 2021. Towards social identity in socio-cognitive agents. Sustainability 13, 20 (2021), 11390.
  70. Wesley C. Robertson. 2017. He’s more katakana than kanji: Indexing identity and self-presentation through script selection in Japanese manga (comics). Journal of Sociolinguistics 21, 4 (2017), 497–520.
  71. Jennifer A. Rode. 2011. A theoretical agenda for feminist HCI. Interacting with Computers 23, 5 (2011), 393–400.
  72. Shigeko Saiki-Craighill. 2014. グラウンデッド・セオリー・アプローチ概論 (Introduction to Grounded Theory Approach). Keio SFC Journal 14, 1 (2014), 30–43.
  73. Right for the Job or Opposites Attract? Exploring Cross-Generational User Experiences with “Younger” and “Older” Voice Assistants. In Companion Publication of the 2023 ACM Designing Interactive Systems Conference (Pittsburgh, PA, USA) (DIS ’23 Companion). Association for Computing Machinery, New York, NY, USA, 160–163. https://doi.org/10.1145/3563703.3596642
  74. Intersectional HCI: Engaging identity through gender, race, and class. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 5412–5427.
  75. Toni Schmader. 2010. Stereotype Threat Deconstructed. Current Directions in Psychological Science 19, 1 (2010), 14–18. https://doi.org/10.1177/0963721409359292 arXiv:https://doi.org/10.1177/0963721409359292
  76. Howard Schuman and Stanley Presser. 1996. Questions and Answers in Attitude Surveys: Experiments on Question Form, Wording, and Context. SAGE, Thousand Oaks, CA, USA. Google-Books-ID: Je640UKqNaYC.
  77. Transcending the “Male Code”: Implicit Masculine Biases in NLP Contexts. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 138, 19 pages. https://doi.org/10.1145/3544548.3581017
  78. Katie Seaborn and Alexa Frank. 2022. What Pronouns for Pepper? A Critical Review of Gender/Ing in Research. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 239, 15 pages. https://doi.org/10.1145/3491102.3501996
  79. Katie Seaborn and Yeongdae Kim. 2023. “I’m” Lost in Translation: Pronoun Missteps in Crowdsourced Data Sets. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI EA ’23). Association for Computing Machinery, New York, NY, USA, Article 168, 6 pages. https://doi.org/10.1145/3544549.3585667
  80. Voice in Human–Agent Interaction: A Survey. ACM Comput. Surv. 54, 4, Article 81 (may 2021), 43 pages. https://doi.org/10.1145/3386867
  81. Can voice assistants sound cute? Towards a model of kawaii vocalics. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (CHI EA ’23). Association for Computing Machinery, New York, NY, USA, 1–7. https://doi.org/10.1145/3544549.3585656
  82. Exploring Gender-Expansive Categorization Options for Robots. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI EA ’22). Association for Computing Machinery, New York, NY, USA, Article 252, 6 pages. https://doi.org/10.1145/3491101.3519646
  83. Ahmet Salih ŞİMŞEK. 2023. The power and type I error of Wilcoxon-Mann-Whitney, Welch’s t, and student’s t tests for likert-type data. International Journal of Assessment Tools in Education 10, 1 (2023), 114–128.
  84. Social Science Statistics. 2024. P Value from Chi-Square Calculator. Retrieved from https://www.socscistatistics.com/pvalues/chidistribution.aspx.
  85. Device uses and device stereotypes. Computers in Human Behavior Reports 4 (2021), 100100.
  86. Mitigating Gender Bias in Natural Language Processing: Literature Review. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Florence, Italy, 1630–1640. https://doi.org/10.18653/v1/P19-1159
  87. Henri Tajfel and John C. Turner. 2004. The social identity theory of intergroup behavior. In Political Psychology. Psychology Press, London, UK, 276–293.
  88. When stereotypes meet robots: The double-edge sword of robot gender and personality in human–robot interaction. Computers in Human Behavior 38 (2014), 75–84.
  89. An Empirical Study of Workers’ Behavior in Spatial Crowdsourcing. In Proceedings of the Third International ACM SIGMOD Workshop on Managing and Mining Enriched Geo-Spatial Data (San Francisco, California) (GeoRich ’16). Association for Computing Machinery, New York, NY, USA, Article 8, 6 pages. https://doi.org/10.1145/2948649.2948657
  90. Can a gender-ambiguous voice reduce gender stereotypes in human-robot interactions?. In Proceedings of the 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN 2023). IEEE, New York, NY, USA, 106–112. https://doi.org/10.1109/RO-MAN57019.2023.10309500
  91. Harry C. Triandis. 2001. Individualism-collectivism and personality. Journal of Personality 69, 6 (2001), 907–924.
  92. ChatGPT: Five priorities for research. Nature 614, 7947 (2023), 224–226.
  93. Between the Lines: Reevaluating the Online/Offline Binary. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI EA ’15). Association for Computing Machinery, New York, NY, USA, 2337–2340. https://doi.org/10.1145/2702613.2702635
  94. Gender and Age Stereotypes in Robotics for Eldercare: Ethical Implications of Stakeholder Perspectives from Technology Development, Industry, and Nursing. Science and Engineering Ethics 28, 4 (2022), 34.
  95. Timothy Bing Lun Yee and Jock Wong. 2021. Japanese first-person singular pronouns revisited: A semantic and cultural interpretation. Journal of Pragmatics 181 (2021), 139–161.
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets