Influence of AI personalization on human reactions

Investigate whether and how the potential to personalize generative artificial intelligence models influences how people react to their use in social interaction.

Background

Personalization could align AI outputs with individual preferences, potentially altering human behavior toward AI-mediated decisions. The authors identify uncertainty about whether personalization modifies human reactions, motivating treatments that vary personalization in their experiment.

References

In particular, several fundamental questions regarding human behavior in AI-mediated social interaction remain unaddressed. And does the potential to personalize generative AI models influence how people react to their use?

— Generative AI Triggers Welfare-Reducing Decisions in Humans  (2401.12773 - Dvorak et al., 2024) in Introduction (Section 1)

Whether this adaptation should be automatic versus user-controlled remains an open question; an automatic adaptation can risk stereotyping, wrong inference, and even the perception of mimicry, while user control may be perceived as an additional burden to the user.

— AI-Generated Email Drafts Shift Culturally Distinctive Communication Styles in Professional Email  (2609.26403 - Sakai et al., 22 Sep 2026) in Section 4, Design Implications, subsection “Adapting AI to cultural communication norms”

All log-based results are associations. Naming almost always occurs at first contact, and we did not randomize the assistant name, so we cannot separate this kind of user would rename anyway'' fromrenaming changed how they talk''; identity tags are written from later conversation and likewise cannot be reversed into causes of naming.

— How Anthropomorphic Attitudes Toward Agents Divide User Behavior, and How Design Should Change  (2610.13156 - Cao et al., 9 Oct 2026) in Section 6, “Limitations and future work” (paragraph 2)