Extent to which LLMs can reliably embody assigned personas
Determine the extent to which large language models can reliably embody assigned personas when instructed via prompting to adopt specific human cultural perspectives, assessing whether persona modulation yields coherent and humanlike cultural stances across tasks and model architectures.
References
Despite past efforts, it is unclear the extent to which LLMs can reliably embody the assigned persona.
— Randomness, Not Representation: The Unreliability of Evaluating Cultural Alignment in LLMs
(2503.08688 - Khan et al., 11 Mar 2025) in Identifying Key Assumptions, Subsection "Steerability"