Extent to which LLMs can reliably embody assigned personas
Determine the extent to which large language models can reliably embody assigned personas when instructed via prompting to adopt specific human cultural perspectives, assessing whether persona modulation yields coherent and humanlike cultural stances across tasks and model architectures.
References
Despite past efforts, it is unclear the extent to which LLMs can reliably embody the assigned persona.
Whether grounding keeps synthesis faithful to the record, how often the figure lapses into anachronism, and how strong the visitor's sense of experiential presence is are questions a live exhibit raises but cannot answer on its own: the first two would require systematic annotation of responses against their sources, and the last a dedicated visitor study with established presence instruments.
This study examines one model family, one deployment stack and one naturally occurring failure mode; cross-model and cross-harness generality remain unknown.