Cross-lingual validity of behavioral dissociations

Determine whether the dissociations among behavioral axes observed for English-language prompts also hold across languages, writing systems, and culturally specific prompt conventions.

Background

The evaluation uses English-only datasets and therefore establishes instability patterns only for English prompts. The paper distinguishes multiple behavioral axes, including generation consistency, activation drift, confidence, and response mirroring, and reports that these axes can exhibit different failure profiles. It remains unresolved whether the same relationships and dissociations would appear when prompts are expressed in other languages, scripts, or culturally specific conventions.

References

Our datasets are English-only, so whether the same dissociations hold across languages, scripts, or culturally specific prompt conventions is untested.

— Generalization Is Stability, Not Accuracy: Multi-Axis Evaluation of LLMs  (2610.01428 - Omar et al., 1 Oct 2026) in Section 5, Discussion, paragraph beginning “Several limitations bound these conclusions.”