Mechanistic Relationship Between Sycophantic Agreement and Honesty/Deception in LLMs
Ascertain the mechanistic relationship between sycophantic agreement in instruction-tuned large language models and the internal features underlying honesty and deception. Determine whether sycophantic agreement shares causal mechanisms with honesty or deception or is represented as a distinct feature, and characterize how these mechanisms interact across model layers and architectures.
References
At the same time, the relation between sycophantic agreement and broader constructs such as honesty and deception remains an open mechanistic question \citep{marks2024the}.
We do not explain why the prediction score alone reduces sycophancy, and Section~\ref{sec:results-ablation} gives two hypotheses that can be tested.
A natural next step is to probe the mechanisms behind these effects, such as whether models retain the correct answer internally when yielding to an opinion.