Isolate causal contributions of keys and values

Establish the separate causal contributions of key and value representations to the behavioral effects of K/V-cache interventions by conducting K-only and V-only ablation experiments.

Background

The reported K/V cosine analysis finds substantially larger V-space gaps than K-space gaps, but these measurements are correlational and arise from interventions that modify keys and values together. The paper therefore cannot determine whether values, keys, or their interaction causes the observed persona-expression and lexical-diversity effects.

The authors explicitly identify K-only and V-only ablations as the experiments needed to convert the descriptive V-versus-K comparison into a causal characterization.

References

We report this descriptively; isolating K-only vs. V-only causal contributions would require dedicated ablation experiments and is left to future work (see \S\ref{sec:limitations}).

K/V-Cache Interventions Dissociate Representation Alignment from Persona Expression in Decoder-Only Language Models  (2609.11020 - Sun et al., 10 Sep 2026) in Section 5.5, K/V cosine analysis; Section 7, Limitations