---
title: Transfer-Localization in Multilingual Models
url: https://www.emergentmind.com/topics/transfer-localization-plane
type: topic
---

# Transfer-Localization in Multilingual Models

The transfer-localization plane is a two-dimensional analytical construct for studying transfer and localization jointly rather than as isolated metrics. In its most explicit formulation, introduced for multilingual large language models, the plane places change in culturally adaptive performance on the horizontal axis and change in cross-lingual factual transfer on the vertical axis, both measured relative to an unaligned baseline model [2510.26024]. Related literature uses the same phrase more loosely for phase-diagram-like views of transport, localization, and transfer efficiency in disordered quantum systems [2509.21374; 1707.01390]. This suggests that the term functions as a general comparative device for exposing trade-offs that single-axis evaluation suppresses.

## 1. Formal definition in multilingual language-model evaluation

In the multilingual LLM setting, let \(M_0\) be the unaligned baseline model and \(M\) the same model after a cross-lingual alignment intervention. Two held-out multiple-choice benchmarks are used: universal or transfer tasks, indexed by \(T\), instantiated by Global MMLU (\(\mathrm{gmmlu}\)); and culturally-adaptive or localization tasks, indexed by \(L\), instantiated by a de-contextualized version of the Blend benchmark. The plane is defined through the coordinate pair
\[
\DeltaTransfer(M)=Acc(M;\mathrm{gmmlu})-Acc(M_0;\mathrm{gmmlu}),
\]
\[
\DeltaLocalize(M)=Acc(M;\mathrm{blend})-Acc(M_0;\mathrm{blend}).
\]
By construction, \(\DeltaTransfer>0\) means that an alignment method improved cross-lingual transfer on universal facts, whereas \(\DeltaLocalize<0\) means that the method caused “cultural erasure,” defined as worse performance on culturally situated questions. The Transfer-Localization Plane is then the set
\[
\{(x,y)\in\mathbb{R}^2 : x=\DeltaLocalize,\; y=\DeltaTransfer\}.
\]
Each evaluated model is represented by a point \((\DeltaLocalize,\DeltaTransfer)\) on this plane [2510.26024].

The formalism is designed to make cross-lingual alignment legible as a two-objective problem. A method that improves factual transfer but degrades culturally situated response quality moves upward and leftward; a method that improves both objectives moves upward and rightward. This definition is notable because it treats cultural localization as an explicit evaluation target rather than as an unmeasured side effect of representational alignment.

## 2. Axes, benchmarks, and geometric interpretation

The practical realization of the two axes relies on benchmark design and normalized scoring. The \(\mathrm{gmmlu}\) benchmark contains approximately \(14\)K multiple-choice questions in six non-English languages: es, id, ko, el, zh, and ar. The localization benchmark, \(\mathrm{blend}\)-decon, contains \(20\)K culturally-adaptive questions per language and is created by stripping explicit location cues such as “in Greece” and requiring the model to infer them from the language. For each question, the log-likelihood of each multiple-choice option is computed, the \(\arg\max\) is selected, and accuracy is defined as the fraction correct. The reported quantity for each benchmark is normalized as
\[
\Delta_B(M)=Acc(M;B)-Acc(M_0;B),
\]
so that the unaligned baseline lies at the common origin \((0,0)\) [2510.26024].

The geometry of the plane is integral to its interpretation. The horizontal axis places \(\DeltaLocalize\) from more erasure on the left to better localization on the right, while the vertical axis places \(\DeltaTransfer\) from worse transfer below to better transfer above. The upper-left quadrant is identified as the “undesirable quadrant,” because it corresponds to positive transfer obtained at the cost of cultural erasure. The upper-right quadrant is the “ideal quadrant,” because it corresponds to simultaneous improvement on both axes. A scatter plot can contain one point per model-language pair or an average across languages, which makes the plane a visual proxy for a Pareto frontier of alignment methods [2510.26024].

A common misconception is that better cross-lingual alignment should register as unambiguously better multilingual behavior. The plane is constructed precisely to test that assumption. By separating universal factual transfer from culturally adaptive performance, it reveals that representational convergence and culturally appropriate divergence need not move together.

## 3. Empirical trade-off frontier

When four representative cross-lingual alignment methods are evaluated—Multilingual Instruction Tuning (\(\mathrm{mist}\)), Middle-Layer Alignment (\(\mathrm{midalign}\)), Cross-Lingual Optimization (\(\mathrm{clo}\)), and English Steering (\(\mathrm{en}\))—all four produce positive \(\DeltaTransfer\) on \(\mathrm{gmmlu}\) across all six languages, and all four produce negative \(\DeltaLocalize\) on \(\mathrm{blend}\), indicating cultural erasure [2510.26024].

| Method | \(\DeltaTransfer\) on gmmlu | \(\DeltaLocalize\) on blend |
|---|---:|---:|
| mist | \(\simeq +0.9\%\) | \(\simeq -0.8\%\) |
| midalign | \(\simeq +2.3\%\) | \(\simeq -2.9\%\) |
| clo | \(\simeq +1.9\%\) | \(\simeq -3.4\%\) |
| en | \(\simeq +0.3\%\) | \(\simeq -1.4\%\) |

The dominant empirical pattern is a trade-off frontier: stronger gains in factual transfer coincide with larger drops in localization. \(\mathrm{midalign}\) provides the largest transfer gain, at approximately \(+2.3\%\), but also incurs a localization drop of approximately \(-2.9\%\). \(\mathrm{clo}\) produces the most severe erasure, approximately \(-3.4\%\), while still increasing transfer by approximately \(+1.9\%\). Even English Steering, which yields the smallest transfer gain at approximately \(+0.3\%\), still hurts localization by approximately \(-1.4\%\). None of the post-training alignment techniques enters the upper-right quadrant [2510.26024].

This finding has two implications. First, factual transfer alone is an incomplete summary statistic for multilingual quality. Second, the plane operationalizes “cultural erasure” as a measurable regression rather than a qualitative concern. The framework therefore shifts evaluation from single-objective optimization to explicitly multi-objective diagnosis.

## 4. Layer-wise structure of transfer and localization

The plane is complemented by an internal-representation analysis that examines where in the network universal and culturally specific information are most steerable. The reported analyses include PCA on hidden activations at layers \(20\), \(28\), and \(47\) for both \(\mathrm{gmmlu}\) and \(\mathrm{blend}\) inputs, together with angular alignment analyses of an English-steering vector \(v_{\mathrm{en}}^\ell\) and a localization vector \(v_{\mathrm{loc}}^\ell\). The key observations are that representations for universal factual questions converge early and peak around middle layers, approximately \(\ell\approx 20\); representations for cultural questions remain language-specific through the middle layers and merge only in deeper layers, for \(\ell>28\); and \(v_{\mathrm{en}}^\ell\) and \(v_{\mathrm{loc}}^\ell\) are nearly parallel in shallow layers, \(\ell<20\), but become almost orthogonal around \(\ell\approx 28\) [2510.26024].

Two concrete vector constructions are specified. For a small set \(S\) of English–nonEnglish parallel prompts \((x_{\mathrm{en}},x_{\mathrm{xx}})\), the English steering vector at layer \(\ell\) is
\[
v_{\mathrm{en}}^\ell=\frac{1}{|S|}\sum_{(x_{\mathrm{en}},x_{\mathrm{xx}})\in S}\left[h^\ell(x_{\mathrm{en}})-h^\ell(x_{\mathrm{xx}})\right],
\]
and the steered activation is
\[
\tilde h^\ell(x)=h^\ell(x)+\gamma\cdot v_{\mathrm{en}}^\ell.
\]
Analogously, from pairs of de-contextualized and original culturally specific prompts \((x_{\mathrm{decon}},x_{\mathrm{con}})\), the localization vector is
\[
v_{\mathrm{loc}}^\ell=\frac{1}{|S'|}\sum_{(x_{\mathrm{con}},x_{\mathrm{decon}})\in S'}\left[h^\ell(x_{\mathrm{con}})-h^\ell(x_{\mathrm{decon}})\right],
\]
with the same additive steering rule \(\tilde h^\ell(x)=h^\ell(x)+\gamma\cdot v_{\mathrm{loc}}^\ell\). The paper also specifies a Mid-Layer Representation Alignment loss at layer \(\ell\),
\[
L_{\mathrm{midalign}}
=
-\log
\left[
\frac{\exp(\cos(h_{\mathrm{src}}^\ell,h_{\mathrm{tgt}}^\ell))}
{\sum_{b\in B}\exp(\cos(h_{\mathrm{src}}^\ell,h_b^\ell))}
\right].
\]

The principal interpretive result is that universal factual transfer and culturally situated knowledge are optimally steerable at different depths. Layer-wise steering experiments confirm that applying \(v_{\mathrm{en}}\) at \(\ell=20\) maximizes \(\DeltaTransfer\) with minimal side effect on \(\DeltaLocalize\), whereas applying \(v_{\mathrm{loc}}\) at \(\ell=28\) maximizes \(\DeltaLocalize\) without destroying \(\DeltaTransfer\) [2510.26024].

## 5. Surgical Steering and controlled motion on the plane

The layer-wise analysis motivates a two-stage inference-time intervention called “Surgical Steering.” For each layer \(\ell\in\{1,\dots,L\}\),
\[
h'^\ell(x)=
\begin{cases}
h^\ell(x)+\gamma\cdot v_{\mathrm{en}}^\ell & \text{if } \ell=\ell_{\mathrm{en}},\\
h^\ell(x)+\gamma\cdot v_{\mathrm{loc}}^\ell & \text{if } \ell=\ell_{\mathrm{loc}},\\
h^\ell(x) & \text{otherwise},
\end{cases}
\]
with \(\ell_{\mathrm{en}}=20\) and \(\ell_{\mathrm{loc}}=28\). The stated purpose of this targeted addition is to push a model simultaneously upward and rightward on the Transfer-Localization Plane by improving transfer at a middle layer and localization at a deeper layer [2510.26024].

The reported effect on the \(\mathrm{mist}\)-aligned model is an increase of approximately \(+0.3\%\) in \(\DeltaTransfer\) and approximately \(+7.5\%\) in \(\DeltaLocalize\) relative to \(\mathrm{mist}\) alone, moving the model from the undesirable quadrant into the top-right. Even heavily aligned models such as \(\mathrm{midalign}\) and \(\mathrm{clo}\) remain partially steerable: applying Surgical Steering to them yields non-zero gains on both axes, although smaller than on unaligned or lightly aligned models [2510.26024].

Within the logic of the plane, Surgical Steering is significant because it converts the plane from a passive evaluation device into an intervention space. The coordinates are no longer merely diagnostic; they become steerable targets. This does not remove the underlying trade-off, but it shows that the trade-off is not rigid across all layers of the network.

## 6. Related uses in transport and localization physics

A distinct but conceptually related use of the transfer-localization idea appears in transfer-tensor analyses of disordered quantum systems. In the Anderson and Aubry–André–Harper models, transfer tensors \(T(l)\) are defined recursively from disorder-averaged dynamical maps and yield a discrete-time propagation with memory,
\[
\rho(k)=\sum_{l=1}^{K}T(l)\rho(k-l).
\]
The central result is that ensemble averaging over static disorder produces non-Markovian memory effects even when each disorder realization is Markovian. Memory is required to cancel fictitious cross-terms that would correspond to re-drawing disorder at every time step, namely temporally uncorrelated dynamic disorder. In this setting, a “transfer–localization plane” is constructed with disorder strength on the horizontal axis and cumulative outgoing pseudoflux \(F_m(\infty)\), or equivalently the effective spectral radius of the cumulative transfer-tensor map \(\mathbb{T}(\infty)=\sum_{l=1}^{\infty}T(l)\), on the vertical axis. A boundary curve \(F_m(\infty)=F_c\) sharply separates localized and extended regions [2509.21374].

The outgoing pseudoflux is defined from population-sector tensor elements by
\[
f_m(l)=\sum_{n\neq m}T_{n,n;m,m}(l), \qquad
F_m(k)=\sum_{l=1}^{k}f_m(l).
\]
In the Anderson model, as static disorder \(\sigma\) increases, \(F_m(\infty)\) first increases and then decreases when localization becomes strong. In the Aubry–André–Harper model, \(\|T(l)\|\to \mathrm{const}\) for all \(\lambda\), but \(F_m(\infty)\) shows a sharp transition at \(\lambda=2V\): for \(\lambda<2V\), \(F_m(\infty)>0\); for \(\lambda>2V\), one finds after a finite cutoff \(k_c\) that \(f_m(l>k_c)=0\), so no outgoing flux appears beyond \(k_c\). The paper therefore concludes that eternal memory is necessary for localization but not sufficient [2509.21374].

An earlier nanoring study uses the phrase more heuristically. There, one may imagine a two-dimensional parameter plane spanned by a localization measure such as ASS–IPR or steady-state \(L_c\), and a transfer-efficiency measure such as \(P_{\rm sink}\) or \(L_s\). The system then occupies qualitative quadrants such as high transfer/low localization or low transfer/high localization as disorder \(\sigma\) and exciton–phonon coupling \(S\) vary. The paper identifies an optimal band near \(S\approx 0.5\) and \(\sigma/J\lesssim 0.6\), whereas strong disorder or strong coupling leads to poor transfer and stronger localization [1707.01390].

These physical constructions are not identical to the multilingual LLM plane. The former are disorder- or coupling-dependent transport diagrams, while the latter is a benchmark-normalized intervention space. The shared structure is the simultaneous treatment of a propagation-oriented quantity and a localization-oriented quantity within one coordinate system.

## 7. Terminological heterogeneity and adjacent usages

The phrase “transfer-localization” also appears in applied localization research with different semantics. In supervised sound-source localization, the direct-path relative transfer function is defined as
\[
d_k=\frac{b_{0,k}}{a_{0,k}},
\]
estimated from noisy and reverberant microphone signals via auto- and cross-power spectral densities under a convolutive transfer function approximation, and concatenated across frequencies into a feature vector for localization. The summary describes this pipeline as forming the desired “transfer–localization” plane, but the actual construction is a high-dimensional feature-to-direction mapping rather than the two-dimensional \((\DeltaLocalize,\DeltaTransfer)\) plane used in multilingual evaluation [1509.03205].

A different use appears in WiFi indoor localization through deep transfer learning. There, the model ingests CSI tensors of shape \((75,30,6)\), achieves mean localization errors of \(0.4655\) m in an office with no obstacles, \(0.5830\) m in an office with obstacles, and \(1.0279\) m in a sports hall, and evaluates transfer by freezing layers \(1\) through \(19\) and retraining only the fully connected block. That protocol saves approximately \(60\%\) of the model parameters from retraining, reduces training time by more than half, and requires only \(55\%\) of the new-environment training data to recover baseline accuracy [2103.05123]. Here “transfer” denotes cross-environment reuse of learned features, while “localization” denotes coordinate regression.

Taken together, these usages show that “Transfer-Localization Plane” is not yet a domain-invariant technical term. Its most rigorous and explicit mathematical formulation in the provided literature is the multilingual LLM framework that plots \(\DeltaLocalize\) against \(\DeltaTransfer\) to quantify the balance between factual transfer and cultural erasure [2510.26024]. In neighboring literatures, the phrase or its components name related but non-identical constructs: transport-versus-localization phase diagrams in disordered systems, acoustic transfer-function features for source localization, and transfer-learning protocols for localization models. The term therefore refers less to a single universal formalism than to a recurring strategy: representing transfer and localization jointly so that hidden trade-offs become observable.

Source: https://www.emergentmind.com/topics/transfer-localization-plane