--- title: 'ValueLocate: Neuron-Level Value Alignment' url: https://www.emergentmind.com/topics/valuelocate-framework type: topic --- # ValueLocate: Neuron-Level Value Alignment ValueLocate is a mechanistic interpretability framework designed to uncover and causally probe value representations within large language models (LLMs). It operationalizes psychological value theory, specifically the Schwartz Values Survey, to localize and manipulate “value neurons” through a taxonomy-driven dataset and a contrastive activation methodology. The framework’s principal contribution is a reproducible pipeline for linking internal activation dynamics to explicit value-laden behavior, advancing foundations for neural-level value alignment in LLMs [2505.17712]. ## 1. Motivation and Theoretical Foundations Mechanistic interpretability (MI) aims to reverse-engineer neural computations by mapping abstract behaviors to human-interpretable model components (e.g., neurons, FFN subunits, attention heads). Standard value alignment protocols in LLMs, such as reinforcement learning from human feedback (RLHF), ensure compliance at the output level but do not elucidate where or how values are structurally encoded. ValueLocate addresses this opacity by reframing value alignment as a question of causally identifiable neural activity. It grounds this approach in Schwartz’s value pairs (e.g., Conservation vs. its antithesis), leveraging the observation that neuron activations can systematically differ based on prompts targeting opposing value aspects. Through this differential analysis, ValueLocate identifies neurons whose activation state reliably tracks—and shapes—the model’s value-laden outputs [2505.17712]. ## 2. ValueInsight Dataset Construction ValueLocate’s interpretability protocol depends critically on ValueInsight, a generative dataset inspired by the four higher-order dimensions of the Schwartz Values Survey: Openness to Change, Self-Transcendence, Conservation, and Self-Enhancement. Each dimension decomposes via a hierarchy Γ = (D, S, A), where D is dimension, S is subvalue, and A is atomic value. For comprehensive coverage: - Each (subvalue, atomic value) and its antonym are instantiated through GPT-4o-generated second-person narratives (≥50 words), producing 80 positive and 80 negative descriptions per atomic value, yielding a total of 640 descriptions. - Real-world situational questions (~15,000 in total) are crafted by pairing each atomic value with a bank of common topics (e.g., family, environment) and prompting GPT-4o to generate neutral, complex dilemmas. - The dataset thus systematically samples both poles of value dimensions, enabling contrasting prompts to expose activation differences in LLMs [2505.17712]. ## 3. Value Neuron Identification via Activation Difference The core identification method exploits the architecture of transformer FFNs. At each layer $\ell$ and position $i$, the residual update is $h_i^\ell = h_i^{\ell-1} + A_i^\ell + F_i^\ell$, with $F_i^\ell = W_2^\ell \sigma(W_1^\ell(h_i^{\ell-1} + A_i^\ell))$. A neuron $k$ in layer $\ell$ is indexed as (row $k$ of $W_1^\ell$, column $k$ of $W_2^\ell$). Neuron activation is measured by summing the nonlinear activations $\sigma(u_{i,k}^\ell)$ across all prompt tokens: $m_k^\ell(x) = \sum_{i=1}^{T} \sigma(u_{i, k}^\ell)$, where $u_{i, k}^\ell = W_{1, k}^\ell \cdot (h_i^{\ell-1} + A_i^\ell)$ for prompt $x$ of length $T$. The activation probability for neuron $k$ is defined over $N$ prompts as $p_k^\ell = (1/N)\sum I[m_k^\ell(x) > 0]$. Crucially, ValueLocate operationalizes contrast: for each value dimension, prompts are separated into positive and reversed (negative) sets. The activation difference $$\delta_k^\ell = p_k^{\ell,+} - p_k^{\ell,-}$$ (Equation 5 in source) quantifies the specificity of each neuron to a given value pole. Pseudocode for $\Delta A$ computation is provided as follows: ``` Input: Model M, layer ℓ, neurons K, value‐description prompts P⁺, P⁻ Output: activation differences δ[1..K] For each neuron k in 1..K: count_pos = 0 count_neg = 0 For each prompt x in P⁺: compute m = sum_i σ(W₁[k] · (h_{i}^{ℓ-1}+A_{i}^{ℓ})) if m > 0 then count_pos++ For each prompt x in P⁻: compute m likewise if m > 0 then count_neg++ p⁺ = count_pos / |P⁺| p⁻ = count_neg / |P⁻| δ[k] = p⁺ – p⁻ Return δ ``` [2505.17712]. ## 4. Differentiable Localization of Value-Critical Neurons Neuron selection eschews computationally intensive backpropagation-based attribution, relying exclusively on forward-pass activations and a fixed thresholding rule. For each value dimension: - Two prompt sets ($P^+$ and $P^-$) are compiled. - All prompts are passed through the model, logging $m_k^\ell$ for every neuron. - Thresholding $\delta_k^\ell$ at $\tau=0.03$ distinguishes neurons: $\delta_k^\ell \geq \tau$ as positive-pole neurons, $\delta_k^\ell \leq -\tau$ as negative-pole neurons, with the remainder deemed neutral. - The sets $V^+$ and $V^-$ define the dimension-specific value-critical neurons. Fewer than 0.4% of all neurons in mid-layer FFNs (notably around layer 15) are typically value-critical, suggesting a highly sparse coding regime for ethical orientation [2505.17712]. ## 5. Causal Editing and Validation Validation of value-neuron causality is performed via explicit neuron editing. For each neuron $(\ell,k)$: - The edited activation is defined by $$ \alpha_k^\ell = \begin{cases} \min(0, m_k^\ell) & \text{if } \delta \leq -\tau \\ m_k^\ell & \text{if } -\tau < \delta < \tau \\ m_k^\ell \cdot (1 + \gamma \delta) & \text{if } \delta \geq \tau \end{cases} $$ (Equation 6), with dynamic scaling factor $\gamma$ (default $\gamma=2.0$). - Editing can be inverted to push toward either value pole. The evaluation protocol utilizes 100 held-out ValueInsight questions per dimension along with external validation sets (PVQ40, ValueBench). G-EVAL (1–5 scale, LLM-scored)—averaged over 10 random seeds—serves as the principal metric. Baselines include LPIP, QRNCA, and CGVST for neuron identification. The protocol confirms that: - Positive-pole neuron editing increases G-EVAL score for that value; negative-pole editing decreases it. - Random neuron editing (up to 50 neurons) yields no systematic shift ($<$0.05) in G-EVAL. - Monotonic increase in score as $\gamma$ increases (dose–response). - Varying $\tau$ from 1% to 10% reveals a categorical tradeoff; $\tau=3\%$ (“elbow” point) is optimal [2505.17712]. ## 6. Empirical Findings and Observational Insights ### Quantitative Results The following G-EVAL mean $\pm$ std. scores on LLama-3.1-8B after positive editing ($\gamma=2.0$) were observed: | Value Dimension | ValueLocate | Best Baseline (CGVST) | |----------------------|--------------|----------------------| | Openness to Change | 4.68±0.06 | 4.42 | | Self-Transcendence | 4.60±0.05 | 4.25 | | Conservation | 4.15±0.09 | 3.85 | | Self-Enhancement | 4.08±0.06 | 3.88 | - Negative-pole editing produces symmetric G-EVAL drops (e.g., Self-Transcendence drops to $\sim$2.30, baseline $\sim$2.55). - Random neuron editing does not reliably affect value expression. ### Qualitative Observations - Pre-editing responses often straddle both value poles or hedge commitments. - Positive-pole editing yields assertive, value-consistent outputs (“I would definitely prioritize...”, “My top concern is...”). - Negative-pole editing reverses the stance with coherent shifts in rhetorical tone. - Value-critical neurons are functionally concentrated at select FFN mid-layer units; this supports the notion of modular semantic encoding. ## 7. Significance and Limitations ValueLocate establishes a mechanistically transparent pipeline that directly connects psychological value theory to interpretable neural dynamics in transformer LLMs. This enables not only identification but also direct, causal control of LLM value orientation, with empirical validation outperforming alternative neuron discovery regimes on both in-sample and out-of-sample prompts. By demonstrating that targeted neuron editing can predictably modulate value-laden behavior, ValueLocate enhances the tractability of neural value alignment and informs future work on ethical model deployment. A limitation is the reliance on the coverage and specificity of the ValueInsight dataset, and the thresholding strategy ($\tau$) requires use-case tuning, trading off edit magnitude and response quality. The framework avoids attributional complexity but may miss distributed or sub-neuronal value traces. A plausible implication is that such neuron-level analyses could support value auditing or fine-grained model editing beyond behavioral alignment, bridging gaps between psychology-grounded value systems and mechanistic interpretability infrastructure in computational models [2505.17712]. Source: https://www.emergentmind.com/topics/valuelocate-framework