---
title: Monosemanticity Score (MS) in Model Interpretability
url: https://www.emergentmind.com/topics/monosemanticity-score-ms
type: topic
---

# Monosemanticity Score (MS) in Model Interpretability

A Monosemanticity Score (MS) quantifies the degree to which model features (usually neurons, units, or latent dimensions) correspond to single, human-interpretable concepts rather than representing multiple, entangled attributes. Monosemanticity is fundamental in mechanistic interpretability, allowing robust attribution of model behavior to interpretable units, and directly impacts feature disentanglement, sparsity, and model controllability. Several lines of recent research have introduced rigorous metrics and proxies for monosemanticity in linguistic, visual, and multimodal models, tying increased monosemanticity to both improved interpretability and, in some contexts, model capacity or alignment performance.

## 1. Formal Definitions of Monosemanticity

The foundational definition treats a neuron (or latent feature) as monosemantic if it activates only in response to a single, interpretable concept or feature set. Given a partition $\{A_1, \dots, A_m\}$ of input space $X$ (with $A_i \cap A_j = \emptyset$, $\cup_i A_i = X$), neuron $z$ is monosemantic for $A_j$ if:

$$
\forall x \in X, \;\;\text{act}(z, x) = 1 \implies x \in A_j
$$

This is the strongest form of disentanglement at the unit level. Imperfect, “polysemantic” units encode superpositions—mixtures of distinct concepts—which hinders interpretability and direct feature-level intervention [2406.17969].

## 2. Metric Formulations and Proxies

### 2.1 Feature Monosemanticity Score (FMS)

FMS, introduced for latent representations of large language models (LLMs), combines measures of feature-level capacity, local and global disentanglement [2506.19382]:

Let $C$ be a concept set ($|C|$ target concepts). For each $c \in C$:

- $\text{accs}_0^c$ — best single-feature classification accuracy.
- $\text{accs}_{\text{cum}}^c(i)$ — accuracy of a small decision-tree stump of depth $i$ (cumulative capacity).
- $\text{accs}_p^c$ — accuracy after removing $p$ most informative features.

Key subcomponents:
- **Local disentanglement:**
  $$
  \text{FMS}_\text{local}^c@p = 2 \cdot (\text{accs}_0^c - \text{accs}_p^c)
  $$
- **Global disentanglement:**
  $$
  A(n) = \sum_{i=1}^n [\text{accs}_{\text{cum}}^c(i) - \text{accs}_0^c], \quad n: \text{smallest such that } \text{accs}_{\text{cum}}^c(n) \approx 1
  $$
  $$
  \text{FMS}_\text{global}^c = 1 - \frac{A(n)}{n}
  $$
- **Aggregate FMS over all concepts:**
  $$
  \text{FMS}@p = \frac{1}{|C|} \sum_{c \in C} \left[\text{accs}_0^c \cdot \frac{\text{FMS}_\text{local}^c@p + \text{FMS}_\text{global}^c}{2}\right]
  $$

All components are normalized to $[0, 1]$, with higher values indicating greater monosemanticity [2506.19382].

### 2.2 Modality Dominance Score (MDS) as Monosemanticity Score

In multimodal architectures, monosemanticity is operationalized via the Modality Dominance Score (MDS), $R(k)$, for feature $k$ [2502.14888]:

$$
R(k) = \frac{1}{M} \sum_{m=1}^M \frac{|z_{i,m}^{(k)}|}{|z_{i,m}^{(k)}| + |z_{t,m}^{(k)}|}
$$

Where $z_{i,m}^{(k)}$ and $z_{t,m}^{(k)}$ are the $k$-th feature activations for image and text modalities, over $M$ paired samples. $R(k)$ near $1$ indicates image-specificity, near $0$ text-specificity, and near $0.5$ cross-modal entanglement.

### 2.3 Proxies via Feature Correlation and Activation-Variance

Monosemanticity can be tracked via proxies such as:

- **Superposition-decomposition ($b_{in}\|W_{in}\|_2$)**: High values in a specific formula indicate monosemantic basis vectors.
- **Activation-variance:** High variance across samples in a dimension implies sparse, concept-specific firing.
- **Feature decorrelation ($1 - \text{mean}_{i \ne j} C_{ij}$):** Lower pairwise correlation between feature activations across samples implies greater monosemanticity [2406.17969].

## 3. Measurement and Experimental Protocols

Measurement depends on context:

- **SAE/G-SAE Models / Latent Representations:** Compute FMS using a labeled dataset and decision-tree classifiers. Remove features iteratively, record accuracy drops, and aggregate via the FMS formula [2506.19382].
- **Multimodal CLIP-like Models:** Compute MDS per feature over paired image-text activations; threshold feature groups using the empirical mean and standard deviation of $R(k)$ [2502.14888].
- **Correlation/Sparsity Proxies:** For MLP activations $Z \in \mathbb{R}^{N \times d}$, compute
  $$
  C_{ij} = \frac{Z_{:,i} \cdot Z_{:,j}}{\|Z_{:,i}\| \|Z_{:,j}\|}
  $$
  and summarize global monosemanticity as $1 - \text{mean}_{i \ne j} C_{ij}$ [2406.17969].

Supervised or contrastive training can enhance monosemanticity, as shown by Guided SAEs (G-SAE) or feature decorrelation regularizers.

## 4. Empirical Findings and Comparative Analyses

FMS and MDS expose substantial differences in monosemanticity across models and training regimes:

- **G-SAE vs. Vanilla SAE:** G-SAE nearly doubles FMS@1 scores across tasks (0.52 vs. 0.27), indicating more precise isolation of concepts in single latent dimensions [2506.19382].
- **CLIP Variants:** Pure CLIP is skewed toward image-dominant neurons, while monosemanticity-enhancing objectives yield a more balanced distribution between modalities [2502.14888].
- **Feature Decorrelation:** Preference alignment (Direct Preference Optimization, DPO) alone increases monosemanticity proxies; augmenting with a feature decorrelation regularizer (DecPO) further enhances sparsity, diversity, and alignment performance [2406.17969].

| Model/Setting         | Monosemanticity Metric     | Key Empirical Result                                 |
|----------------------|---------------------------|------------------------------------------------------|
| Vanilla SAE          | FMS@1                     | 0.27 (avg), low single-feature purity                |
| G-SAE                | FMS@1                     | 0.52 (avg), strong concept–dimension mapping         |
| CLIP                 | MDS ($R(k)$)              | Most features are image-dominant                     |
| CLIP+SAE / CLIP+NCL  | MDS ($R(k)$)              | More balanced (text-/image-dominant, cross-modal)    |
| DPO/DecPO (Llama-2)  | Corr/Sparsity proxies     | DecPO yields +10–13 alignment points, lower $C_{ij}$ |

The higher FMS/MDS in these settings supports more precise and controllable feature interventions.

## 5. Applications and Interpretability Impact

High monosemanticity, as indexed by MS or FMS, enables:

- **Mechanistic interpretability:** Direct attribution of model decisions to latent features or neurons.
- **Fine-grained control:** Behavioral steering via single-feature interventions without cross-concept leakage.
- **Improved detection:** Cleaner detection of privacy attributes, toxicity, or style.
- **Reliable multimodal attribution:** Disentanglement of image, text, and cross-modal concepts, supporting targeted adversarial robustness and controllable generation tasks [2506.19382, 2502.14888].

Monosemanticity is thus key for auditability in safety-critical applications and in scientific analysis of representation learning.

## 6. Limitations and Research Directions

Classic disentanglement metrics (e.g., $\beta$-VAE, Mutual Information Gap) do not assess whether individual units encode a single concept, and vision-specific metrics fail to generalize to language or multimodal settings [2506.19382]. MS/FMS provides a scalar quantification but may be confounded by hierarchical/subconcept structure (revealed by FMS@$p$ for $p>1$), or by the lack of perfect ground-truth concepts [2502.14888, 2406.17969].

A plausible implication is that further formalization is required to make MS reflect not only local capacity but also true semantic disentanglement, especially in deep or highly overparameterized architectures.

Ongoing research aims to:

- Validate MS/FMS/MDS against human-annotated concept datasets.
- Tie monosemanticity more tightly to generalization and safety properties.
- Develop scalable computation techniques for very large ($>$8B) model architectures [2406.17969].

## 7. Practical Recommendations

- **FMS/MDS should be used as an audit tool prior to deploying single-feature interventions or interpretability claims.**
- **Low FMS indicates concept leakage. One-vector steering or ablation is likely to have unpredictable side effects.**
- **Practical improvement methods:** Guided feature conditioning, decorrelation regularization, and contrastive training on labeled concepts have been empirically shown to increase monosemanticity and downstream performance.
- **Thresholding MDS scores provides automatic grouping of features into modality-specific or cross-modal sets, guiding selective interventions in multimodal networks [2502.14888].**

By delivering quantifiable, interpretable measures of feature purity, monosemanticity scores such as FMS and MDS constitute a core methodology in contemporary mechanistic interpretability and model alignment research [2506.19382, 2406.17969, 2502.14888].

Source: https://www.emergentmind.com/topics/monosemanticity-score-ms