---
title: Manifold Aware Concept Erasure (MANCE)
url: https://www.emergentmind.com/topics/manifold-aware-concept-erasure-mance
type: topic
---

# Manifold Aware Concept Erasure (MANCE)

Searching arXiv for the named paper and closely related concept-erasure work.
I’ll look up MANCE and nearby manifold-aware concept erasure papers on arXiv.
Manifold Aware Concept Erasure (MANCE) is a nonlinear concept erasure method that operationalizes the Manifold Constraint Hypothesis (MCH): if natural representations concentrate on a structured, low-dimensional manifold, then interventions should be constrained to that manifold and better preserve other information encoded in the representation during interventions [2607.03973]. In this formulation, concept erasure is not treated as unconstrained movement in the ambient Euclidean space, but as a locally manifold-constrained update process driven by a classifier for the target concept. MANCE estimates local tangent spaces from natural representations, projects concept-removal updates onto those tangent spaces, and applies a closed-form per-sample step-size cap. The method is evaluated across 119 settings spanning text and vision, and the reported results position MANCE, especially MANCE++, as a state-of-the-art approach to nonlinear concept erasure under leakage--surgicality tradeoffs [2607.03973].

## 1. Conceptual basis and Manifold Constraint Hypothesis

MANCE begins from the observation that learned representations from natural data do not fill out their ambient Euclidean space uniformly, but instead concentrate on a structured, low-dimensional manifold [2607.03973]. Let $\mathcal{M}\subset\mathbb{R}^d$ be the unknown manifold on which natural representations lie. An intervention
$$
x\mapsto x+\delta
$$
is said to be constrained to $\mathcal{M}$ if $x+\delta\in\mathcal{M}$; unconstrained updates allow $\delta$ in any direction in $\mathbb{R}^d$.

MCH states: “Among all interventions that achieve the same effect on the target concept, those constrained to $\mathcal{M}$ will better preserve all other (unlabeled) information encoded in the representation.” This premise defines the core distinction between MANCE and prior full-space nonlinear erasure procedures. In MANCE, the aim is not merely to reduce classifier confidence for the target concept, but to do so while minimizing collateral damage to other information, described in the paper as “surgicality” [2607.03973].

A plausible implication is that MANCE reframes concept erasure from a purely discriminative suppression problem into a geometry-constrained intervention problem. In that reading, the relevant object is not only the probe gradient but also the local geometry of the representation support.

## 2. Nonlinear concept erasure formulation

The method assumes representations $X\in\mathbb{R}^{N\times d}$ and binary labels $y\in\{0,1\}^N$ for the concept to erase [2607.03973]. A standard gradient-based erasure round fits a probe
$$
f:\mathbb{R}^d\to\mathbb{R}
$$
by minimizing a classification loss such as cross-entropy,
$$
L(f;X,y)=\sum_i \ell(f(x_i),y_i).
$$
The probe may be, for example, “a small MLP.”

After fitting the probe, one computes the gradient of the probe’s score for the positive class with respect to the inputs,
$$
\nabla_x f(x_i),
$$
and takes a step
$$
x_i \leftarrow x_i - \lambda\,\mathrm{sign}(\nabla f(x_i))
$$
or more generally
$$
x_i \leftarrow x_i - \lambda\,\bigl(\nabla f(x_i)/\|\nabla f(x_i)\|\bigr)
$$
to reduce the probe’s confidence. The paper states that unconstrained iterative application of such steps, with probe refits, can erase the concept but often damages other information [2607.03973].

MANCE retains the iterative, probe-driven structure of nonlinear erasure, but changes the permissible update directions. Rather than accepting the probe gradient as an update in the full ambient space, it estimates a local tangent space and projects the update there. This suggests that MANCE should be understood as a geometry-constrained generalization of iterative probe-based erasure rather than as a different supervision regime.

## 3. Local manifold estimation and tangent-space projection

To constrain updates to $\mathcal{M}$, MANCE estimates the tangent space $T_x\mathcal{M}$ at each point $x_i$ by sampling its $k$ nearest neighbors from the clean representations $X^{(0)}$ [2607.03973]. For each sample,
$$
N_i = k\mathrm{NN}(x_i;X^{(0)}),\qquad
\bar{x}_i = (1/k)\sum_{j\in N_i}x_j,
$$
and
$$
S_i = [x_j-\bar{x}_i]_{j\in N_i}\in\mathbb{R}^{k\times d}.
$$
An SVD is then computed:
$$
S_i = L_i\,\mathrm{diag}(\sigma_{i,1},\ldots,\sigma_{i,k})\,V_i^\top.
$$
The top-$r$ right singular vectors are retained,
$$
B_i=[v_{i,1},\ldots,v_{i,r}]\in\mathbb{R}^{d\times r},
$$
so that $\mathrm{span}(B_i)\approx T_{x_i}\mathcal{M}$.

Given the normalized probe gradient
$$
u_i=\nabla f(x_i)/\|\nabla f(x_i)\|,
$$
its orthogonal projection onto the estimated tangent space is
$$
\Pi_i u_i = B_iB_i^\top u_i.
$$
The coordinate form used by MANCE is
$$
c_i=B_i^\top u_i,\qquad
d_i=B_i\,\mathrm{diag}(\sigma_i^\alpha)\,c_i,
$$
where $\sigma_i=(\sigma_{i,1},\ldots,\sigma_{i,r})$ and $\alpha\ge 0$ reweights the tangent axes by their local variance support. The reported setting is $\alpha=1$ in all experiments [2607.03973].

The use of local PCA rather than a single global subspace is empirically motivated. For the hardest case, sycophancy, the estimated local intrinsic dimension is 34–53 $(\ll d)$, and the mean angle between local tangent directions and a single global direction is 77°–83°, confirming that a global linear subspace is a poor approximation [2607.03973]. This directly addresses a common misconception: MANCE is not a global linear projection method.

## 4. Update rule, step-size cap, and preprocessing variants

MANCE applies a locality-preserving cap on the step size so that the update norm does not exceed an $\epsilon$-fraction of the average neighbor distance [2607.03973]. For each sample,
$$
r_i=(1/k)\sum_{j\in N_i}\|x_j-x_i\|.
$$
Using the tangent update
$$
x_i' = x_i - \lambda\,\langle x_i,\hat{u}_i\rangle\,\hat{u}_i,
\qquad
\hat{u}_i=d_i/\|d_i\|,
$$
and enforcing $\|x_i'-x_i\|\le \epsilon r_i$, the paper gives the closed-form per-sample step
$$
\lambda_i=\min\!\Bigl(\lambda_{\max},\;\frac{\epsilon\,r_i}{|\langle x_i,\hat{u}_i\rangle|}\Bigr).
$$
The iterative loop initializes $X^{(0)}$ from natural inputs, periodically refits the probe every $\tau$ steps, recomputes the local neighborhood geometry, forms tangent-projected directions, and updates each $x_i$ accordingly [2607.03973].

The framework also includes two preprocessing variants that prepend closed-form erasure before the manifold-constrained loop:

| Variant | Prepending step | Description |
|---|---|---|
| MANCE | None | Tangent-projected nonlinear erasure |
| MANCE$^+$ | LEACE | One-shot linear erasure removing the class-mean shift |
| MANCE$^{++}$ | LEACE + CovMatch | Affine projections of total rank $\le 3$ before MANCE |

MANCE$^+$ prepends the one-shot LEACE linear erasure, which removes the class-mean shift in closed form. MANCE$^{++}$ further prepends a rank-2 “CovMatch” projection that aligns class-conditional second moments by removing the top two eigenvectors of $\Sigma_+ - \Sigma_-$. Both steps are affine projections of total rank $\le 3$, after which the residual nonlinear pocket is erased by the MANCE loop [2607.03973].

A common misunderstanding is that MANCE’s gains might come only from adding nonlinear iterations after a strong linear preprocessor. The reported ablation “AmbCE$^{++}$” replaces the tangent-projection update by full-space gradient steps of the same mean magnitude $(\bar{\lambda}\approx 29.3)$. Without the manifold constraint it leaves 6–10 pp leakage and often exceeds the surgicality budget, showing that the key gain comes from the tangent-projection, not merely from the nonlinear probe loop or closed-form preprocessing [2607.03973].

## 5. Evaluation protocol and empirical results

The experimental program spans both language and vision [2607.03973]. In text, the paper reports 119 panels comprising 13 open-source LLM families (0.5B–27B parameters) $\times$ 3 binary concepts (sycophancy, gender, safety) evaluated at the 50%-depth layer, with control concepts answer-preference, profession, helpfulness. In vision, it reports 80 panels using CLIP ViT-B/32 pooled embeddings of CelebA images; 40 binary facial attributes are evaluated under two surgicality regimes, defined by the 5 least- versus 5 most-correlated control attributes.

The main metrics are target leakage and surgicality. Target leakage $S$ is the accuracy of a retrained nonlinear MLP probe (2-layer, $h = 128$) on the erased representations; $D_S = S - S_{\mathrm{floor}}$ measures residual concept signal above chance. Surgicality $\Delta Y$ is the drop in accuracy on control concepts; the budget $D_Y = \max(0,-\Delta Y)$ is capped at 1, 3, 5, 10 pp. Coverage is the number of panels with at least one trajectory step satisfying $D_Y\le \mathrm{budget}$ [2607.03973].

The reported quantitative findings emphasize matched-budget comparisons. Applying MANCE on top of prior erasers (INLP, IGBP, LEACE, Obliviator) consistently reduces leakage at matched surgicality budgets. On the 39-panel NLP grid under $D_Y\le 1$ pp, LEACE alone has +19.1 pp leakage and +MANCE reduces this to +1.5 pp while covering 38/39 panels; INLP changes from +15.2 to +1.8; IGBP from +11.5 to +1.6; Obliviator had zero leakage but only 13/39 coverage [2607.03973].

MANCE$^{++}$ is reported as the strongest nonlinear eraser. On NLP at $D_Y\le 3$ pp it drives leakage to 0.0 pp and reaches chance on 32/37 panels; at $D_Y\le 10$ pp it stays at 0.0 pp on 35/39. In vision, under least-correlated controls, MANCE$^{++}$ covers 35/39 attributes at $\le 1$ pp with +0.7 pp leakage, and 40/40 at $\le 5$ pp with 0.0 pp. Under most-correlated controls, MANCE$^{++}$ still covers 15/19 at $\le 1$ pp and 33/38 at $\le 5$ pp with +2.5 pp leakage. Obliviator attains near-floor leakage only at far lower coverage on the hardest attributes [2607.03973].

These results support the paper’s conclusion that MANCE and its MANCE$^{++}$ variant achieve state-of-the-art nonlinear concept erasure: near-chance leakage under tight surgicality budgets and high coverage even on the most entangled controls [2607.03973].

## 6. Position within manifold-aware erasure research

MANCE belongs to a broader 2026 trend toward manifold-aware concept erasure, but its formulation is distinct from other methods using related language. OrthoEraser, for example, addresses text-to-image safety in diffusion models by reframing concept erasure as a manifold-aware projection problem at an intervention layer [2603.11493]. It uses sparse autoencoders to decompose dense activations, detects coupled benign neurons by zero-ablation, and applies an analytical gradient orthogonalization strategy that projects erasure vectors onto the null space of the coupled neurons. The erasure objective is
$$
d^*=\arg\min_{d\in\mathbb{R}^d}\;\tfrac12\|d-d_{\mathrm{raw}}\|_2^2
\quad\text{s.t.}\quad
U^\top d=0,
$$
so that subtracting $d^*$ guarantees $U^\top(h-d^*)=U^\top h$, i.e. the benign subspace is exactly invariant [2603.11493].

The contrast is instructive. OrthoEraser preserves a critical benign subspace through an analytical orthogonal projection, whereas MANCE preserves information by estimating local tangent spaces from natural representations and constraining iterative nonlinear updates to those spaces. This suggests two different senses of “manifold-aware”: one based on local manifold estimation in representation space, and one based on subspace-preserving projection after disentanglement [2607.03973; 2603.11493].

A further source of terminological ambiguity appears in text-to-image erasure work that uses the phrase “manifold aware concept erasure” in a different construction. TICoE defines a continuous convex concept manifold
$$
M_c=\Bigl\{\,e_c=\sum_{i=1}^N w_i e_i\;\Big|\;w_i\ge 0,\;\sum_{i=1}^N w_i = 1\Bigr\},
$$
built from prompt-bank embeddings, and combines it with Hierarchical Visual Representation Learning for precise concept removal in diffusion models [2604.15829]. In that setting, the “manifold” is a convex semantic hull in text-embedding space rather than an estimated local tangent structure over natural hidden representations.

Taken together, these works indicate that manifold-aware erasure is not a single algorithmic family but a broader design principle: constrain erasure to geometrically structured regions associated with natural or benign variation. In the specific sense established by MANCE, the central claim is narrower and more technical: interventions should be constrained to the natural representation manifold, and local tangent-projected updates provide a practical mechanism for doing so [2607.03973].

Source: https://www.emergentmind.com/topics/manifold-aware-concept-erasure-mance