---
title: 'AdaPert: Perturbation-Conditioned Transcriptional Predictor'
url: https://www.emergentmind.com/topics/adapert
type: topic
---

# AdaPert: Perturbation-Conditioned Transcriptional Predictor

AdaPert is a perturbation-conditioned, knowledge-guided framework for predicting high-dimensional transcriptional responses to genetic interventions while avoiding a pervasive failure mode known as mean collapse. In the formulation used by the method, a control gene-expression profile for a single cell, $X^c \in \mathbb{R}^N$, and a candidate perturbation gene $p \in K$ are mapped to a predicted post-perturbation profile $\hat X^p \in \mathbb{R}^N$ via $F:(X^c,p)\rightarrow \hat X^p$. AdaPert addresses the observation that single-cell perturbation effects are sparse, noisy, and often poorly captured by objectives that emphasize global reconstruction. Its central design couples perturbation-specific subgraph learning on a biological knowledge graph with DEG-aware objectives that explicitly separate responsive signal from non-responsive background [2602.18885].

## 1. Problem formulation and the mean-collapse failure mode

AdaPert is defined for the task of predicting the transcriptional response of a single cell after a genetic perturbation. The standard template described in the paper is a conditional autoencoder:
$$
z_c = ENC_\theta(X^c), \qquad z_p = GNN(G,p), \qquad \hat X^p = DEC_\phi(z_c, z_p),
$$
trained with an MSE reconstruction objective $L(X^p,\hat X^p)$. In this setting, $z_c$ encodes the control state, while $z_p$ represents the perturbation.

The motivation for AdaPert is the mismatch between this training objective and the statistical structure of perturbation responses. Let $D(p)$ denote the set of differentially expressed genes (DEGs) under perturbation $p$ and $\bar D(p)$ its complement, with $|D(p)| \ll |\bar D(p)|$. The reconstruction loss decomposes into contributions from responsive genes and non-responsive genes:
$$
L_{rec}
=
\underbrace{\sum_{i \in D(p)} (\hat X^p_i - X^p_i)^2}_{\text{responsive genes}}
+
\underbrace{\sum_{i \in \bar D(p)} (\hat X^p_i - X^p_i)^2}_{\text{non-responsive genes}}.
$$
Because the non-DEG term dominates, pure MSE training prioritizes minimizing errors where the ground-truth effect is near zero. The paper characterizes the resulting behavior as mean collapse: predictions shrink toward global averages, yielding high global correlations while systematically underestimating large, perturbation-specific effects. In the reported interpretation, this produces many false positives and poor interpretability rather than faithful recovery of sparse transcriptional changes [2602.18885].

This framing places AdaPert in direct opposition to models that optimize only aggregate similarity. A plausible implication is that conventional global metrics can obscure failure precisely where perturbation biology is most informative: in the signed, sparse, high-effect tail of the response distribution.

## 2. Perturbation-conditioned subgraph learning on biological knowledge graphs

AdaPert uses a biological knowledge graph $G=(V,E)$ in which nodes are genes or proteins and edges represent interactions or functional relationships. The experiments use STRING PPI networks aligned to highly variable genes (HVGs). The raw STRING v11.5 graph has 18,382 nodes and 11,257,696 edges, with average degree approximately 1,225. An HVG-filtered example has 4,509 nodes and 1,090,554 edges, with average degree approximately 484. Top-$k$ filtering further reduces density: Top-20 yields 89,793 edges with average degree approximately 40, and Top-10 yields 45,013 edges with average degree approximately 20. These statistics motivate localized modeling rather than dense, static propagation.

Instead of embedding the perturbation by message passing over the full graph, AdaPert extracts a sparse perturbation-specific node-induced subgraph $G_p$ centered on the perturbed gene. The method combines structural and semantic information. Structural embeddings are obtained from mean-aggregation message passing:
$$
h_v^{(0)} = x_v,
\qquad
h_v^{(l+1)} = \sum_{u \in N(v)} \frac{1}{|N(v)|} W^{(l)} h_u^{(l)},
$$
with $h_v = h_v^{(L)} \in \mathbb{R}^{d_s}$ after $L$ layers. The perturbation gene also receives a semantic embedding from text,
$$
s_p = LM(desc(p)), \qquad \tilde z^s_p = W_s s_p,
$$
which is concatenated with node structure:
$$
c_v = [h_v \parallel \tilde z^s_p].
$$

Node relevance is scored by
$$
a_v = w^\top \sigma(W_c c_v),
\qquad
\alpha_v = \frac{\exp(a_v)}{\sum_{u \in V}\exp(a_u)}.
$$
AdaPert then applies differentiable sparse sampling through Gumbel-Softmax:
$$
\tilde \alpha_v =
\frac{\exp((\log \alpha_v + g_v)/\tau)}
{\sum_{u \in V}\exp((\log \alpha_u + g_u)/\tau)},
\qquad g_v \sim \text{Gumbel}(0,1),
$$
and selects nodes with $\tilde \alpha_v > T$ to form $G_p$. The perturbation context representation is the sum of selected node embeddings:
$$
z_{context} = \sum_{v \in V(G_p)} h_v.
$$

The paper emphasizes two properties of this construction. Sparsity is enforced by thresholding Gumbel-Softmax scores, yielding small condition-dependent subgraphs and reducing noise propagation. Adaptivity arises because node selection depends on the perturbation through $\tilde z^s_p$, and because the learned subgraph representation is aligned during training with perturbation-specific DEG signals. In this sense, the graph is not treated as a fixed propagation substrate; it is filtered into a perturbation-conditioned context representation [2602.18885].

## 3. Architecture, forward pass, and anti-collapse objectives

AdaPert retains the conditional autoencoder template, but replaces a dense global graph embedding with the perturbation-conditioned subgraph context. The control state is encoded as $z_c = ENC_\theta(X^c)$ using an MLP/transformer-like encoder, and the predicted perturbed profile is generated as $\hat X^p = DEC_\phi(z_c, z_{context})$. The forward pass is described as five steps: compute $z_c$; compute graph structural embeddings $h_v$ and semantic perturbation embeddings $s_p$; score and sparsely sample nodes to build $G_p$; aggregate selected nodes into $z_{context}$; and decode the perturbed profile.

The anti-mean-collapse strategy is implemented through DEG-aware training. For each perturbation $p$, the response is defined as $\Delta X^p = X^p - X^c$. Statistical tests yield $q_i^{(p)}$, and the DEG partition is
$$
D(p)=\{i \mid q_i^{(p)} < 0.05\},
\qquad
\bar D(p)=\{i \mid q_i^{(p)} \ge 0.05\}.
$$
The global reconstruction term is
$$
L_{recon} = \mathbb{E}[\|\hat X^p - X^p\|_2^2].
$$

To suppress spurious changes on background genes, AdaPert adds a non-DEG robust loss on predicted response $\Delta \hat X^p = \hat X^p - X^c$:
$$
L_{non}
=
\mathbb{E}_p
\left[
\sum_{i \in \bar D(p)}
\rho_\delta(\Delta \hat X^p_i)
\right],
$$
where $\rho_\delta$ is the Huber loss and $\delta$ is set proportional to the empirical standard deviation of non-DEG effects. The stated role of this term is to suppress small spurious deviations strongly while preventing large noisy residuals from dominating.

A second term aligns the learned subgraph representation with a response-driven target. The target masks non-DEGs and preserves signed effects:
$$
y^{(p)}_i =
\begin{cases}
\Delta X^p_i, & i \in D(p),\\
0, & i \in \bar D(p).
\end{cases}
$$
A learnable head $g(\cdot)$ projects this target to $t^{(p)} = g(y^{(p)}) \in \mathbb{R}^d$, and the alignment loss is
$$
L_{align}
=
\mathbb{E}
\left[
\left\|
\frac{z_{context}^{(p)}}{\|z_{context}^{(p)}\|_2}
-
\frac{t^{(p)}}{\|t^{(p)}\|_2}
\right\|_2^2
\right].
$$
The total objective is
$$
L_{total} = L_{recon} + \lambda_{non} L_{non} + \lambda_{align} L_{align}.
$$

The paper reports that subgraph selection is trained end-to-end using Gumbel-Softmax continuous relaxation, with $\tau$ controlling exploration-exploitation and threshold $T$ enforcing sparsity. It further analyzes $\lambda_{non}$: small/medium-effect perturbations benefit from larger $\lambda_{non}$, up to approximately $0.01$, whereas large-effect settings need smaller $\lambda_{non}$. Excessively large $\lambda_{non}$, for example $0.1$, over-suppresses signal. This establishes AdaPert as a model that does not merely regularize predictions; it regularizes specifically against background hallucination while constraining the perturbation context to encode DEG-relevant structure [2602.18885].

## 4. Evaluation protocol, benchmarks, and metrics

AdaPert is evaluated on single-cell CRISPR Perturb-seq datasets from Replogle et al.: K562.Replogle and RPE1.Replogle. Both use unseen perturbation splits, with train/validation/test defined by perturbation identity. The reported statistics are: K562 with Train 111,770 cells / 734 perturbations / 5,000 HVGs, Val 10,918 / 82, and Test 38,475 / 272; RPE1 with Train 74,474 / 771 / 3,352, Val 26,073 / 308, and Test 50,593 / 464. Perturbations are stratified by DEG proportion into small $(<5\%)$, medium $(5$–$10\%)$, and large $(>10\%)$ effect-size regimes.

The baselines are divided into graph-free methods—scVI, CPA, STATE—and graph-based methods—GEARS, TxPert, MORPH. All are trained under identical splits and protocols, and metrics are computed with cell-eval.

The evaluation protocol is explicitly DEG-aware. Global response is defined by $\Delta X^p = X^p - X^c$ and predicted response by $\Delta \hat X^p = \hat X^p - X^c$. The global metrics are Pearson-$\Delta$,
$$
\text{Pearson-}\Delta = corr(\Delta \hat X^p,\Delta X^p),
$$
and Perturbation Discrimination Score (PDS), defined from $L_1$ distances to held-out perturbation effects. DEG-aware metrics are DES, DE-Spearman on significant genes, LFC-weighted DE-Spearman, and DE Direction Match. The paper’s stated reason for emphasizing these metrics is that mean collapse can inflate global correlation by matching the center of the effect distribution while missing strong perturbation-specific responses. In that interpretation, improvements on DES and DEG-restricted correlations are more probative of biologically meaningful recovery than improvements in aggregate reconstruction alone [2602.18885].

## 5. Empirical performance and biological interpretability

On K562, AdaPert achieves the best reported global results among all compared methods: Pearson-$\Delta$ $0.619 \pm 0.262$ and PDS $0.711 \pm 0.296$. The strongest baseline on Pearson-$\Delta$ is TxPert at $0.580 \pm 0.255$, and the strongest baseline on PDS is also TxPert at $0.665 \pm 0.310$. On RPE1, AdaPert attains the best reported Pearson-$\Delta$, $0.674 \pm 0.291$, with PDS $0.663 \pm 0.281$; MORPH has the best baseline PDS at $0.688 \pm 0.268$, while TxPert has Pearson-$\Delta$ $0.655 \pm 0.300$.

The DEG-aware results are more pronounced. On K562, AdaPert reports DES@50 $0.263 \pm 0.190$, DES@100 $0.252 \pm 0.182$, DE-Spearman(sig) $0.622$, DE-Spearman(lfc-sig) $0.688 \pm 0.240$, and Direction-match $0.867 \pm 0.141$, which the paper identifies as best across all compared methods. On RPE1, AdaPert reports DES@50 $0.244$, DES@100 $0.320$, DE-Spearman(sig) $0.267$, DE-Spearman(lfc) $0.729$, and Direction-match $0.870$, again described as best overall.

The effect-size analysis on K562 compares AdaPert against TxPert and is explicitly framed as a mean-collapse sensitivity study. For small perturbations $(<5\% \text{ DEGs})$, AdaPert yields Pearson-$\Delta$ $0.462$ versus $0.457$ and DES $0.115$ versus $0.090$, with PDS approximately similar. For medium perturbations $(5$–$10\%)$, it yields Pearson-$\Delta$ $0.623$ versus $0.541$, DES $0.222$ versus $0.173$, and PDS $0.740$ versus $0.663$. For large perturbations $(>10\%)$, it yields Pearson-$\Delta$ $0.771$ versus $0.741$, DES $0.420$ versus $0.353$, and PDS $0.657$ versus $0.592$. The paper concludes that AdaPert particularly strengthens DEG separation under small and medium effects, where mean collapse is most severe.

Ablation results support the architecture-level interpretation. Removing $z_{context}$ degrades global and DEG metrics across all effect sizes. Removing $L_{non}$ particularly harms small and medium perturbations, which are described as weak signals in high noise. Excessive $\lambda_{non}$ over-smooths and degrades performance.

The model is also presented as interpretable. By selecting nodes conditioned on perturbation semantics and local graph topology, AdaPert forms compact subgraphs around biologically related genes. This is reported to reduce noise propagation from dense, static graphs and to focus on causal neighborhoods, consistent with observations that many DEGs lie within 1–3 hops of the perturbed gene in STRING. In the case of UQCRB, with $n=114$ DEGs, standard models exhibit shrinkage toward zero, whereas AdaPert better tracks large gene-level changes. In HIRA knockdown, Gene Set Enrichment Analysis shows predicted versus ground-truth pathway enrichment correlation $r = 0.53$ with $P < 0.001$, and the model correctly recovers downregulation of cell-cycle pathways including Myc Targets V1 and E2F Targets. The paper also notes preservation of coordinated pathway-level responses such as Myc Targets and Heme Metabolism, which supports biological fidelity beyond gene-level metrics [2602.18885].

## 6. Robustness, limitations, practical use, and nomenclature

AdaPert is evaluated under unseen-perturbation splits and is therefore framed as an out-of-distribution generalization method. The reported DEG-aware gains across effect sizes are used as evidence of robustness to noise and mean collapse, especially for weak signals. Scalability is managed through graph sparsification, including HVG restriction and top-$k$ edge filtering, and through Gumbel-Softmax subgraph extraction that selects only a small set of nodes per perturbation. The practical guidance in the paper recommends AdaPert for tasks involving single-gene perturbations with sparse, noisy effects, particularly when a biological knowledge graph such as STRING and textual gene descriptions are available and when DEG-aware accuracy and interpretability are more important than global correlation alone.

The stated limitations are specific. Performance depends on graph quality: STRING coverage and confidence can affect subgraph relevance, and missing or incorrect edges may limit performance. Node scoring depends on semantic embeddings from $desc(p)$ and LM embeddings, so text-based bias can mis-rank nodes weakly connected in structure. The sparsity threshold $T$ and Gumbel-Softmax temperature $\tau$ must be tuned jointly: overly aggressive sparsity may exclude relevant nodes, while insufficient sparsity may reintroduce noise. The message-passing operator is mean aggregation; the paper notes that richer GNNs such as attention could improve context modeling, but may also increase noise sensitivity if not well regularized. Future directions named in the paper include adaptive edge masking, multi-hop path scoring, causal constraints, and integration of multi-omics priors or context-specific graphs [2602.18885].

The name “AdaPert” in this context should be distinguished from several unrelated acronyms in the literature. “AdaPT: An interactive procedure for multiple testing with side information” denotes Adaptive p-value Thresholding for FDR control [1609.06035]. “Adaptive Precision Training (AdaPT)” is a dynamic fixed-point quantized training method for DNNs [2107.13490]. “ADePT” refers to Adaptive Decomposed Prompt Tuning for parameter-efficient fine-tuning [2501.03291]. “Adaptative Perturbation Pattern Method” is abbreviated A2PM rather than AdaPert [2203.04234]. These homonymous or near-homonymous usages are methodologically unrelated to the perturbation-conditioned transcriptional response predictor defined in [2602.18885].

Source: https://www.emergentmind.com/topics/adapert