DPLM-Evo: Protein Evolution Diffusion Model

• DPLM-Evo is an evolutionary discrete diffusion protein language model that explicitly models substitutions, insertions, and deletions as biological edit operations.
• It employs a dual-space formulation with latent alignment and a contextualized noising kernel to generate variable-length, biologically informed protein sequences.
• Empirical results show enhanced sequence prediction, diverse generation, and effective simulated evolution for post-editing and optimization applications.

Searching arXiv for DPLM-Evo and closely related protein discrete diffusion LLMs. arxiv_search: {"^^^^^^^^8query8 OR \8^^^^^^^^"Towards A Generative Protein Evolution Machine with DPLM-Evo\"^^^^^^^^8 OR DPLM-Evo8^^^^^^^^", "^^^^^^^^8max_results8 ^^^^8submittedDate8^^^^, "^^^^^^^^8sort_by8 "^^^^^^^^8submittedDate8 arxiv_search({"^^^^^^^^8query8 \8^^^^^^^^"Towards A Generative Protein Evolution Machine with DPLM-Evo\"", "^^^^^^^^8max_results8 ^^^^8submittedDate8^^^^, "^^^^^^^^8sort_by8 "^^^^^^^^8submittedDate8 DPLM-Evo is an evolutionary discrete diffusion protein LLM that treats protein generation and analysis as explicit edit processes rather than iterative recovery from masks. The framework was introduced in “Towards A Generative Protein Evolution Machine with DPLM-Evo” (&&&^^^^8query8^^^^&&&). Its central premise is that proteins evolve through accumulated substitutions, insertions, and deletions under biophysical and functional constraints, and that a generative model should therefore denoise by predicting those operations directly. To make indel-aware generation tractable, DPLM-Evo decouples a variable-length observed sequence space from an upsampled latent alignment space, and it augments discrete diffusion with a contextualized evolutionary noising kernel that produces biologically informed, context-dependent mutation patterns.

^^^^8(Wang et al., 30 Apr 2026) OR \8^^^^. Biological premise and departure from masking-based DPLMs

DPLM-Evo is motivated by a mismatch between biological intuition and the corruption processes used in prior discrete diffusion protein LLMs. Existing DPLMs are described as strong generative models, but they typically rely on masking-based absorbing diffusion, so their generation process is effectively iterative mask recovery at a fixed length. The framework argues that this is biologically incomplete because natural protein variation arises through substitutions, insertions, and deletions, not through emergence from masks.

That distinction matters for several problem classes named explicitly by the paper: variable-length generation, post-editing existing proteins, motif scaffolding where scaffold length should adapt, and indel-aware variant effect prediction. DPLM-Evo is therefore designed to close the gap between sequence diffusion and evolutionary editing by introducing explicit pretraining objectives for substitution and insertion/deletion operations during denoising (&&&^^^^8query8^^^^&&&).

^^^^8 OR DPLM-Evo8^^^^. Latent alignment formulation and sequence spaces

The formal structure of DPLM-Evo rests on two coupled sequence spaces. The observed space PRESERVED_PLACEHOLDER_^^^^8query8^^^^ contains protein sequences

PRESERVED_PLACEHOLDER_^^^^8(Wang et al., 30 Apr 2026) OR \8^^^^

where PRESERVED_PLACEHOLDER_^^^^8 OR DPLM-Evo8^^^^ is a mask token. The latent alignment space PRESERVED_PLACEHOLDER_^^^^8max_results8^^^^ contains length-PRESERVED_PLACEHOLDER_^^^^8sort_by8^^^^ sequences over

PRESERVED_PLACEHOLDER_^^^^8submittedDate8^^^^

where PRESERVED_PLACEHOLDER_^^^^8query8^^^^ is a gap token.

The latent alignment serves as an upsampled canvas on which insertions and deletions can be represented as local transitions between residues and gaps. Recovery of the observed sequence is deterministic through the collapse map

PRESERVED_PLACEHOLDER_^^^^8(Wang et al., 30 Apr 2026) \8^^^^

which removes gap symbols. Conversely, $\Gamma(x)$ is the set of latent alignments obtained by inserting exactly $L$ gaps at arbitrary positions.

Training is formulated through an ELBO over latent alignments:

PRESERVED_PLACEHOLDER_^^^^8(Wang et al., 30 Apr 2026) OR \8query8^^^^

Although the diffusion process is defined in latent space, the neural network operates on the collapsed observed sequence PRESERVED_PLACEHOLDER_^^^^8(Wang et al., 30 Apr 2026) OR \8(Wang et al., 30 Apr 2026) OR \8^^^^. An index map PRESERVED_PLACEHOLDER_^^^^8(Wang et al., 30 Apr 2026) OR \8 OR DPLM-Evo8^^^^ connects positions in the observed sequence to non-gap positions in the latent alignment, allowing the loss to be decomposed into substitution, deletion, and insertion terms on observed tokens. In practice, the framework uses a Transformer backbone initialized from a pretrained DPLM-^^^^8query8submittedDate8query8^^^^M; the output projection or substitution head is reused from DPLM, while deletion and insertion are handled by new small binary classifiers (&&&^^^^8query8^^^^&&&).

^^^^8max_results8^^^^. Edit-aware denoising objective

DPLM-Evo predicts three edit actions during denoising. The substitution head PRESERVED_PLACEHOLDER_^^^^8(Wang et al., 30 Apr 2026) OR \8max_results8^^^^ predicts amino acid identities for corrupted residues. The deletion head PRESERVED_PLACEHOLDER_^^^^8(Wang et al., 30 Apr 2026) OR \8sort_by8^^^^ predicts whether a token should be removed, that is, turned into PRESERVED_PLACEHOLDER_^^^^8(Wang et al., 30 Apr 2026) OR \8submittedDate8^^^^. The insertion head PRESERVED_PLACEHOLDER_^^^^8(Wang et al., 30 Apr 2026) OR \8query8^^^^ predicts whether a new residue should be inserted to the right of a position.

The substitution loss is active when both current and target tokens are valid amino acids and differ:

PRESERVED_PLACEHOLDER_^^^^8(Wang et al., 30 Apr 2026) OR \8(Wang et al., 30 Apr 2026) \8^^^^

For stability, both deletion and insertion are implemented as binary classification rather than token-level multiclass prediction:

PRESERVED_PLACEHOLDER_^^^^8(Wang et al., 30 Apr 2026) OR \88^^^^

PRESERVED_PLACEHOLDER_^^^^8(Wang et al., 30 Apr 2026) OR \8^^^^9

The total objective is a weighted sum of the three edit losses:

PRESERVED_PLACEHOLDER_^^^^8 OR DPLM-Evo8query8^^^^

This objective gives DPLM-Evo an explicitly mechanistic decomposition of denoising into biological edit operations. The framework is therefore not limited to residue replacement at fixed length, and it can represent multi-step indels through successive local edit decisions (&&&^^^^8query8^^^^&&&).

^^^^8sort_by8^^^^. Contextualized evolutionary noising and adaptive scaffold growth

A distinctive element of DPLM-Evo is its forward noising kernel. Instead of using only absorbing mask noise, the model defines a noising prior PRESERVED_PLACEHOLDER_^^^^8 OR DPLM-Evo8(Wang et al., 30 Apr 2026) OR \8^^^^ through a transition matrix PRESERVED_PLACEHOLDER_^^^^8 OR DPLM-Evo8 OR DPLM-Evo8^^^^ that encodes substitution, insertion, deletion, and masking behavior. The forward process at time PRESERVED_PLACEHOLDER_^^^^8 OR DPLM-Evo8max_results8^^^^ is

PRESERVED_PLACEHOLDER_^^^^8 OR DPLM-Evo8sort_by8^^^^

with

PRESERVED_PLACEHOLDER_^^^^8 OR DPLM-Evo8submittedDate8^^^^

The substitution component of that kernel can be uniform, static BLOSUM-based, or contextualized. The contextualized evolutionary kernel is the paper’s main technical innovation. For position PRESERVED_PLACEHOLDER_^^^^8 OR DPLM-Evo8query8^^^^, it samples an auxiliary partially masked sequence PRESERVED_PLACEHOLDER_^^^^8 OR DPLM-Evo8(Wang et al., 30 Apr 2026) \8^^^^, forces position PRESERVED_PLACEHOLDER_^^^^8 OR DPLM-Evo88^^^^ to the mask token, and queries the model for the conditional distribution at that site:

PRESERVED_PLACEHOLDER_^^^^8 OR DPLM-Evo8^^^^9

Corruption is thus context-dependent rather than uniform, and after a warmup phase the model uses its own predictions to construct the kernel, making the noising procedure “on-policy.” At PRESERVED_PLACEHOLDER_^^^^8max_results8query8^^^^, where the auxiliary process collapses to an all-mask sequence, the kernel becomes a learned amino-acid prior PRESERVED_PLACEHOLDER_^^^^8max_results8(Wang et al., 30 Apr 2026) OR \8^^^^ rather than a uniform distribution.

Sampling uses a practical approximation rather than exact marginalization over all latent alignments. The model fixes PRESERVED_PLACEHOLDER_^^^^8max_results8 OR DPLM-Evo8^^^^ to a canonical alignment with one insertion slot per residue, for example

PRESERVED_PLACEHOLDER_^^^^8max_results8max_results8^^^^

Denoising then proceeds iteratively: start from a noisy prior sequence sampled from PRESERVED_PLACEHOLDER_^^^^8max_results8sort_by8^^^^, delete tokens whose deletion probabilities exceed PRESERVED_PLACEHOLDER_^^^^8max_results8submittedDate8^^^^, insert masks to the right of positions whose insertion probabilities exceed PRESERVED_PLACEHOLDER_^^^^8max_results8query8^^^^, replace noisy tokens and masks through the substitution head, update the noisy index set to the least confident positions, and renoise via PRESERVED_PLACEHOLDER_^^^^8max_results8(Wang et al., 30 Apr 2026) \8^^^^.

This route-and-denoise scheme gives DPLM-Evo adaptive scaffold growth: the scaffold can expand or contract during denoising as insertion and deletion heads fire. The paper states that the contextualized kernel adds about +^^^^8 OR DPLM-Evo8sort_by8^^^^% per-step training overhead because it requires an extra gradient-free forward pass, whereas the indel mechanism itself incurs negligible overhead relative to the backbone Transformer (&&&^^^^8query8^^^^&&&).

^^^^8submittedDate8^^^^. Empirical performance on prediction, understanding, and generation

The paper reports improvements in both sequence understanding and sequence generation. On ProteinGym substitution zero-shot prediction, DPLM-Evo uses a log-odds score at mutated positions,

PRESERVED_PLACEHOLDER_^^^^8max_results88^^^^

and achieves the best correlation among single-sequence foundation models, outperforming ESM-^^^^8 OR DPLM-Evo8^^^^, ESM-C, ESM-^^^^8(Wang et al., 30 Apr 2026) OR \8^^^^v, and DPLM. The larger ^^^^8max_results8^^^^B model is reported to improve over the ^^^^8query8submittedDate8query8^^^^M model, indicating scale benefits.

For indels, DPLM-Evo directly scores insertions and deletions through Levenshtein operations between wild-type and mutant sequences. On ProteinGym indel benchmarks it achieves ^^^^8query8^^^^.^^^^8sort_by8max_results8submittedDate8 average Spearman, beating ProGen^^^^8 OR DPLM-Evo8^^^^ M at ^^^^8query8^^^^.^^^^8sort_by8query8sort_by8 and approaching MSA-based methods such as PoET at ^^^^8query8^^^^.^^^^8submittedDate8(Wang et al., 30 Apr 2026) OR \8(Wang et al., 30 Apr 2026) \8^^^^ and ProFam ensemble at ^^^^8query8^^^^.^^^^8submittedDate8max_results8query8. The paper further reports that aligning the substitution distribution to GEMME through

PRESERVED_PLACEHOLDER_^^^^8max_results8^^^^9

improves correlations further. An ablation replacing the contextualized kernel with uniform corruption reduces average Spearman from ^^^^8query8^^^^.^^^^8sort_by8 OR DPLM-Evo8^^^^ to ^^^^8query8^^^^.^^^^8 OR DPLM-Evo8max_results8submittedDate8^^^^, which the paper uses to highlight the value of biologically informed noise.

For unconditional generation, DPLM-Evo is initialized from DPLM-^^^^8query8submittedDate8query8^^^^M and trained on UniRef^^^^8submittedDate8query8^^^^ for ^^^^8(Wang et al., 30 Apr 2026) OR \8query8query8^^^^k steps with PRESERVED_PLACEHOLDER_^^^^8sort_by8query8^^^^ diffusion steps and initial lengths PRESERVED_PLACEHOLDER_^^^^8sort_by8(Wang et al., 30 Apr 2026) OR \8^^^^. It achieves average pLDDT around 8^^^^8max_results8^^^^.^^^^8query8, competitive with DPLM at 8^^^^8sort_by8^^^^.^^^^8query8, while showing greater sequence and structure diversity than DPLM-Mask, much lower repetition or less mode collapse, and better length stability with output lengths staying near the initial length. The paper also reports that predicted indel probabilities are higher at early diffusion timesteps and decay later, indicating coarse early structural adjustment followed by finer substitutional refinement (&&&^^^^8query8^^^^&&&).

^^^^8query8^^^^. Simulated evolution and post-editing applications

Beyond zero-shot scoring and unconditional generation, DPLM-Evo is explicitly positioned as a machine for simulated evolution and optimization. The framework can simulate evolutionary trajectories containing substitutions, insertions, and deletions while maintaining foldability. The evaluations reported for this setting include diversity, foldability, sequence entropy, repetition ratio, and length distributions. The stated conclusion is that DPLM-Evo explores protein sequence space more realistically than a mask-only model while remaining near a foldable manifold.

The post-editing use cases are especially concrete. In an unconstrained “refine the sequence” mode applied to natural proteins from the CAMEO dataset, DPLM-Evo produces highly modified sequences, often below ^^^^8submittedDate8query8^^^^% identity to the original, while preserving structural plausibility relative to the seed protein. The paper interprets these as in silico expanded homologs.

For directed evolution of GFP, DPLM-Evo is combined with beam search and structure-based filtering. Starting from a template GFP, the procedure generates ^^^^8(Wang et al., 30 Apr 2026) OR \8query8^^^^ candidates per iteration, filters them with Chai-^^^^8(Wang et al., 30 Apr 2026) OR \8^^^^ using template chromophore-site RMSD PRESERVED_PLACEHOLDER_^^^^8sort_by8 OR DPLM-Evo8^^^^ and pTM as the score, and retains the top candidates for the next round. After ^^^^8 OR DPLM-Evo8query8^^^^ iterations, substitution-only optimization raises pTM from ^^^^8query8^^^^.^^^^8 OR DPLM-Evo8query8max_results8^^^^ to ^^^^8query8^^^^.^^^^8(Wang et al., 30 Apr 2026) \8max_results8max_results8^^^^; allowing indels raises pTM further to ^^^^8query8^^^^.8^^^^8submittedDate8(Wang et al., 30 Apr 2026) \8^^^^; an ESM-^^^^8 OR DPLM-Evo8^^^^ baseline reaches ^^^^8query8^^^^.^^^^8(Wang et al., 30 Apr 2026) \8max_results8(Wang et al., 30 Apr 2026) \8^^^^ under the same protocol; and random mutation remains below ^^^^8query8^^^^.^^^^8query8. The reported outcome is that the chromophore site remains structurally preserved while the remainder of the protein improves, demonstrating explicit edit-trajectory optimization rather than simple completion or fixed-length redesign (&&&^^^^8query8^^^^&&&).

^^^^8(Wang et al., 30 Apr 2026) \8^^^^. Terminological disambiguation and related “Evo” methods

DPLM-Evo should be distinguished from several unrelated methods with superficially similar names. “Dual Prototype Evolving for Test-Time Generalization of Vision-LLMs” introduces DPE, a test-time adaptation framework for CLIP-like vision-LLMs that evolves textual and visual prototype banks during unlabeled test-time adaptation (Zhang et al., 2024). “DPRESERVED_PLACEHOLDER_^^^^8sort_by8max_results8^^^^Evo: Dual Difficulty-Aware Self-Evolution for Data-Efficient Reinforcement Learning” is a Questioner–Solver co-evolution framework for reasoning RL in LLMs (&&&^^^^8(Wang et al., 30 Apr 2026) OR \8query8^^^^&&&). “DSevolve: Enabling Real-Time Adaptive Scheduling on Dynamic Shop Floor with LLM-Evolved Heuristic Portfolios” addresses dynamic flexible job shop scheduling with LLM-evolved dispatching-rule portfolios (&&&^^^^8(Wang et al., 30 Apr 2026) OR \8(Wang et al., 30 Apr 2026) OR \8^^^^&&&).

The shared “Evo” suffix across these papers denotes evolution in very different senses: prototype accumulation for vision-language adaptation, difficulty-aware co-evolution for RL reasoning, heuristic portfolio evolution for scheduling, and explicit substitution/insertion/deletion modeling for proteins. Within that landscape, DPLM-Evo is specifically a protein discrete diffusion framework whose defining technical contribution is the integration of edit-aware denoising, latent alignment, contextualized evolutionary noising, and variable-length generation into a single protein language modeling system.