---
title: 'ZeroFold: Protein–RNA Affinity Predictor'
url: https://www.emergentmind.com/topics/zerofold
type: topic
---

# ZeroFold: Protein–RNA Affinity Predictor

ZeroFold is a transformer-based model for predicting protein–RNA binding affinity directly from sequence-derived, pre-structural embeddings, introduced to address a central difficulty in structural biology: RNA molecules exist as dynamic conformational ensembles, so committing to a single predicted structure can discard binding-relevant information [2603.23583]. In ZeroFold, pre-structural embeddings are extracted from the Boltz-2 trunk before structure decoding, combined for protein and RNA through a cross-modal attention mechanism, and used to predict affinity as \(pK_D=-\log_{10}(K_D)\) [2603.23583]. The model is trained and evaluated on PRADB, a curated dataset of 2,621 unique protein–RNA pairs with experimentally measured affinities drawn from four complementary databases, and on a held-out test set constructed with 40% sequence identity thresholds it achieves a Spearman correlation of 0.65 [2603.23583]. This suggests a representation strategy for flexible biomolecules in which ensemble-relevant information is retained without requiring explicit predicted structures.

## 1. Conceptual basis and problem formulation

ZeroFold addresses protein–RNA binding affinity prediction, where the objective is to infer the strength of interaction between a protein sequence and an RNA sequence, typically reported as

\[
pK_D = -\log_{10}(K_D).
\]

Higher \(pK_D\) corresponds to tighter binding [2603.23583]. The problem is motivated by applications in understanding gene regulation, studying RNA-binding proteins and disease mechanisms, and designing RNA-targeting therapeutics such as RNA-binding peptides [2603.23583].

The paper identifies four obstacles: RNA is highly flexible and often exists as a conformational ensemble rather than a single structure; many protein–RNA interfaces are shallow, heterogeneous, and dynamic; high-quality labeled affinity data are scarce; and structure-based methods usually require experimentally determined 3D structures, which are unavailable for most protein–RNA pairs [2603.23583]. The core hypothesis is that intermediate representations from a biomolecular foundation model, captured before structure decoding, may preserve ensemble-level information that would be lost by selecting a single predicted structure [2603.23583].

These intermediate representations are termed pre-structural embeddings. In the ZeroFold formulation, they are taken from the final Boltz-2 trunk layer before the structure module generates coordinates, and are argued to implicitly preserve information about multiple possible conformations, evolutionary and contextual signals, and ensemble-level structure properties [2603.23583]. This is especially pertinent for RNA, which the paper characterizes as a flexible biomolecule for which single-structure models are inherently incomplete [2603.23583].

## 2. Representation strategy and architecture

ZeroFold uses Boltz-2 to obtain pre-structural embeddings for both the protein and the RNA, then applies separate encoders, a cross-modal attention module, and a scalar affinity head [2603.23583]. The overall pipeline is: input protein and RNA sequences; run them through the Boltz-2 trunk; extract final trunk-layer embeddings before structure decoding; encode protein and RNA separately; fuse them via cross-modal attention; and predict affinity [2603.23583].

The model uses two representation types from the final Boltz-2 trunk layer. The single or per-residue representations are

\[
s_i^{\text{msa}} \in \mathbb{R}^{384}, \quad i \in \{1,\dots,N_{\text{res}}\},
\]

and the pair representations are

\[
z_{ij}^{\text{pair}} \in \mathbb{R}^{128}, \quad i,j \in \{1,\dots,N_{\text{res}}\}.
\]

These are extracted from the final trunk layer of Boltz-2 with `recycling_steps 3`, before the structure module decodes coordinates [2603.23583].

ZeroFold contains separate encoder blocks for protein and RNA. Each chain has a single-stream encoder and a pair-stream encoder, implemented as two successive transition layers with residual connections and dropout while preserving dimensionality [2603.23583]. The RNA encoder includes an additional nucleic acid type embedding distinguishing RNA from DNA. This is a learned 32-dimensional embedding concatenated to the single representation before the first transition layer, expanding the input dimension from 384 to 416; because of that dimensional change, the first layer is applied without a residual connection [2603.23583].

After separate encoding, the model integrates protein and RNA features through a cross-modal attention module intended to model the interaction interface [2603.23583]. The paper characterizes the mechanism in standard transformer terms, where one modality attends to the other. A generic form is

\[
\mathrm{Attn}(Q,K,V) = \mathrm{softmax}\left(\frac{QK^\top}{\sqrt{d_k}}\right)V,
\]

allowing the model to aggregate pairwise relevance between protein residues and RNA nucleotides [2603.23583]. The final joint representation is passed to an affinity prediction head that outputs a scalar estimate \(\hat{y}\approx pK_D\) [2603.23583].

A notable design choice is that the Boltz-2 trunk is frozen during training. Only the downstream ZeroFold components are optimized: the protein encoder, RNA encoder, cross-modal attention module, and affinity head [2603.23583]. This makes the system a downstream predictor built on a fixed pretrained biomolecular foundation model.

## 3. PRADB dataset and curation procedure

To support training and evaluation, the authors construct PRADB, the Protein-RNA Affinity DataBase [2603.23583]. PRADB merges four sources: ProNAB, BioLiP2, the UTexas Aptamer Database, and PDBbind+ [2603.23583]. The raw union contains 4,510 protein–RNA pairs with affinity measurements, and after deduplication yields 2,621 unique protein–RNA pairs [2603.23583].

The source composition is heterogeneous. ProNAB initially contains over 20,000 protein-nucleic acid affinity records; for protein-RNA, 5,323 entries were present, 5,173 had valid \(K_D\) measurements, and after filtering to retain only natural amino acids and unmodified nucleotide bases, 3,588 protein-RNA pairs remained [2603.23583]. BioLiP2 contributes 425 protein-RNA complexes with affinity data; the UTexas Aptamer Database contributes 258 protein-RNA complexes with labeled affinity values; and PDBbind+ contributes 239 protein-RNA complexes and is regarded in the paper as the most reliable source due to high curation and structural information [2603.23583].

For pairs appearing in multiple databases, PDBbind+ affinity values were preferred when available; otherwise, the median affinity from the remaining sources was used [2603.23583]. After resolving duplicates, PRADB contains 2,621 unique protein–RNA sequence pairs, 512 distinct proteins, and 1,411 distinct RNA sequences [2603.23583].

The dataset exhibits broad length distributions. RNA lengths span a broad range with median 22 nt, and protein lengths span a broad range with median 171 aa [2603.23583]. The affinity distribution is approximately unimodal, centered around \(pK_D \approx 7.1\) with standard deviation 1.35 [2603.23583]. This distribution supports a regression formulation rather than a coarse classification task.

## 4. Training protocol and leakage-controlled evaluation

A major emphasis of ZeroFold is fair evaluation under sequence-similarity control [2603.23583]. PRADB is split into training, validation, and test sets in an approximate 8:1:1 ratio [2603.23583]. To reduce leakage, protein sequences in different splits are required to have \(<40\%\) sequence identity, the same criterion is applied to RNA sequences, and the coverage threshold is 80% [2603.23583]. The authors use MMseqs2 easy-cluster and then audit the splits with bidirectional MMseqs2 easy-search, because greedy clustering can miss leakage cases [2603.23583]. After auditing, 23 entries that still exceeded the identity threshold across splits were removed [2603.23583]. The final split sizes are 2,104 training, 210 validation, and 299 test examples [2603.23583].

To mitigate over-representation of large sequence families, each training sample is weighted inversely to cluster size:

\[
w_{ij} \propto \frac{1}{|PC_i|\,|RC_j|},
\]

where \(PC_i\) denotes protein cluster \(i\) and \(RC_j\) denotes RNA cluster \(j\); the weights are normalized to sum to 1 over the training set [2603.23583]. This reduces dominance by highly sampled families such as ribosomal proteins with rRNA [2603.23583].

Training is conducted for 100 epochs, with each epoch comprising 900 training samples weighted by cluster representation [2603.23583]. The Boltz-2 trunk remains frozen, and only the downstream ZeroFold modules are trained on PRADB [2603.23583].

## 5. Quantitative performance and comparative evaluation

On the held-out PRADB test set, ZeroFold achieves the following metrics: MAE \(=1.14\), RMSE \(=1.47\), Pearson correlation coefficient \(=0.63\), and Spearman correlation coefficient \(=0.65\) [2603.23583]. The paper emphasizes that this correlation level is near a practical upper bound imposed by experimental measurement noise, estimated at about \(0.6\)–\(0.7\) on correlation metrics [2603.23583]. This interpretation rests on the observation that identical protein–RNA pairs can have substantially different reported affinities across assays [2603.23583].

The principal structure-based comparator is CoPRA, described as the leading structure-based predictor [2603.23583]. CoPRA reported PCC \(=0.58\) and SCC \(=0.59\) on PRA310 with 5-fold cross-validation, but its benchmark used a 70% protein-sequence identity threshold and relies on experimentally resolved or predicted structures, making the setting less strict and structurally advantaged relative to ZeroFold’s 40% threshold on both protein and RNA [2603.23583]. To compare more fairly, the authors define progressively stricter subsets relative to CoPRA’s PRA310 training data: \(A\), all test examples; \(B\), proteins not present in PRA310; \(C\), maximum protein identity \(<70\%\); and \(D\), maximum protein identity \(<40\%\) [2603.23583].

The reported comparison is as follows:

| Subset | CoPRA PCC | ZeroFold PCC | CoPRA SCC | ZeroFold SCC |
|---|---:|---:|---:|---:|
| A All | 0.50 | 0.63 | 0.54 | 0.65 |
| B Protein not in reference | 0.47 | 0.67 | 0.52 | 0.68 |
| C Max protein identity < 70% | 0.46 | 0.71 | 0.55 | 0.69 |
| D Max protein identity < 40% | 0.22 | 0.54 | 0.23 | 0.52 |

These results indicate that CoPRA performance drops sharply as evaluation becomes fairer, whereas ZeroFold remains comparatively stable [2603.23583]. A plausible implication is that ZeroFold’s gains are not primarily due to overlap with comparator training data.

The principal sequence-based comparator is DeePNAP, described as the leading sequence-based method [2603.23583]. DeePNAP reported \(R=0.92\) in its own paper, but when evaluated on PRA201 in the CoPRA study it fell to PCC \(=0.35\) and SCC \(=0.35\) [2603.23583]. Because DeePNAP was trained on ProNAB, which overlaps with PRADB, the ZeroFold paper again evaluates on filtered subsets [2603.23583]. The reported comparison is:

| Subset | DeePNAP PCC | ZeroFold PCC | DeePNAP SCC | ZeroFold SCC |
|---|---:|---:|---:|---:|
| A All | 0.46 | 0.63 | 0.35 | 0.65 |
| B Protein not in reference | 0.48 | 0.54 | 0.42 | 0.54 |
| C Max protein identity < 70% | 0.44 | 0.61 | 0.45 | 0.56 |
| D Max protein identity < 40% | 0.41 | 0.53 | 0.34 | 0.46 |

The paper states that ZeroFold consistently outperforms DeePNAP across all filtered subsets and all reported metrics [2603.23583].

## 6. Affinity-band behavior, interpretation, and limitations

The test set is also stratified into three affinity bands: low, \(pK_D<5.75\); medium, \(5.75\le pK_D<8.45\); and high, \(pK_D\ge 8.45\) [2603.23583]. These thresholds derive from the dataset mean and standard deviation, with mean \(=7.10\) and SD \(=1.35\), so that \(5.75=7.10-1.35\) and \(8.45=7.10+1.35\) [2603.23583].

The reported Spearman correlations are:

| Affinity band | CoPRA | DeePNAP | ZeroFold |
|---|---:|---:|---:|
| Low | 0.09 | 0.14 | 0.10 |
| Medium | 0.38 | 0.02 | 0.50 |
| High | 0.27 | 0.20 | 0.28 |

The authors interpret this pattern as indicating that ZeroFold is especially effective at coarse discrimination across the affinity range, but that correlation drops within narrower bands, particularly among stronger binders [2603.23583]. They specifically note that SCC is only about 0.28 in the stronger-binding regime, and therefore characterize the model as better suited for virtual screening than for fine-grained lead optimization [2603.23583].

This interpretation is tied to a broader claim about experimental noise and heterogeneous assay conditions. The paper notes that affinity measurements for identical protein–RNA pairs can vary due to pH, temperature, and methodology, and that such variability limits the maximum attainable correlation [2603.23583]. The article therefore frames ZeroFold not as solving affinity prediction in an absolute sense, but as approaching the empirical ceiling allowed by currently available labels [2603.23583].

The paper is also explicit about its limitations. Protein–RNA affinity datasets remain small, amounting here to only a few thousand examples [2603.23583]. Measurement noise is substantial; the compiled labels arise from different assays, laboratories, and conditions [2603.23583]. Performance may vary across protein classes, RNA classes, and affinity ranges, and these subgroup-specific behaviors require more systematic study [2603.23583]. Fine rank-ordering among strong binders remains difficult, which constrains immediate use for lead optimization [2603.23583].

## 7. Significance and relation to broader methodology

A central methodological claim of ZeroFold is that sequence-derived, pre-structural embeddings can substitute for explicit structural models when the biomolecules of interest are flexible and structurally heterogeneous [2603.23583]. In this framework, the value of the Boltz-2 trunk lies not in its final coordinate predictions but in the information encoded before a single structure is selected [2603.23583]. This shifts the representation problem from structure prediction to extracting informative latent states from a pretrained biomolecular model.

The computational implications are also emphasized. Both ZeroFold and structure-based alternatives require a Boltz-2 trunk forward pass, but structure-based methods then require structure decoding before affinity prediction, whereas ZeroFold bypasses that step and directly uses the pre-structural embeddings [2603.23583]. This makes the model faster and more suitable for virtual screening, proteome-wide affinity profiling, and high-throughput candidate evaluation [2603.23583].

The broader scientific significance lies in the claim that pre-structural embeddings are particularly useful for flexible biomolecules such as RNA, where a single predicted conformation may be fundamentally inadequate [2603.23583]. This suggests possible extensions to mutation-effect prediction, binding-site identification, and ribonucleoprotein assembly modeling [2603.23583]. A plausible implication is that ZeroFold exemplifies a more general strategy for biomolecular prediction tasks in which latent representations from foundation models are used directly, rather than forcing all downstream inference through explicit coordinate generation.

Within protein–RNA modeling, ZeroFold is therefore best understood as a leakage-controlled, affinity-regression framework built on frozen Boltz-2 trunk representations, with separate protein and RNA encoders, cross-modal attention, and training on the curated PRADB dataset [2603.23583]. Its reported performance, particularly the test-set Spearman correlation of 0.65 under 40% sequence identity thresholds, positions it as a strong sequence-derived predictor in a domain where explicit structures are often unavailable and, for RNA, often incomplete even when predicted [2603.23583].

Source: https://www.emergentmind.com/topics/zerofold