---
title: 'KinForm: Enzyme Kinetics Prediction'
url: https://www.emergentmind.com/topics/kinform
type: topic
---

# KinForm: Enzyme Kinetics Prediction

KinForm is a machine learning framework for predicting enzyme kinetic parameters, specifically turnover number \(k_{cat}\) and Michaelis constant \(K_M\), by optimising protein feature representations rather than relying on a more complex downstream predictor [2507.14639]. It combines residue-level embeddings from Evolutionary Scale Modeling Cambrian, Evolutionary Scale Modeling 2, and ProtT5-XL-UniRef50; applies weighted pooling based on per-residue binding-site probability; reduces dimensionality with principal-component analysis on concatenated protein features; rebalances training data with a similarity-based oversampling strategy; and emphasizes sequence-overlap-free evaluation [2507.14639]. The framework is positioned against a common convention in enzyme-kinetics prediction, exemplified by methods such as UniKP, in which a single protein language model is represented by mean pooling of the last transformer layer. KinForm argues that this convention is biologically blunt, statistically fragile, and especially vulnerable to evaluation protocols that leak highly similar proteins across folds.

## 1. Problem formulation and motivation

KinForm addresses supervised regression from an enzyme–substrate pair to a log-transformed kinetic value [2507.14639]. Each sample consists of a protein sequence, a substrate representation derived from SMILES, and a target value \(k_{cat}\) or \(K_M\). The paper emphasizes that experimental kinetic data are scarce, noisy, and biased toward a small number of well-studied families, so models trained under standard protocols tend to overfit repeated sequence families and perform poorly on low-similarity proteins.

The framework is motivated by two explicit aims: improve predictive accuracy by making the protein representation more task-relevant, and improve generalization by discouraging memorization and benchmarking under a stricter evaluation regime [2507.14639]. The paper frames the task primarily as a representation-learning problem. In that formulation, the major gains are expected to come from how the protein is represented, pooled, compressed, and evaluated, rather than from the use of a more elaborate prediction head. Consistent with that stance, the final regressor is an Extra Trees model.

A central premise is that catalytic function is usually controlled by a small subset of residues, that the final layer of a protein language model is not always the most informative layer for downstream kinetics prediction, and that random train/test splits can overstate performance by placing nearly identical proteins in both training and test folds [2507.14639]. KinForm is constructed as a direct response to those three issues.

## 2. Protein language models and intermediate-layer selection

KinForm uses residue-level embeddings from three pretrained protein language models: ESMC, ESM-2, and ProtT5-XL-UniRef50 [2507.14639]. For a given model, the hidden-state tensor is written as
\[
\mathbf{E}\in \mathbb{R}^{N\times L\times H},
\]
where \(N\) is the number of transformer layers, \(L\) is sequence length, and \(H\) is hidden dimension. The specific layer counts and hidden sizes are ESM-2 with \(N=34\), \(H=1280\); ProtT5-XL with \(N=24\), \(H=1024\); and ESMC with \(N=36\), \(H=1152\).

For layer selection, the framework first mean-pools each layer over sequence length:
\[
\mathbf{m}_n := \frac{1}{L}\mathbf{1}^{\top}\mathbf{E}_n.
\]
These layerwise vectors are evaluated across all layers. The paper reports that the best-performing representations are often not from the final layer; intermediate layers tend to work better [2507.14639]. To choose one layer per model and task, KinForm uses the heuristic score
\[
S := 0.8\,\widetilde{R^2} + 0.4\,\overline{R^2} - 0.5\,\sigma_{R^2},
\]
where \(\widetilde{R^2}\) is median \(R^2\), \(\overline{R^2}\) is mean \(R^2\), and \(\sigma_{R^2}\) is the standard deviation of \(R^2\) across folds.

| Model | \(K_M\) layer | \(k_{cat}\) layer |
|---|---:|---:|
| ESM-2 | 30 | 26 |
| ESMC | 32 | 34 |
| ProtT5-XL-UniRef50 | 19 | last layer retained for fairness with UniKP |

The task-specific layer choices support the claim that there is no universally best layer across tasks [2507.14639]. A plausible implication is that \(K_M\) and \(k_{cat}\) depend on different abstractions within pretrained sequence models, so fixed use of the last layer can discard usable biochemical structure.

## 3. Binding-site-aware pooling and representation assembly

A defining design choice in KinForm is to avoid uniform averaging across residues and instead use binding-site-aware pooling guided by per-residue probabilities from Pseq2Sites [2507.14639]. For each residue \(i\), Pseq2Sites provides a binding probability \(w_i\in[0,1]\). These are normalized as
\[
\tilde{\mathbf{w}} := \frac{\mathbf{w}}{\mathbf{1}^{\top}\mathbf{w}},
\]
and used to compute the binding-weighted representation
\[
\mathbf{m}_b := \tilde{\mathbf{w}}^{\top}\mathbf{E}_n.
\]
The conventional global mean-pooled representation is
\[
\mathbf{m}_g := \frac{1}{L}\mathbf{1}^{\top}\mathbf{E}_n,
\]
and KinForm also uses the concatenated representation
\[
\mathbf{m}_{gb} := [\mathbf{m}_g \,\|\, \mathbf{m}_b].
\]

The biological rationale stated in the paper is that catalytic activity is often determined by a small subset of residues near the active site or binding site, so uniform mean pooling can wash out the relevant signal [2507.14639]. In KinForm, each of the three language models contributes both a global-mean pooled stream and a binding-weighted stream. Because ESMC, ESM-2, and ProtT5 have hidden sizes \(1152\), \(1280\), and \(1024\), the concatenated global stream has dimension \(3456\), the binding-weighted stream also has dimension \(3456\), and the full two-stream protein representation has \(6912\) features.

This multi-model assembly is intended to capture complementary information across encoders [2507.14639]. The paper also warns that simply increasing dimensionality is not always beneficial for generalization, which motivates the later PCA stage.

## 4. Dimensionality reduction, molecular encoding, and predictor variants

KinForm-L applies dimensionality reduction to the protein representation with a two-stage scaling-plus-PCA pipeline [2507.14639]. Each of the six feature blocks—three global and three binding-weighted—is first independently robust-scaled using training-set medians and interquartile ranges. The three global blocks are concatenated into \(\mathbf{X}_g \in \mathbb{R}^{n\times 3456}\), and the three binding blocks into \(\mathbf{X}_b \in \mathbb{R}^{n\times 3456}\). Each matrix is then standardized with training-set mean and standard deviation, PCA is fit separately to the standardized global and binding matrices, and the final compressed protein representation is
\[
\mathbf{Z} := [\mathbf{Z}_g \,|\, \mathbf{Z}_b] \in \mathbb{R}^{n\times 2k}.
\]
In the main KinForm-L configuration, each side is reduced to \(k=300\), yielding a \(600\)-dimensional protein vector.

For the substrate, the main experiments use the SMILES Transformer representation, selected because it performs most consistently across tasks and validation settings [2507.14639]. The molecular embedding is formed by taking the last and penultimate encoder layers, pooling each with both mean and max pooling over tokens, and concatenating the four resulting vectors into \(\mathbb{R}^{1024}\).

The final predictor remains deliberately simple. Protein and substrate representations are concatenated and passed to an Extra Trees regressor, which is used because it performed best in the UniKP benchmark of multiple machine-learning models [2507.14639]. Two variants are distinguished. KinForm-H uses the full \(6912\)-dimensional protein representation with no PCA and an input vector in \(\mathbb{R}^{7936}\). KinForm-L uses the PCA-reduced protein representation and an input vector in \(\mathbb{R}^{1624}\). The paper characterizes KinForm-H as emphasizing high similarity or in-distribution performance, and KinForm-L as emphasizing low similarity or generalization.

## 5. Similarity-aware rebalancing and evaluation protocol

KinForm is evaluated on three benchmark datasets [2507.14639]. For \(k_{cat}\), the paper uses DLKcat with **16,775** samples after filtering invalid SMILES and negative values, and Shen with **35,001** samples after filtering. For \(K_M\), it uses a dataset with **11,722** samples. Both \(k_{cat}\) datasets are compiled from BRENDA and SABIO-RK, and all targets are \(\log_{10}\)-transformed.

A major methodological claim of the paper concerns evaluation. Standard 5-fold cross-validation randomly splits datapoints into five folds, but this can place highly similar or identical protein sequences in both training and test sets [2507.14639]. KinForm therefore emphasizes Sequence-Exclusive Cross Validation (SE-CV), also in 5 folds, with the constraint that no protein sequence in the training set may appear in the test set for that fold. Beyond overall \(R^2\) and RMSE, the paper bins test proteins by sequence similarity to the training set using MMseqs2 at identity thresholds \(20\%\), \(50\%\), \(70\%\), and \(90\%\), assigning each test protein to the highest threshold for which it shares a cluster with a training protein; otherwise it is placed in the \(<20\%\) bin.

The similarity-based oversampling scheme is applied only to the training data [2507.14639]. Unique protein sequences are clustered with MMseqs2 at identity thresholds \(0.90\), \(0.40\), and \(0.20\). Each sequence is assigned to the highest threshold for which its cluster has more than one member; singleton sequences at all thresholds are assigned to the \(<0.20\) bin. Sequences are then grouped into the four similarity bands \(<0.2\), \(0.20\text{--}0.39\), \(0.40\text{--}0.89\), and \(\ge 0.90\), and lower-similarity bands are oversampled by random duplication with replacement until they match the size of the \(\ge 0.90\) band.

The reported metrics are
\[
R^2 = 1 - \frac{\sum_{i=1}^{n}(y_i-\hat{y}_i)^2}{\sum_{i=1}^{n}(y_i-\bar{y})^2}
\]
and
\[
\mathrm{RMSE} = \sqrt{\frac{1}{n}\sum_{i=1}^{n}(y_i-\hat{y}_i)^2}.
\]
The paper’s broader argument is that similarity-binned evaluation reveals whether a model genuinely generalizes beyond homologous families, rather than merely memorizing local sequence neighborhoods.

## 6. Results, ablations, and methodological significance

For \(k_{cat}\), KinForm-L is reported as the best model under SE-CV, whereas KinForm-H is best under standard random 5-fold cross-validation [2507.14639]. The strongest gains occur in low-similarity bins. On DLKcat, KinForm-L improves UniKP by about **100%** in the \(<20\%\) similarity bin, from roughly **0.077 to 0.15** \(R^2\). The paper also states that this can be described as roughly **44%** improvement in another reporting context, noting that the exact percentage depends on the baseline value and bin summary being referenced. Across both DLKcat and Shen, the qualitative pattern is consistent: high-similarity sequences are matched or slightly trailed in some settings, but low-similarity sequences are clearly improved. In a comparable split setting on Shen, KinForm-H achieves an \(R^2\) around **0.72**, described as on par with EITLEM’s final transfer-learning result but with a much simpler training pipeline.

For \(K_M\), the full-resolution configuration equivalent to KinForm-H is used for the main benchmark, and KinForm outperforms UniKP under both CV and SE-CV by around **5%** overall [2507.14639]. The paper explicitly notes that KinForm-L does not provide a consistent advantage for \(K_M\), so PCA-compressed features were not retained for the main \(K_M\) experiments. It also observes that the CV–SE-CV gap is smaller for \(K_M\) than for \(k_{cat}\), which suggests that \(K_M\) may depend more heavily on substrate representation and less on protein-sequence generalization, or that the dataset is less sensitive to sequence-overlap leakage.

The ablation results isolate the roles of the major design components [2507.14639]. Binding-weighted pooling improves over plain global mean, and the strongest settings usually concatenate global and binding vectors. Intermediate layers often outperform the last layer, with the optimal layer depending on both model and task. PCA has a clear regularization effect: no PCA gives the best standard CV but the worst SE-CV; moderate PCA reduction gives the best SE-CV; too many components restore standard CV but degrade SE-CV. The best SE-CV performance is often obtained with about **200–400 components**, capturing roughly **90–95%** of variance. Oversampling barely changes overall SE-CV accuracy but gives a small, consistent improvement in the \(<20\%\) similarity bin while leaving high-similarity performance mostly unchanged.

The paper’s principal methodological conclusion is that sequence-overlap-free evaluation should be the standard for benchmarking enzyme kinetic prediction models [2507.14639]. Random splits are presented as misleading because identical or highly similar proteins can inflate apparent predictive performance. KinForm’s broader significance lies in demonstrating that relatively simple regressors can outperform prior methods when paired with carefully engineered protein representations, binding-site-aware pooling, dimensionality control, and evaluation protocols that measure generalization beyond homology leakage.

Source: https://www.emergentmind.com/topics/kinform