MolFORM: Multimodal Molecular Modeling

Updated 6 July 2026

MolFORM is a multimodal framework integrating discrete atom types and continuous 3D coordinates for structure-based drug design and molecular property prediction.
It employs multi-flow matching with an SE(3)-equivariant GNN backbone to generate ligands conditioned on protein pockets and to fuse chemical-language with physicochemical descriptors.
The framework achieves state-of-the-art performance with preference-guided fine-tuning (DPO) and significantly faster generation compared to diffusion-based methods.

Searching arXiv for exact and closely related uses of “MolFORM” to ground the article in the current literature. I’m querying arXiv for “MolFORM” and nearby variants such as “MultiModal-MoLFormer”. MolFORM denotes a multimodal line of molecular modeling whose exact arXiv usage is twofold. The exact title match, "MolFORM: Multi-modal Flow Matching for Structure-Based Drug Design," is a structure-based drug design framework that jointly models discrete atom types and continuous $3$D coordinates by multi-flow matching, then refines generation with Direct Preference Optimization (DPO) using AutoDock Vina score as a reward signal (Huang et al., 7 Jul 2025). A separate usage, “MolFORM/MultiModal-MoLFormer,” refers to a multimodal extension of MoLFormer for molecular property prediction that concatenates chemical-language embeddings with causally selected physicochemical descriptors (Soares et al., 2023). This suggests that the term is used most directly for the SBDD flow-matching model, while also appearing as a shorthand for a distinct property-prediction architecture.

1. Nomenclature and domain of use

The two documented uses of the name operate in different problem settings. One is a generative, protein-conditioned $3$D molecular design system; the other is a supervised property-prediction system built on SMILES embeddings and descriptor fusion.

Usage of “MolFORM”	Primary task	Core formulation
MolFORM (Huang et al., 7 Jul 2025)	Structure-based drug design	Multi-flow matching over atom types and $3$D coordinates, followed by DPO
MolFORM / MultiModal-MoLFormer (Soares et al., 2023)	Molecular property prediction	Concatenation of MoLFormer embeddings with causally selected Mordred descriptors

In the exact-title SBDD sense, MolFORM addresses protein-conditioned ligand generation. In the MoLFormer-derived sense, it addresses hard, low-data property prediction tasks such as PFAS toxicity and biodegradability classification. The distinction is substantive rather than terminological: the first is a non-autoregressive generative model over coupled discrete–continuous molecular modalities, whereas the second is a multimodal predictor over chemical language and physicochemical features.

2. Problem formulation in structure-based drug design

In the SBDD formulation, the objective is to generate a ligand $M$ conditioned on a protein pocket $P$ , that is, to model $p(M \mid P)$ (Huang et al., 7 Jul 2025). A ligand is represented as

$M = \{X, V\},$

where $X \in \mathbb{R}^{N_M \times 3}$ are $3$D coordinates, $V \in [k]^{N_M}$ are discrete atom types, and $3$0 is the number of ligand atoms. The central difficulty is that ligand design is intrinsically multi-modal: the model must determine both what atoms to place and where to place them in $3$1D.

The framework is positioned against a backdrop in which diffusion-based generative models are predominant in SBDD. MolFORM instead explores a non-autoregressive alternative based on flow matching. The motivation is that flow matching learns a transport map from a simple prior to the ligand distribution while naturally accommodating both discrete and continuous variables. This formulation treats chemistry and geometry as coupled but distinct generative factors rather than collapsing them into a single output space.

The architecture uses an SE(3)-equivariant GNN backbone, with alternating updates to atom embeddings and coordinates. This backbone choice is consistent with the problem setting: the model is explicitly tied to protein–ligand structural data and to $3$2D equivariant inductive bias rather than to sequence-only generation.

3. Multi-flow matching architecture

MolFORM builds on Conditional Flow Matching (CFM), which learns a time-dependent vector field transporting samples from a source distribution $3$3 to the target data distribution $3$4. Its continuous-time dynamics are written as

$3$5

with conditional flow-matching loss

$3$6

For the continuous branch, corresponding to $3$7D coordinates, the Euclidean objective reduces to a position MSE,

$3$8

and sampling proceeds by Euler integration,

$3$9

For the discrete branch, corresponding to atom types, MolFORM uses Discrete Flow Matching (DFM). Clean atom types are corrupted by uniform noising,

$3$0

with marginal noisy distribution

$3$1

The denoising objective is cross-entropy,

$3$2

Sampling uses a discrete Euler-style update,

$3$3

with rate matrix

$3$4

and posterior

$3$5

The two branches are coupled by the pretraining objective

$3$6

where the Chamfer term is

$3$7

This factorization is presented as important because it allows preference or learning signals to act on geometry and atom types with greater precision. The paper argues that such disentanglement reduces gradient interference and stabilizes optimization (Huang et al., 7 Jul 2025).

4. Preference-guided fine-tuning with DPO

After base training, MolFORM adds a preference alignment stage based on DPO (Huang et al., 7 Jul 2025). The preference dataset is

$3$8

where $3$9 is the protein pocket, $M$ 0 is the preferred ligand, and $M$ 1 is the less preferred ligand. Preferences are derived mainly from Vina score, and the dispreferred example is chosen as the molecule with the worst docking score in order to create a stronger preference gap.

The generic DPO objective is

$M$ 2

MolFORM’s distinctive refinement is a multi-flow DPO co-modeling strategy that distributes the preference signal across both modalities rather than applying it to only one. For the discrete branch, the paper gives

$M$ 3

and for geometry it uses a Chamfer-informed preference term,

$M$ 4

The intended effect is not only better binding affinity but also improved geometry and reduced mode collapse. The paper further notes that using only binding affinity as the reward still improves other properties, which it interprets as a shift of the overall generation distribution toward better ligands rather than narrow overfitting to a single metric.

5. Empirical performance, efficiency, and evaluation regime

Experiments are conducted on CrossDocked2020, starting from about $M$ 5 million docked protein-binding complexes and filtering to $M$ 6 protein-binding complexes for training and $M$ 7 novel complexes for testing, using criteria including RMSD $M$ 8 Å and sequence identity $M$ 9 (Huang et al., 7 Jul 2025). The comparison set includes LiGAN, 3DSBDD, GraphBP, Pocket2Mol, TargetDiff, DiffSBDD, D3FG, DecompDiff, MolCraft, VoxBind, DiffBP, and FLAG.

Base MolFORM is already competitive with strong diffusion-based baselines, especially TargetDiff, on binding and geometric quality. Reported values are approximately Vina Score $P$ 0, Vina Min $P$ 1, Vina Dock $P$ 2, QED $P$ 3, and SA $P$ 4. After preference tuning, MolFORM-DPO reports Vina Score $P$ 5, Vina Min $P$ 6, Vina Dock $P$ 7, QED $P$ 8, and SA $P$ 9, and is described as achieving state-of-the-art or near-state-of-the-art performance across nearly all metrics.

A particularly informative comparison is against TargetDiff under DPO. The paper reports TargetDiff-DPO at Vina Score $p(M \mid P)$ 0, Vina Min $p(M \mid P)$ 1, QED $p(M \mid P)$ 2, and SA $p(M \mid P)$ 3, versus MolFORM-DPO at $p(M \mid P)$ 4, $p(M \mid P)$ 5, $p(M \mid P)$ 6, and $p(M \mid P)$ 7, respectively. This is interpreted as evidence that the multi-flow factorization makes MolFORM more amenable to preference tuning. The paper also reports that diversity stays around $p(M \mid P)$ 8 after DPO.

The framework is also materially faster at generation than diffusion baselines. It requires about 69 seconds to generate $p(M \mid P)$ 9 samples, versus 3428 s for TargetDiff and 6189 s for DecompDiff. The paper attributes this to the efficiency of flow matching and to the use of only 100 integration steps. Training is reported on two NVIDIA GH200 GPUs: about 12 hours and 100k steps for the base model, then about 4 hours and 20k steps for DPO fine-tuning.

A separate arXiv usage of the term appears in the paper on multimodal property prediction, where MolFORM/MultiModal-MoLFormer extends MoLFormer by combining 768-dimensional embeddings with causally selected Mordred descriptors (Soares et al., 2023). The pipeline standardizes molecules with RDKit, extracts 1826 descriptors from Mordred, applies multistage causal feature selection using Markov blanket inference and Predictive Permutation Feature Selection, and then concatenates the selected descriptor vector with the chemical-language embedding before a prediction head with 2 fully connected layers. The descriptor set is reduced from 1826 $M = \{X, V\},$ 0 29 features for toxicity and 1826 $M = \{X, V\},$ 1 5 for biodegradability, yielding input sizes of 797 and 773, respectively. Reported results include $M = \{X, V\},$ 2, MAE $M = \{X, V\},$ 3, RMSE $M = \{X, V\},$ 4, and acc $M = \{X, V\},$ 5 for PFAS toxicity, and acc $M = \{X, V\},$ 6, specificity $M = \{X, V\},$ 7, and sensitivity $M = \{X, V\},$ 8 for biodegradability. This is therefore a distinct MolFORM usage centered on supervised property prediction rather than protein-conditioned molecular generation.

The name should also not be conflated with MolFusion, whose paper explicitly states that it is not a direct match for “MolFORM” (Cai et al., 2024). That clarification is useful because multimodal molecular representation learning has generated several similarly named frameworks, but their objectives differ sharply: MolFusion aligns SMILES and graph modalities at molecular and atomic levels, whereas MolFORM in the exact-title sense targets structure-based generation over atom identities and coordinates.

The SBDD MolFORM paper notes several practical observations and limitations. Uniform corruption worked better than masked discrete corruption for this molecular task. ODE Euler sampling outperformed SDE-style Euler–Maruyama sampling, though the authors indicate that stochastic sampling may require further hyperparameter tuning. The preference signal is based mainly on Vina score, so the DPO stage remains anchored to a relatively narrow reward proxy even if broader properties improve. The method also relies on protein–ligand structural data and an equivariant architecture, making its assumptions tightly coupled to $M = \{X, V\},$ 9D SBDD settings. Future work is explicitly suggested on other fine-tuning strategies and multi-objective optimization (Huang et al., 7 Jul 2025).