Papers
Topics
Authors
Recent
Search
2000 character limit reached

Universal Model for Atoms Overview

Updated 14 July 2026
  • Universal Model for Atoms is a unified framework that employs equivariant graph neural networks to predict interatomic energies, forces, and stresses across chemically diverse systems.
  • It integrates a Mixture-of-Linear-Experts mechanism with global task embeddings to enable zero-shot transfer across domains without domain-specific fine-tuning.
  • Empirical scaling laws and benchmark evaluations demonstrate UMA's efficiency and scalability in applications like crystal structure prediction and interatomic potential modeling.

Universal Model for Atoms, usually abbreviated UMA, denotes a family of equivariant graph neural network interatomic potentials trained on a single combined corpus of 459\sim 459 million DFT calculations, or 30\sim 30 billion atoms total, spanning materials, molecules, catalysts, molecular crystals, and metal-organic frameworks (Wood et al., 30 Jun 2025). Its central claim is that a single multi-task model, conditioned on atomic structure and global descriptors such as total charge, spin multiplicity, and the DFT task to emulate, can compute atomistic energies, forces, and stresses across chemically distinct domains without domain-specific fine-tuning (Wood et al., 30 Jun 2025). The term “universal” also appears in a different sense in few-body atomic physics, where it refers to van der Waals or Efimov parameter reduction rather than cross-domain machine-learning transfer (Wang et al., 2014, Kievsky et al., 2017).

1. Architectural formulation

UMA builds on an equivariant graph neural network in which node embeddings are constructed from per-atom spherical harmonics up to degree LmaxL_{\max}, initialized by atomic number and augmented by global embeddings for total charge, spin multiplicity, and a one-hot “task” vector identifying which DFT setting to emulate. Message passing is implemented through TT layers of SO(2) convolutions, each followed by node-wise feed-forward blocks and layer normalization. A single node-wise block predicts total energy, while forces and, optionally, stress are obtained either by direct heads during pre-training or by auto-gradients during fine-tuning (Wood et al., 30 Jun 2025).

The distinctive UMA mechanism is the Mixture-of-Linear-Experts (MoLE). Instead of a single linear map WW, each linear block uses KK experts {Wk}k=1K\{W_k\}_{k=1}^K combined through dense gating coefficients {αk}\{\alpha_k\}: y=k=1Kαk(Wkx),kαk=1.y=\sum_{k=1}^K \alpha_k\,(W_k x), \qquad \sum_k \alpha_k=1. Because the gating coefficients depend only on global features such as element composition, charge, spin, and DFT task, UMA can precompute

W=k=1KαkWk,y=Wx,W^*=\sum_{k=1}^K \alpha_k W_k, \qquad y=W^*x,

thereby preserving rotational equivariance and adding no extra cost at inference. The gating network is a 3-layer MLP plus softmax acting on the concatenated global embeddings (Wood et al., 30 Jun 2025).

In downstream documentation, the FastCSP deployment describes UMA as a message-passing, equivariant graph neural network that predicts total potential energy, atomic forces, and stress tensor from an atomic configuration 30\sim 300, with

30\sim 301

That account states that the practical implementation uses the eSEN architecture, where the neighbor interaction 30\sim 302 is realized by a self-attention module within a cutoff 30\sim 303, node updates and readouts are built from gated equivariant layers, and a MoLE head is used in the final readout to scale model capacity while preserving fast inference (Gharakhanyan et al., 4 Aug 2025).

2. Training corpus, preprocessing, and optimization

UMA is trained on a single combined dataset of approximately half a billion DFT calculations assembled from five public benchmarks. The constituent datasets are OMat24 with 100 million samples over 89 elements using PBE/VASP and sampling weight 30\sim 304; OMol25 with 76 million samples over 83 elements using 30\sim 305B97M-V/ORCA and weight 30\sim 306; OC20++ with 229 million samples over 56 elements using RPBE/VASP and weight 30\sim 307; OMC25 with 25 million samples over 12 elements using PBE-D3/VASP and weight 30\sim 308; and ODAC25 with 29 million samples over 70 elements using PBE-D3/VASP and weight 30\sim 309 (Wood et al., 30 Jun 2025).

To merge these chemically and methodologically distinct sources into a single multi-task model, UMA introduces a global task embedding, applies a heat-of-formation referencing of the total energy,

LmaxL_{\max}0

normalizes all labels by their force-RMS, and samples from each dataset in proportion to its assigned weight (Wood et al., 30 Jun 2025). The need for an explicit task embedding is a reminder that UMA is universal across several electronic-structure domains, but not agnostic to the reference method.

Training follows a two-stage schedule. In the pre-training stage, UMA uses BF16 precision, a direct force head without autograd, radius cutoff LmaxL_{\max}1 Å, max-neighbors LmaxL_{\max}2, AdamW optimization, cosine learning-rate schedule with peak LmaxL_{\max}3, warm-up LmaxL_{\max}4 of steps, and weight decay LmaxL_{\max}5. The number of pre-train steps is LmaxL_{\max}6M for UMA-S, LmaxL_{\max}7M for UMA-M, and LmaxL_{\max}8M for UMA-L. The loss is

LmaxL_{\max}9

with TT0 and TT1, except TT2 for OMol25 energy (Wood et al., 30 Jun 2025).

In the fine-tuning stage, UMA switches to FP32 precision, uses autograd for conservative forces and stress, increases max-neighbors to TT3 while keeping the same radius, applies a cosine schedule with peak learning rate TT4, warm-up TT5, and weight decay TT6, and runs TT7M steps for UMA-S, TT8M for UMA-M, and TT9M for UMA-L. The fine-tuning objective is

WW0

with WW1, WW2, and WW3 (Wood et al., 30 Jun 2025).

3. Scaling laws and computational profile

A notable feature of UMA is that it is accompanied by explicit empirical scaling laws. Training compute is approximated as

WW4

with WW5 FLOPs per parameter per atom for UMA-M. On the compute-optimal frontier, the optimal model size and dataset size satisfy

WW6

The fitted exponents are WW7 for dense models and WW8 for MoLE models (Wood et al., 30 Jun 2025).

Restricting to that frontier, the validation loss follows

WW9

with KK0 for dense models and KK1 for MoLE models. The corresponding interpretation given in the paper is that an MoLE model can match the loss of a dense model with approximately KK2 fewer active parameters (Wood et al., 30 Jun 2025).

The three released sizes illustrate how this trade-off is operationalized. UMA-S has KK3M total parameters with KK4M active parameters and KK5 experts; UMA-M has KK6B total parameters with KK7M active parameters and KK8 experts; UMA-L has KK9M parameters and is dense. Inference measurements, excluding graph-construction overhead, are reported on a single H100 GPU for a periodic system with {Wk}k=1K\{W_k\}_{k=1}^K0 neighbors per atom in TF32. At {Wk}k=1K\{W_k\}_{k=1}^K1 atoms the speeds are {Wk}k=1K\{W_k\}_{k=1}^K2, {Wk}k=1K\{W_k\}_{k=1}^K3, and {Wk}k=1K\{W_k\}_{k=1}^K4 steps per second for UMA-S, UMA-M, and UMA-L, respectively; at {Wk}k=1K\{W_k\}_{k=1}^K5 atoms they are {Wk}k=1K\{W_k\}_{k=1}^K6, {Wk}k=1K\{W_k\}_{k=1}^K7, and OOM; and at {Wk}k=1K\{W_k\}_{k=1}^K8 atoms UMA-S reaches {Wk}k=1K\{W_k\}_{k=1}^K9 steps per second while the larger models are OOM (Wood et al., 30 Jun 2025). This profile explains why the “universal” claim is tied not only to accuracy but also to the feasibility of running one model across many atomistic workloads.

4. Zero-shot evaluation across domains

UMA is evaluated in a zero-shot setting, meaning without domain-specific fine-tuning, across benchmarks in materials, catalysis, molecules, molecular crystals, and metal-organic frameworks. On Matbench Discovery, higher F1 is better, and the reported values are {αk}\{\alpha_k\}0 for UMA-S, {αk}\{\alpha_k\}1 for UMA-M, and {αk}\{\alpha_k\}2 for UMA-L, compared with {αk}\{\alpha_k\}3 for eSEN-30M. On OC20 S2EF adsorption, UMA-M reports adsorption-energy errors of {αk}\{\alpha_k\}4 meV ID and {αk}\{\alpha_k\}5 meV OOD, with force MAE {αk}\{\alpha_k\}6 meV ID and {αk}\{\alpha_k\}7 meV OOD; the comparison entry eV{αk}\{\alpha_k\}8-OC20 reports {αk}\{\alpha_k\}9, y=k=1Kαk(Wkx),kαk=1.y=\sum_{k=1}^K \alpha_k\,(W_k x), \qquad \sum_k \alpha_k=1.0, y=k=1Kαk(Wkx),kαk=1.y=\sum_{k=1}^K \alpha_k\,(W_k x), \qquad \sum_k \alpha_k=1.1, and y=k=1Kαk(Wkx),kαk=1.y=\sum_{k=1}^K \alpha_k\,(W_k x), \qquad \sum_k \alpha_k=1.2 meV, respectively (Wood et al., 30 Jun 2025).

On AdsorbML, the global-minima success rates are y=k=1Kαk(Wkx),kαk=1.y=\sum_{k=1}^K \alpha_k\,(W_k x), \qquad \sum_k \alpha_k=1.3, y=k=1Kαk(Wkx),kαk=1.y=\sum_{k=1}^K \alpha_k\,(W_k x), \qquad \sum_k \alpha_k=1.4, and y=k=1Kαk(Wkx),kαk=1.y=\sum_{k=1}^K \alpha_k\,(W_k x), \qquad \sum_k \alpha_k=1.5 for UMA-S, UMA-M, and UMA-L, compared with y=k=1Kαk(Wkx),kαk=1.y=\sum_{k=1}^K \alpha_k\,(W_k x), \qquad \sum_k \alpha_k=1.6 for the eVy=k=1Kαk(Wkx),kαk=1.y=\sum_{k=1}^K \alpha_k\,(W_k x), \qquad \sum_k \alpha_k=1.7 baseline. On OMol25 OOD-Comp, the energy error y=k=1Kαk(Wkx),kαk=1.y=\sum_{k=1}^K \alpha_k\,(W_k x), \qquad \sum_k \alpha_k=1.8 is y=k=1Kαk(Wkx),kαk=1.y=\sum_{k=1}^K \alpha_k\,(W_k x), \qquad \sum_k \alpha_k=1.9, W=k=1KαkWk,y=Wx,W^*=\sum_{k=1}^K \alpha_k W_k, \qquad y=W^*x,0, and W=k=1KαkWk,y=Wx,W^*=\sum_{k=1}^K \alpha_k W_k, \qquad y=W^*x,1 meV/atom for UMA-S, UMA-M, and UMA-L, compared with W=k=1KαkWk,y=Wx,W^*=\sum_{k=1}^K \alpha_k W_k, \qquad y=W^*x,2 meV/atom for eSEN-OMol. On OMC25 crystal lattices, W=k=1KαkWk,y=Wx,W^*=\sum_{k=1}^K \alpha_k W_k, \qquad y=W^*x,3 is W=k=1KαkWk,y=Wx,W^*=\sum_{k=1}^K \alpha_k W_k, \qquad y=W^*x,4, W=k=1KαkWk,y=Wx,W^*=\sum_{k=1}^K \alpha_k W_k, \qquad y=W^*x,5, and W=k=1KαkWk,y=Wx,W^*=\sum_{k=1}^K \alpha_k W_k, \qquad y=W^*x,6 meV/atom for UMA-S, UMA-M, and UMA-L, compared with W=k=1KαkWk,y=Wx,W^*=\sum_{k=1}^K \alpha_k W_k, \qquad y=W^*x,7 meV/atom for eSEN-OMC. On ODAC25 MOF adsorption, the OOD adsorption-energy errors are W=k=1KαkWk,y=Wx,W^*=\sum_{k=1}^K \alpha_k W_k, \qquad y=W^*x,8, W=k=1KαkWk,y=Wx,W^*=\sum_{k=1}^K \alpha_k W_k, \qquad y=W^*x,9, and 30\sim 3000 meV for UMA-S, UMA-M, and UMA-L, compared with 30\sim 3001 meV for eqV2-ODAC (Wood et al., 30 Jun 2025).

These results underwrite the paper’s central contention that a single, unfine-tuned model can perform similarly or better than specialist models across heterogeneous chemical domains. They also clarify that “universality” in UMA is empirical rather than axiomatic: it is established by cross-benchmark transfer under shared training and inference rules, not by a proof of method-independence.

5. Molecular-crystal structure prediction with FastCSP

A concrete downstream realization of UMA is FastCSP, an open-source, high-throughput crystal-structure-prediction workflow for molecular crystals. Its workflow proceeds through six stages: random-structure generation via Genarris 3.0 using 30\sim 3002 structures per space group and up to 30\sim 3003; pre-filtering by rigid-press compression and pymatgen deduplication; full geometry and lattice relaxation with UMA, discarding failures or connectivity changes; second deduplication with retention of structures within 30\sim 3004 kJ/mol of the global minimum; optional finite-temperature free-energy evaluation with UMA through harmonic approximation phonons in Phonopy and quasi-harmonic approximation using a Vinet EOS and Legendre transform to obtain 30\sim 3005; and final ranking by UMA lattice energy or free energy at the desired 30\sim 3006 (Gharakhanyan et al., 4 Aug 2025).

In that workflow, the UMA-S-1.1 “Small” model is benchmarked against PBE-D3 on 30\sim 3007 mostly rigid molecules covering 30\sim 3008 experimental polymorphs. The reported potential-energy-surface fidelity is a relative lattice-energy MAE of 30\sim 3009 kJ/mol per molecule with Spearman rank 30\sim 3010. The reported geometry-relaxation agreement is average 30\sim 3011 Å, with 30\sim 3012 of UMA-relaxed structures matching PBE-D3 topology under 30\sim 3013 Å. In terms of CSP recall, 30\sim 3014 of known polymorphs lie within the top-10 UMA-ranked minima at 30\sim 3015 K lattice energy, and all known forms are within 30\sim 3016 kJ/mol of the global minimum according to UMA. On an NVIDIA H100 with 30\sim 3017 GB memory, a full relaxation of one crystal takes approximately 30\sim 3018 s (Gharakhanyan et al., 4 Aug 2025).

FastCSP is also where several practical limits of the UMA paradigm are made explicit. The manuscript notes larger errors for chemistry not well represented in OMC25, exemplified by diazide–carbonyl interactions in Target XVI; it states that the workflow has not yet been tested on molecules with extensive conformational flexibility 30\sim 3019, co-crystals, salts, hydrates, or solvates; and it remarks that final ranking of 30\sim 3020 differences below 30\sim 3021 kJ/mol may still require higher-level DFT such as PBE0+MBD for some systems, including glycine polymorphs (Gharakhanyan et al., 4 Aug 2025). Thus, the crystal-structure-prediction application presents UMA as a high-accuracy production model, but not as a complete replacement for all higher-level electronic-structure verification.

6. Broader scope and distinct meanings of “universality”

Later work in biomolecular simulation places UMA within a broader landscape of atomic foundation models. UBio-MolFM introduces UBio-Mol26, a 30\sim 3022-million-frame training set, E2Former-V2 with Equivariant Axis-Aligned Sparsification and Long-Short Range modeling, and a Three-Stage Curriculum Learning protocol for large bio-systems. In its large-system benchmarks, E2Former-V2 reports approximately 30\sim 3023 higher inference throughput than state-of-the-art equivariant models, specifically UMA-S and MACE, on 30\sim 3024–30\sim 3025K atom systems, while targeting ab initio-level fidelity for systems up to approximately 30\sim 3026 atoms (Huang et al., 13 Feb 2026). A plausible implication is that UMA has become a reference point against which later domain-specialized universal atomic models are measured.

A different research tradition uses “universal” in the sense of low-energy few-body physics. In the universal van der Waals model for three ultracold atoms, the entire two-spin, two-channel Feshbach resonance is characterized by the two dimensionless two-body parameters 30\sim 3027 and 30\sim 3028, together with the van der Waals length 30\sim 3029. The three-body Schrödinger equation is solved in hyperspherical coordinates with pairwise Lennard-Jones 30\sim 3030–30\sim 3031 potentials, and the resulting theory predicts three-body recombination and atom-dimer collision rates without adjustable fitting parameters. For ultracold Cs near 30\sim 3032 G, using 30\sim 3033 and 30\sim 3034, the model reproduces the first Efimov recombination resonance at 30\sim 3035, the double-minimum structure in recombination at small 30\sim 3036, and the atom-dimer loss resonance at 30\sim 3037 (Wang et al., 2014).

Near the unitary limit in three-boson systems, universality is expressed through the angle 30\sim 3038 defined by 30\sim 3039, the three-body parameter 30\sim 3040, and Efimov relations such as

30\sim 3041

for the ground state. In that framework, the atom-dimer scattering length obeys

30\sim 3042

with 30\sim 3043, 30\sim 3044, and 30\sim 3045, and finite-range corrections are studied with local and non-local Gaussian potentials fixed to reproduce 30\sim 3046. For three 30\sim 3047He atoms, mapping a Gaussian model to the LM2M2 potential gives 30\sim 3048, compared with direct LM2M2 calculations of approximately 30\sim 3049 (Kievsky et al., 2017).

This distinction suggests that the same adjective labels two different scientific programs. In current computational chemistry and materials science, “Universal Model for Atoms” refers to a trained cross-domain interatomic-potential family such as UMA (Wood et al., 30 Jun 2025). In AMO few-body physics, “universal” refers instead to the compression of observables into a small set of low-energy scales and dimensionless parameters (Wang et al., 2014, Kievsky et al., 2017).

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Universal Model for Atoms.