---
title: Universal Model for Atoms Overview
url: https://www.emergentmind.com/topics/universal-model-for-atoms
type: topic
---

# Universal Model for Atoms Overview

Universal Model for Atoms, usually abbreviated UMA, denotes a family of equivariant graph neural network interatomic potentials trained on a single combined corpus of \(\sim 459\) million DFT calculations, or \(\sim 30\) billion atoms total, spanning materials, molecules, catalysts, molecular crystals, and metal-organic frameworks [2506.23971]. Its central claim is that a single multi-task model, conditioned on atomic structure and global descriptors such as total charge, spin multiplicity, and the DFT task to emulate, can compute atomistic energies, forces, and stresses across chemically distinct domains without domain-specific fine-tuning [2506.23971]. The term “universal” also appears in a different sense in few-body atomic physics, where it refers to van der Waals or Efimov parameter reduction rather than cross-domain machine-learning transfer [1404.0483][1702.06465].

## 1. Architectural formulation

UMA builds on an equivariant graph neural network in which node embeddings are constructed from per-atom spherical harmonics up to degree \(L_{\max}\), initialized by atomic number and augmented by global embeddings for total charge, spin multiplicity, and a one-hot “task” vector identifying which DFT setting to emulate. Message passing is implemented through \(T\) layers of SO(2) convolutions, each followed by node-wise feed-forward blocks and layer normalization. A single node-wise block predicts total energy, while forces and, optionally, stress are obtained either by direct heads during pre-training or by auto-gradients during fine-tuning [2506.23971].

The distinctive UMA mechanism is the Mixture-of-Linear-Experts (MoLE). Instead of a single linear map \(W\), each linear block uses \(K\) experts \(\{W_k\}_{k=1}^K\) combined through dense gating coefficients \(\{\alpha_k\}\):
\[
y=\sum_{k=1}^K \alpha_k\,(W_k x), \qquad \sum_k \alpha_k=1.
\]
Because the gating coefficients depend only on global features such as element composition, charge, spin, and DFT task, UMA can precompute
\[
W^*=\sum_{k=1}^K \alpha_k W_k, \qquad y=W^*x,
\]
thereby preserving rotational equivariance and adding no extra cost at inference. The gating network is a 3-layer MLP plus softmax acting on the concatenated global embeddings [2506.23971].

In downstream documentation, the FastCSP deployment describes UMA as a message-passing, equivariant graph neural network that predicts total potential energy, atomic forces, and stress tensor from an atomic configuration \(\{R_i,Z_i\}\), with
\[
E_{\rm tot}=\sum_i E_i,\qquad F_i=-\nabla_{R_i}E_{\rm tot},\qquad \sigma_{\alpha\beta}=\frac{1}{V}\frac{\partial E_{\rm tot}}{\partial \varepsilon_{\alpha\beta}}.
\]
That account states that the practical implementation uses the eSEN architecture, where the neighbor interaction \(\phi\) is realized by a self-attention module within a cutoff \(R_{\rm cut}\), node updates and readouts are built from gated equivariant layers, and a MoLE head is used in the final readout to scale model capacity while preserving fast inference [2508.02641].

## 2. Training corpus, preprocessing, and optimization

UMA is trained on a single combined dataset of approximately half a billion DFT calculations assembled from five public benchmarks. The constituent datasets are OMat24 with 100 million samples over 89 elements using PBE/VASP and sampling weight \(4\); OMol25 with 76 million samples over 83 elements using \(\omega\)B97M-V/ORCA and weight \(4\); OC20++ with 229 million samples over 56 elements using RPBE/VASP and weight \(1\); OMC25 with 25 million samples over 12 elements using PBE-D3/VASP and weight \(2\); and ODAC25 with 29 million samples over 70 elements using PBE-D3/VASP and weight \(1\) [2506.23971].

To merge these chemically and methodologically distinct sources into a single multi-task model, UMA introduces a global task embedding, applies a heat-of-formation referencing of the total energy,
\[
E_{\rm ref}=E_{\rm DFT}-\sum_{i=1}^n \bigl[E_{i,\rm DFT}-\Delta H_{f,i}\bigr],
\]
normalizes all labels by their force-RMS, and samples from each dataset in proportion to its assigned weight [2506.23971]. The need for an explicit task embedding is a reminder that UMA is universal across several electronic-structure domains, but not agnostic to the reference method.

Training follows a two-stage schedule. In the pre-training stage, UMA uses BF16 precision, a direct force head without autograd, radius cutoff \(6\) Å, max-neighbors \(=30\), AdamW optimization, cosine learning-rate schedule with peak \(8\times 10^{-4}\), warm-up \(1\%\) of steps, and weight decay \(10^{-3}\). The number of pre-train steps is \(1.68\)M for UMA-S, \(2.08\)M for UMA-M, and \(2.58\)M for UMA-L. The loss is
\[
\mathcal{L}_{\rm pre}=\lambda_E\|\hat E-E\|^2+\lambda_F\|\hat F-F\|^2,
\]
with \(\lambda_E=10\) and \(\lambda_F=30\), except \(\lambda_E=30\) for OMol25 energy [2506.23971].

In the fine-tuning stage, UMA switches to FP32 precision, uses autograd for conservative forces and stress, increases max-neighbors to \(300\) while keeping the same radius, applies a cosine schedule with peak learning rate \(4\times 10^{-4}\), warm-up \(1\%\), and weight decay \(10^{-3}\), and runs \(1.0\)M steps for UMA-S, \(0.545\)M for UMA-M, and \(0.350\)M for UMA-L. The fine-tuning objective is
\[
\mathcal{L}_{\rm fine}=\lambda_E\|\hat E-E\|^2+\lambda_F\|\hat F-F\|^2+\lambda_S\|\hat \sigma-\sigma\|^2,
\]
with \(\lambda_E=20\), \(\lambda_F=2\), and \(\lambda_S=1\) [2506.23971].

## 3. Scaling laws and computational profile

A notable feature of UMA is that it is accompanied by explicit empirical scaling laws. Training compute is approximated as
\[
C\approx \kappa\,N_{\rm param}\,D_{\rm atoms},
\]
with \(\kappa\approx 270\) FLOPs per parameter per atom for UMA-M. On the compute-optimal frontier, the optimal model size and dataset size satisfy
\[
N^*(C)\propto C^\alpha,\qquad D^*(C)\propto C^\beta.
\]
The fitted exponents are \((\alpha,\beta)=(0.61,0.39)\) for dense models and \((0.56,0.44)\) for MoLE models [2506.23971].

Restricting to that frontier, the validation loss follows
\[
\log L\approx \hat \alpha \log N^*+\gamma,
\]
with \((\hat \alpha,\gamma)=(-0.29,2.16)\) for dense models and \(( -0.25,1.82)\) for MoLE models. The corresponding interpretation given in the paper is that an MoLE model can match the loss of a dense model with approximately \(2.5\times\) fewer active parameters [2506.23971].

The three released sizes illustrate how this trade-off is operationalized. UMA-S has \(150\)M total parameters with \(6\)M active parameters and \(32\) experts; UMA-M has \(1.4\)B total parameters with \(\sim 50\)M active parameters and \(32\) experts; UMA-L has \(700\)M parameters and is dense. Inference measurements, excluding graph-construction overhead, are reported on a single H100 GPU for a periodic system with \(\sim 50\) neighbors per atom in TF32. At \(1{,}000\) atoms the speeds are \(16\), \(3\), and \(1.6\) steps per second for UMA-S, UMA-M, and UMA-L, respectively; at \(10{,}000\) atoms they are \(1.6\), \(0.2\), and OOM; and at \(100{,}000\) atoms UMA-S reaches \(0.1\) steps per second while the larger models are OOM [2506.23971]. This profile explains why the “universal” claim is tied not only to accuracy but also to the feasibility of running one model across many atomistic workloads.

## 4. Zero-shot evaluation across domains

UMA is evaluated in a zero-shot setting, meaning without domain-specific fine-tuning, across benchmarks in materials, catalysis, molecules, molecular crystals, and metal-organic frameworks. On Matbench Discovery, higher F1 is better, and the reported values are \(0.916\) for UMA-S, \(0.930\) for UMA-M, and \(0.928\) for UMA-L, compared with \(0.925\) for eSEN-30M. On OC20 S2EF adsorption, UMA-M reports adsorption-energy errors of \(33.4\) meV ID and \(46.5\) meV OOD, with force MAE \(16.0\) meV ID and \(21.0\) meV OOD; the comparison entry eV\(^2\)-OC20 reports \(149.1\), \(306.5\), \(11.6\), and \(15.7\) meV, respectively [2506.23971].

On AdsorbML, the global-minima success rates are \(68.4\%\), \(71.1\%\), and \(74.4\%\) for UMA-S, UMA-M, and UMA-L, compared with \(60.8\%\) for the eV\(^2\) baseline. On OMol25 OOD-Comp, the energy error \(\varepsilon_{E/{\rm atom}}\) is \(3.64\), \(3.26\), and \(2.33\) meV/atom for UMA-S, UMA-M, and UMA-L, compared with \(3.67\) meV/atom for eSEN-OMol. On OMC25 crystal lattices, \(\varepsilon_{E/{\rm atom}}\) is \(0.91\), \(0.82\), and \(0.59\) meV/atom for UMA-S, UMA-M, and UMA-L, compared with \(1.05\) meV/atom for eSEN-OMC. On ODAC25 MOF adsorption, the OOD adsorption-energy errors are \(292.4\), \(290.2\), and \(291.1\) meV for UMA-S, UMA-M, and UMA-L, compared with \(316.0\) meV for eqV2-ODAC [2506.23971].

These results underwrite the paper’s central contention that a single, unfine-tuned model can perform similarly or better than specialist models across heterogeneous chemical domains. They also clarify that “universality” in UMA is empirical rather than axiomatic: it is established by cross-benchmark transfer under shared training and inference rules, not by a proof of method-independence.

## 5. Molecular-crystal structure prediction with FastCSP

A concrete downstream realization of UMA is FastCSP, an open-source, high-throughput crystal-structure-prediction workflow for molecular crystals. Its workflow proceeds through six stages: random-structure generation via Genarris 3.0 using \(500\) structures per space group and up to \(Z=8\); pre-filtering by rigid-press compression and pymatgen deduplication; full geometry and lattice relaxation with UMA, discarding failures or connectivity changes; second deduplication with retention of structures within \(20\) kJ/mol of the global minimum; optional finite-temperature free-energy evaluation with UMA through harmonic approximation phonons in Phonopy and quasi-harmonic approximation using a Vinet EOS and Legendre transform to obtain \(G(T,P)\); and final ranking by UMA lattice energy or free energy at the desired \((T,P)\) [2508.02641].

In that workflow, the UMA-S-1.1 “Small” model is benchmarked against PBE-D3 on \(28\) mostly rigid molecules covering \(36\) experimental polymorphs. The reported potential-energy-surface fidelity is a relative lattice-energy MAE of \(1.16\) kJ/mol per molecule with Spearman rank \(\rho \approx 0.94\). The reported geometry-relaxation agreement is average \(\mathrm{RMSD}_{30}=0.22\) Å, with \(90\%\) of UMA-relaxed structures matching PBE-D3 topology under \(\mathrm{RMSD}_{30}<1\) Å. In terms of CSP recall, \(94\%\) of known polymorphs lie within the top-10 UMA-ranked minima at \(0\) K lattice energy, and all known forms are within \(5\) kJ/mol of the global minimum according to UMA. On an NVIDIA H100 with \(80\) GB memory, a full relaxation of one crystal takes approximately \(15\) s [2508.02641].

FastCSP is also where several practical limits of the UMA paradigm are made explicit. The manuscript notes larger errors for chemistry not well represented in OMC25, exemplified by diazide–carbonyl interactions in Target XVI; it states that the workflow has not yet been tested on molecules with extensive conformational flexibility \((Z' > 1)\), co-crystals, salts, hydrates, or solvates; and it remarks that final ranking of \(\Delta E\) differences below \(1\) kJ/mol may still require higher-level DFT such as PBE0+MBD for some systems, including glycine polymorphs [2508.02641]. Thus, the crystal-structure-prediction application presents UMA as a high-accuracy production model, but not as a complete replacement for all higher-level electronic-structure verification.

## 6. Broader scope and distinct meanings of “universality”

Later work in biomolecular simulation places UMA within a broader landscape of atomic foundation models. UBio-MolFM introduces UBio-Mol26, a \(17\)-million-frame training set, E2Former-V2 with Equivariant Axis-Aligned Sparsification and Long-Short Range modeling, and a Three-Stage Curriculum Learning protocol for large bio-systems. In its large-system benchmarks, E2Former-V2 reports approximately \(4\times\) higher inference throughput than state-of-the-art equivariant models, specifically UMA-S and MACE, on \(1\)–\(50\)K atom systems, while targeting ab initio-level fidelity for systems up to approximately \(1{,}500\) atoms [2602.17709]. A plausible implication is that UMA has become a reference point against which later domain-specialized universal atomic models are measured.

A different research tradition uses “universal” in the sense of low-energy few-body physics. In the universal van der Waals model for three ultracold atoms, the entire two-spin, two-channel Feshbach resonance is characterized by the two dimensionless two-body parameters \(r_{\rm bg}\equiv a_{\rm bg}/r_{\rm vdW}\) and \(s_{\rm res}\), together with the van der Waals length \(r_{\rm vdW}=\tfrac12 (mC_6/\hbar^2)^{1/4}\). The three-body Schrödinger equation is solved in hyperspherical coordinates with pairwise Lennard-Jones \(6\)–\(12\) potentials, and the resulting theory predicts three-body recombination and atom-dimer collision rates without adjustable fitting parameters. For ultracold Cs near \(-11.7\) G, using \(a_{\rm bg}\approx 16.8\,r_{\rm vdW}\) and \(s_{\rm res}\approx 560\), the model reproduces the first Efimov recombination resonance at \(a_-^*\approx -9.3\,r_{\rm vdW}\), the double-minimum structure in recombination at small \(a\), and the atom-dimer loss resonance at \(a_+^*\approx 4.7\,r_{\rm vdW}\) [1404.0483].

Near the unitary limit in three-boson systems, universality is expressed through the angle \(\xi\) defined by \(E_3/E_2=\tan^2 \xi\), the three-body parameter \(\kappa_*\), and Efimov relations such as
\[
\kappa_* a=\frac{e^{-\Delta(\xi)/(2s_0)}}{\cos \xi}
\]
for the ground state. In that framework, the atom-dimer scattering length obeys
\[
\frac{a_{AD}}{a}=d_1+d_2\tan\!\bigl[s_0\ln(\kappa_* a)+d_3\bigr],
\]
with \(d_1\approx 1.46\), \(d_2\approx 2.15\), and \(d_3\approx 0.09\), and finite-range corrections are studied with local and non-local Gaussian potentials fixed to reproduce \((a,E_2)\). For three \(^4\)He atoms, mapping a Gaussian model to the LM2M2 potential gives \(a_{AD}\approx 212\,a_0\), compared with direct LM2M2 calculations of approximately \(217\,a_0\) [1702.06465].

This distinction suggests that the same adjective labels two different scientific programs. In current computational chemistry and materials science, “Universal Model for Atoms” refers to a trained cross-domain interatomic-potential family such as UMA [2506.23971]. In AMO few-body physics, “universal” refers instead to the compression of observables into a small set of low-energy scales and dimensionless parameters [1404.0483][1702.06465].

Source: https://www.emergentmind.com/topics/universal-model-for-atoms