Papers
Topics
Authors
Recent
Search
2000 character limit reached

Equivariant U-Shaped Neural Operator (E-UNO)

Updated 5 July 2026
  • The paper demonstrates that E-UNO significantly reduces prediction errors in Cahn–Hilliard simulations, achieving up to an order-of-magnitude improvement over FNO.
  • The method employs a unique combination of global spectral convolution and hierarchical U-shaped architecture to capture both global coupling and local high-frequency structures.
  • Equivariance regularization with respect to the dihedral group stabilizes training, enforces symmetry, and ensures physically consistent phase evolution.

Equivariant U-Shaped Neural Operator (E-UNO) is a neural-operator architecture introduced for the Cahn–Hilliard phase-field model, where the objective is to learn the evolution of the phase-field variable from short histories of past dynamics. The model combines global spectral convolution, a multi-resolution U-shaped architecture, and an explicit equivariance regularization aligned with the symmetries of the underlying dynamics. In the reported study, E-UNO is presented as an efficient surrogate for complex phase-field systems, with improved accuracy over standard Fourier neural operator (FNO) and U-shaped neural operator (UNO) baselines, particularly on fine-scale and high-frequency structures (Xue et al., 1 Sep 2025).

1. Governing equation and operator-learning setting

The target physical system is the Cahn–Hilliard model for phase separation in binary mixtures. In the formulation used for E-UNO, the free energy is

F[Φ]=Ω(λϵW(Φ)+λϵ2Φ2)dx,W(Φ)=14(Φ21)2,F[\Phi] = \int_\Omega \left( \frac{\lambda}{\epsilon} W(\Phi) + \frac{\lambda \epsilon}{2} |\nabla \Phi|^2 \right) dx, \qquad W(\Phi)=\frac{1}{4}(\Phi^2-1)^2,

on a domain ΩRd\Omega \subset \mathbb{R}^d with d=2,3d=2,3 and time interval T=(0,Tf)T=(0,T_f). The strong form is

Φt=(γ(Φ)μ),\frac{\partial \Phi}{\partial t} = \nabla \cdot (\gamma(\Phi)\nabla \mu),

μ=δFδΦ=λ(Φ(Φ21)ϵϵΔΦ),\mu = \frac{\delta F}{\delta \Phi} = \lambda \left( \frac{\Phi(\Phi^2-1)}{\epsilon} - \epsilon \Delta \Phi \right),

with homogeneous Neumann boundary conditions

nΦ=0,nμ=0on Ω.n\cdot \nabla \Phi = 0,\qquad n\cdot \nabla \mu = 0 \quad \text{on } \partial \Omega.

The model satisfies mass conservation and energy dissipation,

ddtF[Φ]=Ωγμ2dx0.\frac{d}{dt} F[\Phi] = - \int_\Omega \gamma |\nabla \mu|^2 dx \le 0.

For constant mobility γ1\gamma \equiv 1, the formulation recovers classical spinodal-decomposition dynamics (Xue et al., 1 Sep 2025).

A spectral weak formulation on a periodic $2$D grid ΩRd\Omega \subset \mathbb{R}^d0 is written by expanding ΩRd\Omega \subset \mathbb{R}^d1 and ΩRd\Omega \subset \mathbb{R}^d2 in Fourier modes ΩRd\Omega \subset \mathbb{R}^d3 and enforcing

ΩRd\Omega \subset \mathbb{R}^d4

Within the operator-learning viewpoint, the short-window temporal evolution is treated as an operator

ΩRd\Omega \subset \mathbb{R}^d5

mapping

ΩRd\Omega \subset \mathbb{R}^d6

between the Bochner spaces

ΩRd\Omega \subset \mathbb{R}^d7

In practice, space is discretized on ΩRd\Omega \subset \mathbb{R}^d8 and time-stepped with ΩRd\Omega \subset \mathbb{R}^d9, while a neural operator d=2,3d=2,30 is trained by minimizing a data loss in either an d=2,3d=2,31 or d=2,3d=2,32 sense.

2. Architectural composition of E-UNO

E-UNO is defined by three coupled design elements: global spectral convolution, a U-shaped multi-resolution backbone, and equivariance regularization. The architecture is intended to capture both nonlocal coupling and multiscale structure, which is central for Cahn–Hilliard dynamics (Xue et al., 1 Sep 2025).

The Fourier layers implement global spectral convolution. At layer d=2,3d=2,33, a feature field d=2,3d=2,34 is mapped to d=2,3d=2,35 by

d=2,3d=2,36

where

d=2,3d=2,37

and d=2,3d=2,38 is learned for modes d=2,3d=2,39 and zero otherwise. The stated effect is a mesh-independent, global, translation-invariant convolution in spectral space.

The U-shaped encoder–decoder contains T=(0,Tf)T=(0,T_f)0 spectral blocks with feature widths

T=(0,Tf)T=(0,T_f)1

and spatial scalings

T=(0,Tf)T=(0,T_f)2

The architecture uses average-pool by T=(0,Tf)T=(0,T_f)3 at layers T=(0,Tf)T=(0,T_f)4–T=(0,Tf)T=(0,T_f)5, a bottleneck at layer T=(0,Tf)T=(0,T_f)6 with T=(0,Tf)T=(0,T_f)7, bilinear-interpolate by T=(0,Tf)T=(0,T_f)8 at layers T=(0,Tf)T=(0,T_f)9–Φt=(γ(Φ)μ),\frac{\partial \Phi}{\partial t} = \nabla \cdot (\gamma(\Phi)\nabla \mu),0, and skip connections that add encoder features to decoder features at matching resolutions. The input Φt=(γ(Φ)μ),\frac{\partial \Phi}{\partial t} = \nabla \cdot (\gamma(\Phi)\nabla \mu),1 is lifted via Φt=(γ(Φ)μ),\frac{\partial \Phi}{\partial t} = \nabla \cdot (\gamma(\Phi)\nabla \mu),2, processed through the Φt=(γ(Φ)μ),\frac{\partial \Phi}{\partial t} = \nabla \cdot (\gamma(\Phi)\nabla \mu),3 spectral U-blocks, and projected back to the phase-field space via Φt=(γ(Φ)μ),\frac{\partial \Phi}{\partial t} = \nabla \cdot (\gamma(\Phi)\nabla \mu),4.

A concise architectural summary is given below.

Component Specification Role
Spectral blocks Φt=(γ(Φ)μ),\frac{\partial \Phi}{\partial t} = \nabla \cdot (\gamma(\Phi)\nabla \mu),5 Core U-shaped backbone
Channel widths Φt=(γ(Φ)μ),\frac{\partial \Phi}{\partial t} = \nabla \cdot (\gamma(\Phi)\nabla \mu),6 Multi-resolution feature hierarchy
Spatial scalings Φt=(γ(Φ)μ),\frac{\partial \Phi}{\partial t} = \nabla \cdot (\gamma(\Phi)\nabla \mu),7 Down/up-sampling schedule

This arrangement differs from plain FNO by combining Fourier layers with explicit hierarchical resolution changes and skip connections. The paper attributes the resulting gain to the ability of U-shape multi-resolution blocks to capture both global coupling and local high-frequency structures.

3. Equivariance regularization and symmetry handling

A defining element of E-UNO is its equivariance regularization with respect to the dihedral group Φt=(γ(Φ)μ),\frac{\partial \Phi}{\partial t} = \nabla \cdot (\gamma(\Phi)\nabla \mu),8, comprising rotations and reflections of the square. The regularization term is

Φt=(γ(Φ)μ),\frac{\partial \Phi}{\partial t} = \nabla \cdot (\gamma(\Phi)\nabla \mu),9

Operationally, the procedure is specified as follows: apply each μ=δFδΦ=λ(Φ(Φ21)ϵϵΔΦ),\mu = \frac{\delta F}{\delta \Phi} = \lambda \left( \frac{\Phi(\Phi^2-1)}{\epsilon} - \epsilon \Delta \Phi \right),0 to the input snapshot sequence; feed the transformed sequence through the same UNO network; apply μ=δFδΦ=λ(Φ(Φ21)ϵϵΔΦ),\mu = \frac{\delta F}{\delta \Phi} = \lambda \left( \frac{\Phi(\Phi^2-1)}{\epsilon} - \epsilon \Delta \Phi \right),1 to the network’s output; and penalize the difference to the original untransformed output (Xue et al., 1 Sep 2025).

The stated purpose of minimizing μ=δFδΦ=λ(Φ(Φ21)ϵϵΔΦ),\mu = \frac{\delta F}{\delta \Phi} = \lambda \left( \frac{\Phi(\Phi^2-1)}{\epsilon} - \epsilon \Delta \Phi \right),2 is to bias μ=δFδΦ=λ(Φ(Φ21)ϵϵΔΦ),\mu = \frac{\delta F}{\delta \Phi} = \lambda \left( \frac{\Phi(\Phi^2-1)}{\epsilon} - \epsilon \Delta \Phi \right),3 to commute with the dihedral group actions, thereby reducing redundancy and improving generalization. The paper further states that encoding μ=δFδΦ=λ(Φ(Φ21)ϵϵΔΦ),\mu = \frac{\delta F}{\delta \Phi} = \lambda \left( \frac{\Phi(\Phi^2-1)}{\epsilon} - \epsilon \Delta \Phi \right),4-equivariance reduces data redundancy, stabilizes training, and yields more uniform predictions across rotated and reflected patterns.

A common point of interpretation is the status of equivariance in E-UNO. In the formulation reported here, equivariance is encouraged by an explicit loss term rather than imposed by a strictly equivariant layer construction. This suggests that the model seeks approximate commutation with group actions through optimization, while still retaining the standard UNO computational pathway.

4. Training protocol and implementation details

The reported dataset consists of 300 independent COMSOL Multiphysics simulations on μ=δFδΦ=λ(Φ(Φ21)ϵϵΔΦ),\mu = \frac{\delta F}{\delta \Phi} = \lambda \left( \frac{\Phi(\Phi^2-1)}{\epsilon} - \epsilon \Delta \Phi \right),5 with a μ=δFδΦ=λ(Φ(Φ21)ϵϵΔΦ),\mu = \frac{\delta F}{\delta \Phi} = \lambda \left( \frac{\Phi(\Phi^2-1)}{\epsilon} - \epsilon \Delta \Phi \right),6 grid, μ=δFδΦ=λ(Φ(Φ21)ϵϵΔΦ),\mu = \frac{\delta F}{\delta \Phi} = \lambda \left( \frac{\Phi(\Phi^2-1)}{\epsilon} - \epsilon \Delta \Phi \right),7, and μ=δFδΦ=λ(Φ(Φ21)ϵϵΔΦ),\mu = \frac{\delta F}{\delta \Phi} = \lambda \left( \frac{\Phi(\Phi^2-1)}{\epsilon} - \epsilon \Delta \Phi \right),8. Each simulation is run from uniform μ=δFδΦ=λ(Φ(Φ21)ϵϵΔΦ),\mu = \frac{\delta F}{\delta \Phi} = \lambda \left( \frac{\Phi(\Phi^2-1)}{\epsilon} - \epsilon \Delta \Phi \right),9 plus small noise for spinodal decomposition. From each run, 30 sub-trajectories are extracted; sampling uses nΦ=0,nμ=0on Ω.n\cdot \nabla \Phi = 0,\qquad n\cdot \nabla \mu = 0 \quad \text{on } \partial \Omega.0; and the predictive task uses nΦ=0,nμ=0on Ω.n\cdot \nabla \Phi = 0,\qquad n\cdot \nabla \mu = 0 \quad \text{on } \partial \Omega.1 past frames to predict nΦ=0,nμ=0on Ω.n\cdot \nabla \Phi = 0,\qquad n\cdot \nabla \mu = 0 \quad \text{on } \partial \Omega.2 future frames. The train/validation/test split is nΦ=0,nμ=0on Ω.n\cdot \nabla \Phi = 0,\qquad n\cdot \nabla \mu = 0 \quad \text{on } \partial \Omega.3 (Xue et al., 1 Sep 2025).

Training uses the total loss

nΦ=0,nμ=0on Ω.n\cdot \nabla \Phi = 0,\qquad n\cdot \nabla \mu = 0 \quad \text{on } \partial \Omega.4

with nΦ=0,nμ=0on Ω.n\cdot \nabla \Phi = 0,\qquad n\cdot \nabla \mu = 0 \quad \text{on } \partial \Omega.5. The data term is either

nΦ=0,nμ=0on Ω.n\cdot \nabla \Phi = 0,\qquad n\cdot \nabla \mu = 0 \quad \text{on } \partial \Omega.6

or the gradient-enhanced form

nΦ=0,nμ=0on Ω.n\cdot \nabla \Phi = 0,\qquad n\cdot \nabla \mu = 0 \quad \text{on } \partial \Omega.7

Optimization uses Adam with cosine-annealing learning-rate schedule over 200 epochs, with learning rate decreasing from nΦ=0,nμ=0on Ω.n\cdot \nabla \Phi = 0,\qquad n\cdot \nabla \mu = 0 \quad \text{on } \partial \Omega.8 to nΦ=0,nμ=0on Ω.n\cdot \nabla \Phi = 0,\qquad n\cdot \nabla \mu = 0 \quad \text{on } \partial \Omega.9. The batch size is 20 trajectories, or sub-windows, per batch. No extra data augmentation is used beyond the ddtF[Φ]=Ωγμ2dx0.\frac{d}{dt} F[\Phi] = - \int_\Omega \gamma |\nabla \mu|^2 dx \le 0.0 transformations employed in ddtF[Φ]=Ωγμ2dx0.\frac{d}{dt} F[\Phi] = - \int_\Omega \gamma |\nabla \mu|^2 dx \le 0.1.

These implementation choices place the method squarely in a short-horizon autoregressive or windowed-forecasting regime. A plausible implication is that the architecture is optimized for local-in-time operator approximation rather than direct end-to-end long-rollout prediction.

5. Empirical performance

The reported test-set comparison evaluates FNO, UNO, and E-UNO using three-step predictive error. Median relative ddtF[Φ]=Ωγμ2dx0.\frac{d}{dt} F[\Phi] = - \int_\Omega \gamma |\nabla \mu|^2 dx \le 0.2 error ddtF[Φ]=Ωγμ2dx0.\frac{d}{dt} F[\Phi] = - \int_\Omega \gamma |\nabla \mu|^2 dx \le 0.3 is given as approximately ddtF[Φ]=Ωγμ2dx0.\frac{d}{dt} F[\Phi] = - \int_\Omega \gamma |\nabla \mu|^2 dx \le 0.4–ddtF[Φ]=Ωγμ2dx0.\frac{d}{dt} F[\Phi] = - \int_\Omega \gamma |\nabla \mu|^2 dx \le 0.5 for FNO, ddtF[Φ]=Ωγμ2dx0.\frac{d}{dt} F[\Phi] = - \int_\Omega \gamma |\nabla \mu|^2 dx \le 0.6–ddtF[Φ]=Ωγμ2dx0.\frac{d}{dt} F[\Phi] = - \int_\Omega \gamma |\nabla \mu|^2 dx \le 0.7 for UNO, and ddtF[Φ]=Ωγμ2dx0.\frac{d}{dt} F[\Phi] = - \int_\Omega \gamma |\nabla \mu|^2 dx \le 0.8–ddtF[Φ]=Ωγμ2dx0.\frac{d}{dt} F[\Phi] = - \int_\Omega \gamma |\nabla \mu|^2 dx \le 0.9 for E-UNO. The paper also states that E-UNO reduces the max early-stage γ1\gamma \equiv 10 error by γ1\gamma \equiv 11 relative to UNO and by an order of magnitude relative to FNO (Xue et al., 1 Sep 2025).

The reported inference speed is γ1\gamma \equiv 12 per sample on an NVIDIA A100 for E-UNO and UNO, compared with γ1\gamma \equiv 13 for COMSOL on CPU, corresponding to an γ1\gamma \equiv 14 speed-up. FNO and E-FNO are reported at approximately γ1\gamma \equiv 15.

A compact summary of the quantitative comparison is as follows.

Model Median relative γ1\gamma \equiv 16 error γ1\gamma \equiv 17 Inference speed
FNO γ1\gamma \equiv 18–γ1\gamma \equiv 19 $2$0
UNO $2$1–$2$2 $2$3
E-UNO $2$4–$2$5 $2$6

The ablation studies isolate the effects of equivariance, gradient enhancement, and hierarchical multi-resolution structure. FNO with equivariance, denoted E-FNO, shows a $2$7–$2$8 drop in median error in dynamic regimes, specifically time windows $2$9–ΩRd\Omega \subset \mathbb{R}^d00. UNO with equivariance, denoted E-UNO, yields an additional ΩRd\Omega \subset \mathbb{R}^d01–ΩRd\Omega \subset \mathbb{R}^d02 error reduction versus UNO. Adding the gradient term ΩRd\Omega \subset \mathbb{R}^d03 in ΩRd\Omega \subset \mathbb{R}^d04 reduces early-stage peak error from ΩRd\Omega \subset \mathbb{R}^d05 to ΩRd\Omega \subset \mathbb{R}^d06 and tightens error variance. UNO architectures outperform FNO by approximately ΩRd\Omega \subset \mathbb{R}^d07–ΩRd\Omega \subset \mathbb{R}^d08 in ΩRd\Omega \subset \mathbb{R}^d09 error, which the paper interprets as confirmation of the benefit of hierarchical features.

6. Physical consistency, super-resolution, and broader scope

The qualitative analysis emphasizes that E-UNO reproduces complex finger-like spinodal patterns. In the reported three-step rollout from ΩRd\Omega \subset \mathbb{R}^d10, the model achieves maximum absolute error below ΩRd\Omega \subset \mathbb{R}^d11. Free-energy trajectories are also used as a physical-consistency diagnostic: the E-UNO and ground-truth ΩRd\Omega \subset \mathbb{R}^d12 curves are described as almost indistinguishable, with ensemble spread below ΩRd\Omega \subset \mathbb{R}^d13 at all times (Xue et al., 1 Sep 2025).

The study also reports super-resolution behavior. An E-UNO model trained on a ΩRd\Omega \subset \mathbb{R}^d14 grid is directly applied to a ΩRd\Omega \subset \mathbb{R}^d15 grid and is reported to capture fine interfacial structures with max error below ΩRd\Omega \subset \mathbb{R}^d16. This result is consistent with the paper’s description of spectral convolution as mesh-independent and global, although the super-resolution claim itself is empirical rather than a formal guarantee.

The broader significance is framed in terms of symmetry and scale hierarchy. The paper states that U-shape multi-resolution blocks capture both global coupling through Fourier layers and local high-frequency structures through skip-connected down/up-sampling, and that the synergy between spectral nonlocality and hierarchical locality leads to superior accuracy on multiscale phase-field dynamics. It further proposes that the same framework can be applied to N-phase Cahn–Hilliard, Cahn–Hilliard–Navier–Stokes, Allen–Cahn, and phase-field–crystal models by replacing the temporal history length or augmenting the loss with model-specific invariants such as momentum conservation or curvature flow. Other symmetry groups, including ΩRd\Omega \subset \mathbb{R}^d17 and translation in inhomogeneous domains, are likewise identified as enforceable through a similar group-equivariance loss. Super-resolution inference and online coupling to finite-element solvers are described as immediate next steps for multiscale PDE surrogates.

Within this framing, E-UNO occupies a specific position among neural operators: it is not only a surrogate for short-horizon Cahn–Hilliard evolution, but also a design pattern combining Fourier nonlocality, U-shaped scale hierarchy, and explicit symmetry regularization. The reported results suggest that this combination is particularly effective when the target dynamics are simultaneously multiscale, translation-structured, and approximately symmetric under discrete geometric transformations.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (1)

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Equivariant U-Shaped Neural Operator (E-UNO).