---
title: 'AeroJEPA: Scalable 3D Aerodynamic Modeling'
url: https://www.emergentmind.com/topics/aerojepa
type: topic
---

# AeroJEPA: Scalable 3D Aerodynamic Modeling

AeroJEPA is a Joint-Embedding Predictive Architecture for scalable 3D aerodynamic field modeling that decouples surrogate model prediction from full computational fluid dynamics (CFD) field resolution. Rather than directly mapping input geometries to high-dimensional CFD outputs, AeroJEPA operates by learning low-dimensional latent representations ("tokens") of both geometric context and target flow, bridges them via a predictive latent regressor, and reconstructs physical fields as needed through an implicit neural representation (INR). This architecture enables efficient surrogate modeling of extremely large aerodynamic fields, while producing semantically meaningful latent spaces useful for design and analysis [2605.05586].

## 1. Architectural Overview

AeroJEPA's central premise is to replace direct field regression with a latent-to-latent prediction pipeline, separating the encoding of input geometry plus operating conditions from the encoding of ground-truth CFD outputs. Training objective is then cast as a token-level matching in latent space, with optional field-level supervision via an INR decoder.

### Context Latent Representation

- **Input:** Unstructured point cloud of solid boundary, $\mathcal{P} = \{x_i \in \partial\Omega\}_{i=1}^{N_c}$
- **Subsampling:** Farthest Point Sampling (FPS) to $N_c \sim 8\times10^3$–$1.3\times10^5$ points
- **Encoder:** Composition of centroid clustering, local message passing, and Point-Transformer blocks
- **Output:** $Z_c = \mathcal{E}_c(\mathcal{P}) \in \mathbb{R}^{M\times d}$, where $M$ = token count, $d$ = token dimension (dataset-dependent)

### Target Latent Representation

- **Input:** Independently subsampled point cloud of CFD outputs, $\mathcal{F} = \{(q_j, \phi(q_j))\}_{j=1}^{N_t}$
- **Encoder:** $\mathcal{E}_t$, with structure analogous to context encoder 
- **Output:** $Z_t = \mathcal{E}_t(\mathcal{F}) \in \mathbb{R}^{M\times d}$ (used only at training time)

### Latent Predictor

- **Structure:** Transformer-style network $f_\theta^{\mathrm{pred}}$ with alternating self-attention, cross-attention, MLP mixing, FiLM-style conditioning on operating variables $c = (\alpha, Re, Ma, \ldots)$ in every layer
- **Operation:** $\hat{Z}_t = f_\theta^{\mathrm{pred}}(Z_c, c)$ produces predicted flow tokens
- **Loss:** Token-wise latent-matching,
  $$
  \mathcal{L}_\mathrm{lat} = \|\,\hat{Z}_t - Z_t\|_2^2
  $$


## 2. Continuous Implicit Decoder

AeroJEPA leverages a continuous INR decoder $f_\phi^{\mathrm{dec}}$ to reconstruct physical fields from predicted latent tokens at arbitrary spatial resolution. This MLP-based decoder accepts each query point $q = (x, y, z)$ (optionally with signed distance function) and the latent code $\hat{Z}_t$, and outputs field values such as velocity $u(q) \in \mathbb{R}^3$ and pressure $p(q)$:
$$
\phi(q) = f_\phi^{\mathrm{dec}} \bigl(\hat{Z}_t, q \bigr)
$$
Internally, query coordinates are lifted using Fourier features and pooled with learned summaries or attended token subsets before entering the MLP, effectively decoupling output cost from field discretization and supporting continuous-domain inference.

## 3. Training Objectives and Regularization

Full end-to-end training minimizes a composite loss:
$$
\mathcal{L}_\mathrm{total} =
\lambda_\ell \mathcal{L}_\mathrm{lat}
+ \lambda_r \mathcal{L}_\mathrm{rec}
+ \lambda_s \mathcal{L}_\mathrm{sig}
$$
Terms are:

- $\mathcal{L}_\mathrm{lat}$: Latent-matching loss, as above
- $\mathcal{L}_\mathrm{rec}$: Reconstruction loss,
  $$
  \mathbb{E}_{q\sim \Omega} \bigl\| f_\phi^{\mathrm{dec}}(\hat{Z}_t, q) - \phi(q) \bigr\|_2^2
  $$
- $\mathcal{L}_\mathrm{sig}$: SIGReg regularization, which enforces token diversity by urging random projections toward isotropic Gaussian
- Typical weights: $\lambda_\ell=1.0$, $\lambda_r=1.0$, $\lambda_s=0.01$

A "latent-only" second training phase drops the reconstruction loss, optimizing only latent-level objectives.

The learning process is summarized by the following pseudo-code sketch:

```python
# 1. Subsample geometry/context P_c and flow/target F_t, and sample q for reconstruction
Z_c = E_c(P_c)                      # M×d context tokens
Z_t = E_t(F_t)                      # M×d target tokens

# 2. Predict latent tokens from context + operating conditions
Z_pred = f_pred(Z_c,   c)           # M×d

# 3. (Optional) Decode back to CFD field at query points q
phi_hat = f_dec(Z_pred,   q)        # N_q × (#channels)

# 4. Compute losses
L_lat = ||Z_pred – Z_t||_2^2
L_rec = mean_q ||phi_hat(q) – phi_true(q)||_2^2
L_sig = SIGReg({Z_pred, Z_t})

L_total = λ_ℓ * L_lat + λ_r * L_rec + λ_s * L_sig

# 5. Backprop & update all parameters end-to-end
optimizer.step(∂L_total/∂θ)
```

## 4. Benchmark Datasets and Comparative Results

AeroJEPA is evaluated on realistic, large-scale benchmarks designed to test aerodynamic surrogate performance.

### HiLiftAeroML

- WMLES for high-lift aircraft; surface boundary layer $12$–$15$M points, volumetric domain $\sim 50$M points
- 8 geometric control parameters, 205 training/50 test geometries, each at 10 angles of attack (AoA)
- $M=3072$, $d=64$; per-baseline chunk size $131$k points vs. single-latent decode in AeroJEPA

| Field | AeroJEPA (Rel L₂) | Best Baseline (Rel L₂) | Inference TFLOPs |
|-------|-------------------|------------------------|------------------|
| $p$   | 0.0048 ± 0.0026   | 0.0206 ± 0.0047 (FigConvUNet) | 57 vs. 88 |
| $u$   | 0.1445 ± 0.0423   | 0.4761 ± 0.0934 | 57 vs. 88 |
| $v$   | 0.2749 ± 0.0388   | 0.8492 ± 0.0555 | 57 vs. 88 |
| $w$   | 0.1880 ± 0.0455   | 0.7137 ± 0.0864 | 57 vs. 88 |

AeroJEPA achieves lower relative $L_2$ error for all fields and requires fewer inference FLOPs due to the single latent-based decode, whereas baselines operate chunk-wise, incurring significant overhead.

### SuperWing

- $4\,239$ transonic wings $\times\ 28\,856$ RANS snapshots; 54 morphological parameters; fixed grid $\sim 32$k points
- $M=512$, $d=128$; AeroJEPA is independent of inference chunking

| Field        | Chunked Best | One-pass Best | AeroJEPA |
|--------------|--------------|---------------|----------|
| $C_{f,\tau}$ | 0.1429       | 0.0280        | 0.0548   |
| $C_{f,z}$    | 0.2912       | 0.0529        | 0.1084   |
| $C_p$        | 0.1946       | 0.0309        | 0.0644   |

AeroJEPA maintains competitive accuracy and uniform computational cost per inference ($\approx 0.32$ TFLOPs), regardless of output resolution, compared with baselines requiring chunked or single-pass decoding at greater expense.

## 5. Latent Space Semantics and Analysis

The semantically structured latent space induced by AeroJEPA supports a spectrum of analysis and design utilities beyond field regression.

### Linear Probing

Ridge regression probes of standardized mean-pooled latents ($z \in \mathbb{R}^D$) uncover direct mapping to design variables and aerodynamic properties:
- On HiLiftAeroML, context latents predict flap and slat deflections with $R^2 \in [0.965, 0.988]$; predicted latents recover $C_L$ and $C_D$ to $0.930$, $0.996$ respectively.
- On SuperWing, predicted latents yield $C_L: 0.984$, $C_D: 0.965$; context latents retrieve 9/54 morphological parameters at $R^2 \ge 0.85$.

### Controlled Latent Interpolation

Linear interpolation between two predicted latents,
$$
\hat{Z}_t(\gamma) = (1-\gamma)\hat{Z}_t^{(1)} + \gamma\,\hat{Z}_t^{(2)}
$$
generates physically plausible intermediate CFD fields whose macroscopic coefficients track the dataset ground truth, supporting meaningful field morphing.

### Concept-Vector Arithmetic

Probing geometric parameters defines orthogonal concept subspaces; walks along these axes in latent space shift design variables independently in accordance with physical aircraft practice, as demonstrated by the near block-diagonal structure of the HiLift deflection-response matrix.

### Constrained Latent-Space Optimization

Treating $z_\mathrm{ctx} \in \mathbb{R}^{128}$ as a design variable, direct optimization for maximum $L/D = C_L/C_D$ is possible under Mahalanobis trust regions, parameter bounds, and physical constraints. Optimization converges to solutions coincident with the empirical design frontier. Gradient-based search is executed using SLSQP and autograd-computed Jacobians.

## 6. Significance and Implications

AeroJEPA demonstrates the feasibility of predictive latent learning for aerodynamic surrogate modeling at realistic, field-scale resolutions. Its capacity for single-shot, mesh-size-invariant inference, explicit regularization vs. token collapse, and emergence of semantically organized latent spaces enables not only accurate field prediction but downstream physical analysis and gradient-based design. A plausible implication is that such architectures may generalize to other domains exhibiting large-scale physical field structure, where latent-pathway surrogates are desired for analysis-aware modeling and automated inverse design [2605.05586].

Source: https://www.emergentmind.com/topics/aerojepa