---
title: Neural Eikonal Solvers
url: https://www.emergentmind.com/topics/neural-eikonal-solvers
type: topic
---

# Neural Eikonal Solvers

Neural eikonal solvers comprise a class of machine learning-based methodologies for computing solutions to the eikonal equation, a non-linear Hamilton–Jacobi PDE that models first-arrival travel times in heterogeneous media. These solvers replace or augment classical numerical schemes (e.g., fast marching/sweeping) with deep neural architectures—typically physics-informed neural networks (PINNs), neural operators, or hybrid schemes—yielding mesh-free, highly parallelizable, and operator-learned surrogates for geodesic traveltimes, seismic imaging, tomography, and geometric computing. Recent directions include equivariant neural fields for grid-free, geometry-adaptive generalization, robust factorizations for caustics, and operator-based approaches for inversion and multi-parameter tomographic mapping.

## 1. Mathematical Foundations and Problem Formulations

The canonical steady-state eikonal equation in a domain $\Omega\subset\mathbb{R}^d$ (typically $d=2,3$) is
\[
|\nabla T(x)| = \frac{1}{v(x)}, \qquad x \in \Omega,
\]
with a boundary or initial condition $T(x_0) = 0$ at a source $x_0$. Here, $v(x)$ denotes the velocity field, and $T(x)$ is the first-arrival travel time. In seismic or elasticity contexts, multiparameter systems for P- and S-waves appear:
\[
|\nabla T_p(x)|^2 = \frac{1}{v_p^2(x)},\qquad |\nabla T_s(x)|^2 = \frac{1}{v_s^2(x)}
\]
for P- and S-wave speeds $v_p, v_s$.

Variations in neural approaches include:
- **One-point eikonal**: $T(x; x_0)$ for fixed $x_0$ (pinned source).
- **Two-point eikonal**: $T(x_s, x_r)$, symmetric in $x_s$, $x_r$ (arbitrary source-receiver).
- **Inverse mapping**: $T(\cdot; x_0) \mapsto v(\cdot)$ (velocity inversion).

Mesh-based formulations are replaced by mesh-free surrogates, often leveraging factorization to absorb source-based singularities via
\[
T(x; x_0) = R(x, x_0)\,\gamma(x; x_0),
\]
where $R(x, x_0) = \|x - x_0\|$.

## 2. Neural Architectures for Eikonal Solving

Neural eikonal solvers adopt a range of architectures, with design dictated by the desired mapping, problem geometry, and properties of the target solution.

### Physics-Informed Neural Networks (PINNs)
PINNs treat $T(x)$ or a related factor (e.g., slowness or normalized time) as the output of a neural network, trained by minimizing a physics-based residual:
\[
L(\theta) = \mathbb{E}_x\left[ \big|\,|\nabla T_\theta(x)| - S(x)\,\big|^p \right] + \text{(BCs)}
\]
where $S(x)=1/v(x)$. For two-point formulations, symmetry-enforced architectures (e.g., $T(x_s, x_r)=T(x_r, x_s)$) improve reciprocity.

### Deep Operator Networks (DeepONet)
DeepONets encode operator mappings from function spaces (e.g., $v(\cdot)$ or $T(\cdot; x_0)$) to function-valued outputs using a "branch" network for the input function and a "trunk" network for the coordinate query, merged via an inner product. For example, forward DeepONet receives $v(x)$ and $x_0$ as input, predicts $T(x; x_0)$; inverse DeepONet receives $T(\cdot; x_0)$ as input, predicts $v(x)$ [2306.05754].

### Local Neural Solvers in Fast Marching/Sweeping
The local update in classical fast marching (FMM) may be replaced with a compact feedforward network trained to regress local distances from neighbor values, retaining the O($N\log N$) global ordering [1903.07973].

### Equivariant Neural Fields (ENFs)
ENF-based neural eikonal solvers model $T_\theta(s,r;z)$, encoding families of solutions parameterized by latent context $z$, structured via group actions for equivariance under Euclidean or more general homogeneous manifold transforms. This enables grid-free, geometry-adaptive learning with explicit steerability [2505.16035].

#### Table: Representative Network Choices

| Architecture         | Input                         | Output                         |
|----------------------|------------------------------|--------------------------------|
| PINN                 | $x$ (and/or $x_0$, $x_s$)    | $T(x)$, $\gamma(x)$            |
| DeepONet             | $v(x)$ (branch), $x$, $x_0$  | $T(x; x_0)$                    |
| Local solver (FMM)   | $\{u(q)\}_{q\in\mathcal N}$  | $u(p)$                         |
| ENF                  | $x_s$, $x_r$, $z$            | $T(x_s, x_r; z)$               |

Architectural advances involve residual blocks, locally adaptive activations (e.g., arctan with trainable slope), bounded activations (to constrain the physical range), and group-invariant pooling for equivariant representation [2505.16035, 2007.08330, 2205.07989].

## 3. Loss Functions and Training Strategies

Loss design is dictated by the need to enforce the eikonal PDE, boundary conditions, and, for some approaches, data consistency or operator mapping accuracy. Key loss formulations include:

- **PDE Residual Minimization**: $|\nabla T(x)| - S(x)$ penalized (L1 or L2).
- **Factored Residuals**: Using analytically known factors to regularize singularities and improve convergence, e.g., via $\gamma$ as in PINNPStomo's $L(\gamma, v)$ [2407.16439].
- **Hamiltonian Loss**: L1 norm of the Hamiltonian $\mathcal H_2(x, \tau)$ provides robustness near caustics and accommodates non-smooth behavior [2205.07989].
- **Data-informed Losses**: For inverse problems or when data are available, MSE to observed $T^{\mathrm{obs}}$.
- **Regularization**: Positivity/physical range penalties, boundary enforcement, and (in DeepONet) potentially normalization—but explicit regularization may be omitted in high-performing models [2306.05754].

Adaptive optimizers (Adam, L-BFGS-B), dynamic gradient-weight balancing, two-stage optimization (coarse then fine collocation), and data-driven sampling (weighted by error concentration) are common strategies for accelerating or stabilizing training [2007.08330, 2101.11840, 2205.07989, 2407.16439].

## 4. Advances in Factorization, Robustness, and Generalization

Factorization techniques address the $1/\|x-x_0\|$ singularity at sources and improve learning dynamics:

- **Classical Multiplicative Factorization**: $T(x) = T_0(x) \tau(x)$, $T_0(x)$ reflecting the homogeneous solution [2007.08330, 2101.11840].
- **New Factored Forms**: PINNPStomo employs $T(x) = R(x)\gamma(x)$, $R(x) = \|x-x_s\|$, making the factorization source-velocity independent and eliminating the need for a background velocity $v_0$ [2407.16439].
- **Bounding and Symmetrization**: Use of sigmoid mappings to constrain output range, reciprocity averaging for two-point networks [2205.07989].

For challenging regimes with caustics (multi-valued solutions, non-differentiable wavefronts), tailored architectures (Gaussian activation, L1 Hamiltonian loss), input scaling, and explicit factorization enable highly accurate and stable learning, with performance superior to standard PINNs or FMMs (e.g., relative MAE $\approx$ 0.2–0.8% vs. FMM on Marmousi) [2205.07989].

Equivariance and steerability, as in E-NES, allow for transferable neural representations across rotated, translated, or otherwise transformed domains, and enable user-controllable solution fields via latent group actions [2505.16035].

## 5. Operator Learning and Inverse Problems

Operator learning frameworks generalize the solution concept beyond fixed initial/boundary conditions:

- **Forward Operator Learning**: $G_f: (v, x_0) \mapsto T(\cdot; x_0)$; DeepONet models can generate travel times for arbitrary new sources without retraining, provided the velocity model class matches training [2306.05754].
- **Inverse Operator Learning**: $G_i: T(\cdot; x_0) \mapsto v(\cdot)$; inverse DeepONet infers underlying velocity models from measured first-arrival times, enabling parametric seismic inversion [2306.05754].
- **Multi-parameter Inversion**: PINNPStomo uses coupled networks and a joint loss for simultaneous recovery of $v_p(x), v_s(x)$, achieving multiparameter inversion in both 2D and 3D settings [2407.16439].
- **Transfer and Surrogate Modeling**: PINN surrogates trained on multiple source positions enable rapid travel time evaluation for new sources, with transfer learning accelerating retraining under velocity perturbations [2007.08330, 2101.11840].

## 6. Computational Performance and Benchmarking

Neural eikonal solvers are evaluated versus traditional schemes across accuracy, speed, memory, and scalability:

- **Accuracy**: Neural approaches consistently achieve lower absolute and relative travel time errors compared to first- and second-order fast marching/sweeping, and handle challenging regimes (sharp contrasts, caustics) where traditional methods degrade [1903.07973, 2205.07989].
- **Speed and Scalability**: Training can be computationally intensive, but once trained, inference is grid-free and massively parallel: e.g., EikoNet computes $10^6$ queries in 0.424s on a V100 GPU, massively undercutting FMM lookup table requirements [2004.00361].
- **Generalization**: Approaches such as DeepONet and ENF provide generalization to new sources/receivers, velocity fields, or domain geometries, while ENF generalizes to non-Euclidean manifolds (spheres, hyperbolic spaces) with group equivariance [2505.16035, 2306.05754].
- **Robustness**: Gaussian activations and robust L1 Hamiltonian losses for NES increase reliability near caustics and improve training speed and error by 10–60$\times$ over previous neural solvers [2205.07989].
- **Operator Surrogacy**: Neural surrogates admit O(1) inference in travel-time tables, advantageous in iterative inversion or real-time localization [2101.11840, 2007.08330].

## 7. Applications, Extensions, and Open Directions

Neural eikonal solvers are deployed in seismic forward modeling, velocity inversion, tomography, hypocenter localization, and geometric computing. Noteworthy features and future directions include:

- **Mesh-free flexibility**: All leading approaches are mesh-free, enabling seamless handling of irregular topographies, free surfaces, and unstructured domains [2007.08330, 2101.11840, 2407.16439].
- **Seismic tomography and multiparameter inversion**: PINNPStomo establishes simultaneous P/S inversion from joint travel times with no background speed assumption [2407.16439].
- **Scalability to 3D/complex physics**: References extend PINN frameworks to anisotropy, attenuation, and sharp heterogeneity with only residual modification [2007.08330, 2101.11840], while E-NES and PINNPStomo demonstrate 3D scalability and data-driven training [2505.16035, 2407.16439].
- **Operator learning open questions**: Stability, uniqueness, and robustness, especially in inverse problems, as well as the efficacy of physics-informed loss terms (vs. data-driven), remain areas of investigation [2306.05754].
- **Meta-learning and adaptive sampling**: Unsolved issues involve convergence in highly heterogeneous fields (spectral bias), which may be addressed via active collocation, meta-learning, or hybrid PINN/operator schemes [2007.08330, 2101.11840].

A plausible implication is that future neural eikonal solvers will integrate operator learning, geometric equivariance, and robust physics-informed regularization to achieve real-time, high-fidelity, and physically interpretable solutions across a spectrum of domains and acquisition geometries.

Source: https://www.emergentmind.com/topics/neural-eikonal-solvers