---
title: Differentiable Forward Scattering Model (DFSM)
url: https://www.emergentmind.com/topics/differentiable-forward-scattering-model-dfsm
type: topic
---

# Differentiable Forward Scattering Model (DFSM)

A Differentiable Forward Scattering Model (DFSM) is a forward operator for a scattering, diffraction, or wave-propagation problem that is expressed in a form compatible with gradient-based inversion. In the arXiv literature, the term is used for coherent surface scattering imaging, multi-peak Bragg coherent x-ray diffraction imaging, forward-scatter radar, optical diffraction tomography, synthetic aperture radar rendering, photonic scattering-matrix optimization, underwater acoustic localization, weakly perturbed stellar streams, multi-sphere acoustic scattering, and small-angle x-ray scattering analysis [2212.01253, 2208.00970, 2508.11470]. Across these settings, DFSM denotes a model that preserves the relevant physics of the forward map while enabling derivatives of predicted measurements with respect to object, geometry, material, or latent-field parameters.

## 1. Scope and defining characteristics

In coherent surface scattering imaging (CSSI), the DFSM addresses grazing-incidence reflection geometry near or below the critical angles of total external reflection, where reflected substrate fields interfere strongly with transmitted fields and generate multiple-scattering effects that a single Fourier transform cannot capture. In that setting, the goal is to map a three-dimensional refractive-index distribution
$$
n(x,y,z)=1-\delta(x,y,z)+i\,\beta(x,y,z)
$$
and an incident coherent wave $\phi_0(x,y)$ to the exit wave and then to the far-field intensity [2212.01253].

In other domains, the same designation is attached to formally different operators. In forward-scatter radar, DFSM replaces a non-differentiable shadow indicator by a continuous Secondary Wave-Source Response Field (SWRF), turning Kirchhoff–Fresnel diffraction into a differentiable inverse problem. In multi-peak BCDI, it couples several Bragg reflections into a single optimization. In optical diffraction tomography, it is the exact Lippmann–Schwinger map together with an explicit Jacobian. In photonics, it is a differentiable scattering matrix $S(\lambda,p)$ computed without differentiating eigenvectors. In underwater acoustics, it is a modular multipath superposition model. In SAXS analysis, it is a differentiable composition of a surrogate monodisperse scattering model and a trainable polydispersity layer [2508.11470, 2208.00970, 1708.00745, 2009.10933, 2503.23260, 2606.05200].

This suggests a recurring template: physical parameters are mapped to a predicted field or intensity, a loss is defined against measured data, and gradients are propagated through the entire pipeline. The common feature is not a single governing equation, but the requirement that the forward scattering computation remain faithful enough to the underlying physics while also remaining differentiable.

## 2. Mathematical structure of representative DFSMs

The CSSI formulation derived from the multislice formalism discretizes the sample along the surface-normal $Z$ into $N$ slices of thickness $\Delta z$. For slice $j$,
$$
\delta_j(x,y)=\int_{z_j}^{z_j+\Delta z}\delta(x,y,z)\,dz,\qquad
\beta_j(x,y)=\int_{z_j}^{z_j+\Delta z}\beta(x,y,z)\,dz,
$$
and the transmission operator is
$$
T_j(x,y)=\exp[i\,k_0\,\delta_j(x,y)-k_0\,\beta_j(x,y)].
$$
Free-space propagation between slices is applied in Fourier space with
$$
P(k_x,k_y;\Delta z)=\exp\!\left[-i\,\Delta z\,(k_x^2+k_y^2)/(2k_0)\right],
$$
leading to the recursive update
$$
\Psi_j'(x,y)=T_j(x,y)\Psi_j(x,y),\qquad
\Psi_{j+1}(x,y)=\mathcal{F}^{-1}\{P\,\mathcal{F}\{\Psi_j'(x,y)\}\},
$$
and the predicted far-field intensity
$$
I_{\mathrm{pred}}(q_x,q_y)=|\mathcal{F}\{\Psi_N'(x,y)\}|^2.
$$
The details state that the notation follows Myint et al. (2022), with explicit forward-differentiable implementation details added [2212.01253].

A different mathematical strategy appears in forward-scatter radar. There, the classical Kirchhoff–Fresnel diffraction model contains a binary indicator $\mathbf{1}_S$ for the shadow region, which is non-differentiable at the target boundary. The DFSM replaces $\mathbf{1}_S(x',z')\in\{0,1\}$ by $\sigma(p(x',z'))\in(0,1)$, where
$$
\sigma(p)=\frac{1}{1+\exp(-p)}.
$$
The field prediction becomes
$$
U(R)=A\,K\,F(\alpha_1,\alpha_2)\iint_Q
\frac{e^{-j\,k\,[r_1(x',z')+r_2(x',z')]}}{r_1(x',z')\,r_2(x',z')}
\,\sigma(p(x',z'))\,dx'\,dz'.
$$
In this formulation, all physics factors are known and the only unknown is the continuous field $p(x',z')$ [2508.11470].

Other DFSMs preserve differentiability without resorting to a sigmoid relaxation. In optical diffraction tomography, the forward model is the exact Lippmann–Schwinger equation,
$$
u(x)=u^{\mathrm{in}}(x)+\int_\Omega g(x-x')\,f(x')\,u(x')\,dx',
$$
with discrete form
$$
(I-GD_f)u=u^{\mathrm{in}},
$$
and an explicit Jacobian
$$
J_{h_p}(f)=(I-GD_f)^{-1}\,G\,\mathrm{diag}(u_p(f)).
$$
In photonics, the forward map is the scattering matrix
$$
\begin{bmatrix} b_L \\ b_R \end{bmatrix}
=
S(\lambda,p)
\begin{bmatrix} a_L \\ a_R \end{bmatrix},
$$
and differentiation is performed through auxiliary matrices $D_1,D_2,D_3$ and a Lyapunov-type equation for $\Omega'$, thereby sidestepping explicit differentiation of eigenvectors [1708.00745, 2009.10933].

## 3. Mechanisms for maintaining differentiability

The cited literature uses several distinct mechanisms to keep the forward model differentiable.

| Domain | Forward model | Differentiability mechanism |
|---|---|---|
| CSSI | Multislice propagation | PyTorch FFTs, complex tensors, exponentials |
| Forward-scatter radar | FKDM with SWRF | Sigmoid relaxation of the shadow indicator |
| Optical diffraction tomography | Lippmann–Schwinger | Explicit Jacobian and adjoint linear solve |
| Photonics | Scattering matrix via RCWA | Eigenvector-free derivative algorithm |
| SAXS | Surrogate plus quadrature | Automatic differentiation through network and inverse-CDF mapping |

In CSSI, each slice parameter $\delta_j(x,y)$ and $\beta_j(x,y)$ is a PyTorch tensor with `requires_grad=True`, and the forward pass is written entirely in PyTorch using `torch.complex64`, `torch.fft.fft2`, `torch.fft.ifft2`, and element-wise exponentials and multiplications. In multi-peak BCDI, every step from object amplitude and displacement to detector intensity is composed of multiplication, $\exp$, FFT, modulus, and square, so autodiff engines back-propagate the loss automatically. In SAXS, differentiability runs through the neural surrogate, the Gauss–Legendre quadrature layer, and the inverse-CDF mapping for a truncated log-normal radius distribution [2212.01253, 2208.00970, 2606.05200].

Some DFSMs rely instead on explicit derivatives. The optical diffraction tomography model computes the gradient of the data-fidelity term using two linear solves per illumination and does not require back-propagation through the forward-iteration history. The photonics formulation computes $\partial S/\partial p$ by differentiating $\Omega^2=PQ$ into a Lyapunov-type equation, then obtaining $X'=(e^{j\Omega L/k_0})'$ from the upper-right block of a block-matrix exponential. The differentiable SAR renderer of Fu & Xu (2023) derives first-order gradients analytically through soft rasterization, soft occlusion, and Gaussian slant-range mapping [1708.00745, 2009.10933, 2205.07099].

A common misconception is that differentiability requires simplification to weak-scattering or purely Fourier-transform models. The literature does not support that view. The CSSI model is explicitly introduced because conventional CDI reconstruction techniques cannot be directly applied near the critical angle, and the ODT model is built from the exact Lippmann–Schwinger formulation rather than the Born or Rytov approximations [2212.01253, 1708.00745].

## 4. Losses, regularization, and inverse-problem formulations

DFSMs are typically embedded in variational or gradient-based inverse problems. In CSSI, a representative loss is the mean-squared error on amplitudes,
$$
L=\frac{1}{M}\sum_{u,v}\left(\sqrt{I_{\mathrm{pred}}(u,v)}-\sqrt{I_{\mathrm{meas}}(u,v)}\right)^2,
$$
or, with regularization,
$$
L(\delta,\beta)=\frac{1}{M}\|\sqrt{I_{\mathrm{pred}}(\delta,\beta)}-\sqrt{I_{\mathrm{meas}}}\|_2^2+R(\delta,\beta),
$$
where $R$ may be a support constraint or total variation. Parameters are updated by an optimizer such as Adam, with optional shrink-wrap support [2212.01253].

In forward-scatter radar, the total cost is
$$
C(\mathbf{p})=
L_{\mathrm{data}}(\mathbf{F}(\mathbf{p}),\mathbf{F}_{\mathrm{obs}})
+\lambda_{\mathrm{ent}}W_{\mathrm{ent}}(\mathbf{p})
+\lambda_{\mathrm{geo}}W_{\mathrm{geo}}(\mathbf{p}).
$$
The data term is a log-Huber loss applied to complex residuals, the entropy term counteracts premature sigmoid saturation, and the geometric prior is decomposed into smoothness, connectivity, and compactness. After optimization, $\sigma(p_i)$ is thresholded at $0.5$ to obtain a hard binary profile [2508.11470].

Other DFSMs follow analogous patterns with domain-specific objectives. Multi-peak BCDI minimizes a mean-square-root-amplitude error over all Bragg reflections plus a small TV term. Underwater acoustic localization defines
$$
L_{\mathrm{DA}}(p,\theta)=\int_0^T(r(t)-\hat r(t;p,\theta))^2dt+\frac{\gamma}{2}\|\theta-\theta_{\mathrm{tr}}\|^2,
$$
so that source position and network weights can be jointly adapted at inference time. The differentiable SAR renderer optimizes a composite objective
$$
L=L_{\mathrm{sil}}+\lambda_1L_{\mathrm{tex}}+\lambda_2L_{\mathrm{lap}}+\lambda_3L_{\mathrm{flat}},
$$
combining silhouette IoU, SAR texture fidelity, Laplacian smoothness, and planarity. In point-scattering radar models, coherent, noncoherent, and sequential losses are compared for fitting range profiles [2208.00970, 2503.23260, 2205.07099, 2206.02075].

These formulations show that DFSM is not tied to a single regularizer or optimizer. What recurs is the use of differentiability to make physically structured inverse problems accessible to first-order methods.

## 5. Implementations and computational properties

Implementation practice depends strongly on the forward operator. The CSSI DFSM keeps the refractive-index volume in GPU memory, uses cuFFT under `torch.fft`, avoids host–device transfers inside the slice loop, and benefits from ATen/CUDA kernel fusion. The details report that, on a single NVIDIA A100, a $70\,\mu\mathrm{m}\times4\,\mu\mathrm{m}\times50\,\mathrm{nm}$ sample with $200\,\mathrm{nm}$ slices and $5\,\mathrm{nm}$ lateral voxels can be propagated through $N\approx250$ slices in $\lesssim1\,\mathrm{s}$, while the backward pass incurs roughly a $2\times$ slowdown [2212.01253].

Some DFSMs are designed primarily to reduce memory or evaluation cost. In optical diffraction tomography, the explicit Jacobian reduces peak memory from $O(N\!\cdot\!K)$ to $O(N)$ because it eliminates the need to store the entire forward-iteration history. In the SAXS framework, the full simulator for $50$ GRFs and $64$ radii costs approximately $49\,\mathrm{s}$ per evaluation, whereas the surrogate plus differentiable quadrature costs approximately $2.4\,\mathrm{ms}$, yielding an approximately $10\,000\times$ speedup and making $8000$ AdamW restarts feasible in $\lesssim1\,\mathrm{min}$ on a single GPU [1708.00745, 2606.05200].

JAX-based DFSMs emphasize whole-pipeline differentiability. The stellar-stream model uses pure JAX together with `galax` and `diffrax`, so `jax.grad` can be applied directly to statistics of the density and kinematic power spectra. After a one-time compilation cost of approximately $20\,\mathrm{s}$, each simulation scales linearly in the number of kicks; for the forecast setup with $N_\star=1.7\times10^3$, the cost is approximately $0.2\,\mathrm{s}$ per kick, and for $N_\star=3\times10^4$ on a $128^3$ grid the memory usage is approximately $4\,\mathrm{GB}$ of GPU RAM. The differentiable SAR renderer reports forward times of approximately $0.1\,\mathrm{s}$ for approximately $6\,\mathrm{k}$ facets and approximately $0.29\,\mathrm{s}$ for approximately $23\,\mathrm{k}$ facets on $128\times128$ grids, with additional backward runtimes reported for T-72, Envisat, and Tiangong-1 reconstructions [2606.09629, 2205.07099].

## 6. Reconstructions, benchmarks, and limitations

The empirical role of DFSM is clearest in reconstruction and forecast results. In CSSI, a simulated buried-chip example with $216$ voxels is reported to recover a $3\mathrm{D}$ gold-in-silicon pattern in approximately $2\,\mathrm{k}$ epochs using amplitude MSE alone, and in a FIB-deposited pillar example with strong AFM priors and optimization of $50\times40\times14$ voxels, the top-surface taper angle is refined by $80$ epochs to reproduce the key beating fringes in the single-shot image [2212.01253].

In forward-scatter radar, convex polygons are evaluated in both Transition Zone and Far-Field geometries using Intersection-over-Union and $95\%$ Hausdorff Distance. Under noise-free signals, Transition Zone IoU lies in $[0.88,0.96]$ and $95\%$HD in $[0.08\,\mathrm{m},0.19\,\mathrm{m}]$, while Far-Field IoU lies in $[0.82,0.96]$ and $95\%$HD in $[0.08\,\mathrm{m},0.28\,\mathrm{m}]$. For non-convex targets under severe mixed noise at $\mathrm{SNR}=8\,\mathrm{dB}$ with AWGN plus $5\%$ impulse noise, Transition Zone IoU is approximately $\{0.83,0.85,0.84\}$ with $95\%$HD $\le 0.33\,\mathrm{m}$, and Far-Field IoU is approximately $\{0.68\text{–}0.90\}$ with $95\%$HD $\le 0.40\,\mathrm{m}$ [2508.11470].

In multi-peak BCDI, a dislocation-free synthetic crystal reconstructed from five Bragg peaks reaches a final spatial resolution of approximately $23\,\mathrm{nm}$, whereas conventional single-peak phase retrieval under identical noise gives approximately $40\,\mathrm{nm}$. A synthetic crystal with two screw dislocations is reported to recover the two orthogonal trenches and half-plane phase jumps, and an experimental SiC nanoparticle reconstruction yields a clean D-shaped cross section with smooth, continuous displacement fields [2208.00970].

Several papers also delimit where DFSM-based inversion becomes difficult. In underwater acoustics, joint DFSM adaptation cuts RMSE by $2$–$3\times$ for depth offsets up to $\pm2\,\mathrm{m}$, but for large offsets the small-mismatch assumptions break and adaptation stalls. In point-scattering radar characterization, coherent-only fitting often converges to a wrong local minimum when initialization is inaccurate, while sequential noncoherent-to-coherent fitting mitigates but does not eliminate local-minimum sensitivity. In the GD-1-like stellar-stream forecasts, residual small-scale excess power is attributed to full $6\mathrm{D}$ effects not captured by the $1\mathrm{D}$ theory, even though kinematic information tightens constraints on the free-streaming cutoff scale by a factor of approximately $3$–$5$ relative to density alone [2503.23260, 2206.02075, 2606.09629].

Taken together, these results show that DFSM is best understood as a methodological class rather than a single model: a physics-structured forward operator made differentiable so that inverse scattering, reconstruction, localization, and forecast problems can be solved by gradient-based optimization. The specific operator may be multislice propagation, an integral equation, a scattering matrix, a differentiable renderer, or a surrogate-augmented ensemble average; the unifying principle is the retention of physically meaningful forward structure under differentiation.

Source: https://www.emergentmind.com/topics/differentiable-forward-scattering-model-dfsm