---
title: Local Neural Operators in PDE Analysis
url: https://www.emergentmind.com/topics/local-neural-operators
type: topic
---

# Local Neural Operators in PDE Analysis

Searching arXiv for recent and foundational papers on local neural operators to ground the encyclopedia entry.
Local neural operators are neural-operator formulations that impose locality on mappings between function spaces, typically by learning short-time evolution rules, locally supported kernels, patchwise operators, or local residual and flux updates instead of a single global input–output map. In the literature, the term covers several related but distinct ideas: local-in-space time-marching operators for transient PDEs on varied domains, localized differential and integral operator layers that preserve resolution transfer, local-in-time surrogates for equation-free computation, and architectures that augment globally spectral models with explicit local branches or local feature extractors [2203.08145], [2402.16845], [2505.02308]. Across these variants, the common objective is to align operator learning with the finite dependence structure, short-range interactions, and multiscale organization of PDE dynamics, while retaining the discretization-agnostic advantages associated with neural operators.

## 1. Conceptual scope and historical formulations

A central early formulation treats the target of learning not as a domain-specific solver but as a local time-marching operator
$$
\mathcal{G}:u_t(x) \mapsto u_{t+\Delta t}(x),
$$
with locality expressed by
$$
\frac{\partial u_{t+\Delta t}(x_a)}{\partial u_t(x_b)}=0,\qquad \forall \|x_a-x_b\|>r,
$$
for some finite interaction radius \(r\). On this view, a local neural operator learns a shift-invariant rule that can be reused across spatial locations and then combined with separate boundary treatment, which is why it was proposed for solving transient PDEs on varied domains rather than only on one fixed geometry [2203.08145].

Subsequent work broadened the meaning of locality. In equation-free analysis, a “local neural operator” may be local in time, local in space, or local in space-time. The local-in-time case learns a short-time solution operator \(\mathcal{S}_{\Delta t}\) rather than a long-horizon map; the local-in-space case is a “Gap-Tooth” operator on small spatial subdomains; and the local-in-space-time case is a patch operator that restricts both spatial and temporal support [2505.02308]. In additive manufacturing, locality is introduced through physically defined heat-affected windows of size \(11\times11\times11\), although the core operator inside each window remains an FNO with global Fourier convolution on that restricted subdomain [2307.01804]. This distinction is important: “local” may refer either to the learned kernel itself or to the domain on which an otherwise global operator is applied.

The broader operator-learning literature also clarifies what locality cannot mean. Purely pointwise nonlinear maps are not universal for operator learning; a general operator architecture must be both nonlinear and nonlocal. Theoretical analysis of the averaging neural operator shows that even a minimal nonlocal ingredient—a spatial average, equivalent in periodic settings to the zeroth Fourier mode—already suffices for universal approximation on compact subsets of \(C^s\) or \(W^{s,p}\) spaces [2304.13221]. This places local neural operators within a larger design tension: locality is useful, but complete elimination of nonlocal coupling is not, in general, compatible with universal operator approximation.

## 2. Architectural realizations of locality

The original Local Neural Operator architecture is organized as a lifting layer, a stack of \(n\) blocks, and a projection layer. Each block has two parallel paths: a physical path consisting of convolutional layers in physical space, and a spectral path in which a local subdomain is transformed by a Legendre transform, processed by a learnable linear map, and mapped back by the inverse transform. With GELU activations, the full operator is written as
$$
\mathcal{G}_\theta = \mathcal{P}_\textup{projection}\circ\mathcal{B}_n\circ\cdots\circ\mathcal{B}_1\circ\mathcal{P}_\textup{lifting},
$$
and locality is enforced through bounded physical stencils and localized spectral windows rather than global Fourier modes [2312.09820].

A second line of work constructs local neural-operator layers directly at the operator level. “Neural Operators with Localized Integral and Differential Kernels” introduces localized differential operators derived from CNN-like kernels under the correct scaling as \(h\to0\), together with localized integral operators based on discrete-continuous convolutions (DISCO). The differential branch gives continuous-limit justification for stencil-like layers, while the DISCO branch preserves operator-learning properties and resolution transfer by evaluating a continuous kernel basis across discretizations and, on the sphere, via group convolution [2402.16845].

A third formulation learns local numerical updates rather than solution snapshots. In ideal MHD, the modified Flux Fourier Neural Operator replaces hand-designed numerical fluxes with learned flux functions over shifted local stencils. The method uses separate FNO models for density, velocity components, magnetic-field components, and energy, and advances the conservative state through residual updates such as
$$
\bold{U}_{j+1} = \bold{U}_{j} + \frac{\Delta t}{\Delta x}\Big[G^{l}-G^{r}\Big]
$$
in one dimension, or with both \(x\)- and \(y\)-direction fluxes in two dimensions [2404.16015]. Here locality is inherited from the numerical-flux formulation itself.

Hybrid designs retain a global operator backbone but add explicit local modules. Conv-FNO introduces a CNN pre-extractor whose local spatial features are concatenated with the original input before FNO processing, while two resizing schemes are proposed so that the added CNN does not destroy resolution invariance [2503.17797]. LoGlo-FNO instead inserts a parallel local spectral convolution branch defined on patches \(P_m\), where
$$
(\mathcal{K}_{l}(a; \phi)\hat{z}_t^{(m)})(x)=\int_{P_m}\kappa(x,y,a(x),a(y);\phi)\hat{z}_t^{(m)}(y)\,dy,\quad x\in P_m,
$$
and supplements it with a high-frequency propagation branch based on pooled-and-upsampled residuals [2504.04260]. These models do not reject global structure; they repartition it into local and global channels.

Graph-based surrogates introduce yet another locality mechanism. In graph neural simulators for time-dependent PDEs, nodes represent spatial points and edges represent local neighborhoods, with message passing restricted to \(\mathcal{N}(i)\). The learned object is the instantaneous derivative
$$
\frac{\partial u}{\partial t}=\mathcal{G}(t,\mathbf{x},u,u_{\mathbf{x}},u_{\mathbf{xx}},\dots),
$$
which is then integrated by explicit Euler,
$$
u^{t+1}=u^t+\Delta t\cdot \mathrm{GNS}(u^t).
$$
Although this work does not use the term “local neural operator” explicitly, it is local in space through neighbor-only message passing and local in time through one-step derivative prediction [2509.06154].

## 3. Mathematical notions of locality

The most explicit formalization of locality in LNOs is through receptive field and receptive range. For a one-dimensional simplification, the relevance from input point \(x_2\) to output point \(x_1\) is defined as
$$
F(x_1,x_2)=\left|\frac{\partial \tilde{u}_{t+\Delta t}(x_1)}{\partial u_t(x_2)}\right|,
$$
and, statistically at random initialization,
$$
F(x_1,x_2)=\sqrt{\mathrm{Var}\left(\frac{\partial \tilde{u}_{t+\Delta t}(x_1)}{\partial u_t(x_2)}\right)}.
$$
From this, the paper defines the normalized receptive-field profile \(\bar F_0(x)\), the maximum receptive range (MRR) \(r_{\textup{LNO}}\), and the effective receptive range (ERR)
$$
\varrho(\bar F_0)=\sqrt{\int_{D_x}(x-\bar x)^2\bar F_0(x)\,dx}.
$$
For multi-block architectures, the MRR grows with depth and spectral width, and the analysis shows that \(N\) affects the receptive field more strongly than \(K\) or \(M\) [2312.09820].

The main empirical theorem-like conclusion from this analysis is that an initial receptive range compatible with the learning task is crucial. If the receptive range is too small, LNOs exhibit cutoff, numerical oscillation, and recurrent-rollout failure; if it is too large, accuracy degrades because capacity is spent on irrelevant long-range interactions. The reported error curves are U-shaped as a function of initial ERR, and the compatible \(N\) shifts with Reynolds number, Mach number, and time step because the physical dependence range changes with those parameters [2312.09820]. This suggests that locality is not a static architectural virtue but a task-dependent quantity that must be matched to the PDE’s effective domain of dependence.

A more abstract approximation-theoretic treatment reaches a related conclusion from a different direction. “Local approximation of operators” reduces nonlinear operator approximation to approximation on \(\mathbb{S}^d\) using spherical polynomials and localized kernels. It proves constructive estimates whose constants grow only like \(\mathcal{O}(d^{1/6})\), and it shows that local approximation at \(x\) can be obtained using only samples in a neighborhood \((x,\delta_n)\) because the kernel suppresses far-away contributions exponentially [2202.06392]. In this setting, locality is smoothness-adaptive and neighborhood-based, not tied to any specific neural architecture.

There is also a phase-space notion of operator locality. For operators with bandlimited Kohn–Nirenberg symbols, localized test functions and local subsets of Gabor coefficients yield local approximations of the operator, whereas exact identification of the full operator class requires a globally non-decaying identifier. The result is a rigorous statement that exact global identifiability and local probing are different objectives [1211.6048]. In a modern reading, this supports a common design trade-off in local neural operators: practical local approximation is often preferable to exact globally coupled reconstruction.

## 4. Relation to global neural operators

Local neural operators are frequently introduced as a response to limitations of globally spectral or globally parameterized neural operators. FNOs perform global convolutions in Fourier space, which is effective for long-range interactions but can over-smooth local detail; plain CNNs capture local features efficiently but are tied to fixed discretizations. Localized differential and integral kernels were proposed precisely to bridge this gap while keeping operator-learning properties such as prediction at arbitrary resolution [2402.16845].

Several papers frame the problem as one of local–global complementarity rather than replacement. Conv-FNO argues that standard FNOs are strong at global modeling but weak at extracting local spatial features from raw inputs, and therefore augments them with CNN-based local feature extraction [2503.17797]. LoGlo-FNO makes the same point in spectral terms: standard FNOs often miss local, high-frequency, and non-dominant spectral components because of spectral bias and explicit high-frequency truncation, so it couples a global Fourier branch to a local patchwise branch that retains all Fourier modes within each patch, plus a high-frequency propagation module and a frequency-sensitive loss [2504.04260].

A related but distinct argument is made by adaptive-coordinate methods. ACT attributes part of the apparent nonlocality of neural-operator mappings to fixed Eulerian coordinates: moving waves, vortices, fronts, and interfaces are spatially misaligned in static coordinates, which forces the backbone to connect distant points. By learning residual coordinate transforms
$$
\phi_h^{(m)}(\xi)=\xi+\Delta_h^{(m)}(\xi),
$$
with bounded offsets and differentiable resampling, ACT aims to make the operator effectively more local in the transformed representation [2605.06203]. This suggests that some “nonlocal” burdens can be transferred from the kernel to the coordinate system.

A persistent misconception is that any operator applied on a small patch is automatically local in the strict mathematical sense. The additive-manufacturing FNO is explicitly local only through its heat-affected windows; inside each window, the operator still performs global Fourier convolution [2307.01804]. Conversely, some models that are not labeled LNOs, such as graph neural simulators or Flux FNO, instantiate strong locality biases by learning local derivatives or local fluxes [2509.06154], [2404.16015]. The term therefore names a family resemblance rather than a single canonical architecture.

## 5. Empirical performance across PDE classes

The earliest varied-domain LNO results were reported for transient Navier–Stokes. Trained on random flows in a periodic square and then reused as an explicit time-marching scheme on unseen domains, the model achieved lower reported errors than FNO at \(t=2\) s for viscosities \(\mu=0.002\) and \(\mu=0.001\), while using fewer trainable weights. On a lid-driven cavity at \(Re=1000\), the reported mean absolute errors were \(0.0343\) for normalized \(u/U\) and \(0.0302\) for normalized \(v/V\), with total hybrid LNO-plus-boundary-treatment time \(4.580\) s per step versus \(9.849\) s for implicit FEM. On a cascade of NACA0012 airfoils, the reported relative error rate was \(7.51\%\), and the full \(0\)–\(20\) s simulation took \(5.96\) s with LNO plus boundary treatment versus \(6124\) s for FEM, a speedup of \(1027\times\) [2203.08145].

The locality analysis paper confirms that performance depends sharply on architectural locality. For 2-D compressible flow on a \(128\times128\) periodic grid, a baseline task \((Re,Ma,\Delta t)=(100,0.2,0.05)\) failed catastrophically for \(N=8\) with \(\bar e^\rho=\infty\), \(\bar e^T=\infty\), and \(\bar e^v=417.11\), whereas moderate \(N\) values such as \(10\), \(14\), or \(16\) yielded stable errors on the order of \(10^{-3}\)–\(10^{-2}\) in density and temperature and around \(10^{-2}\)–\(10^{-1}\) in velocity. For smaller Mach number \(Ma=0.1\), the compatible locality shifted to larger \(N\), and for larger Mach number \(Ma=0.4\), it shifted back to smaller \(N\) [2312.09820].

Localized-kernel augmentations of FNO and SFNO report substantial improvements on canonical benchmarks. On Darcy flow, adding a differential kernel reduced relative \(L^2\) error from \(5.867\times10^{-2}\) for FNO to \(7.357\times10^{-3}\); on turbulent 2D Navier–Stokes, combining differential and local integral kernels reduced 1-step error from \(1.381\times10^{-1}\) to \(9.022\times10^{-2}\); and on spherical shallow water equations, adding a local integral kernel reduced 5-step autoregressive error from \(3.185\times10^{-3}\) to \(5.392\times10^{-4}\). The paper summarizes the gains as relative \(L^2\)-error reductions of \(34\)–\(72\%\) on turbulent 2D Navier–Stokes and spherical shallow water benchmarks [2402.16845].

Local-update formulations perform particularly well on conservation-law structure. In ideal MHD, Flux NO achieved relative \(l^2\) error \(2.5\times10^{-3}\) at \(t=0.5\) on the 2D test set, compared with \(2.39\times10^{-1}\) for 2D FNO, \(1.51\times10^{-1}\) for 2D FNO (heavy), and \(1.42\times10^{-1}\) for 3D FNO. The reported inference time for \(\Delta t=0.5\) was about \(4.16\times10^{-1}\) s, compared with \(1.05\times10^{1}\) s for WENO-Z, or roughly \(25\times\) faster on the reported setup [2404.16015].

In low-data regimes, graph-based local surrogates also show a marked advantage over neural-operator baselines. For 2D Burgers, coupled Burgers, and Allen–Cahn, GNS achieved under \(1\%\) relative \(L_2\) errors with only \(30\) training samples out of \(1000\), and averaged across all cases reduced autoregressive error by \(82.48\%\) relative to FNO AR and \(99.86\%\) relative to DON AR [2509.06154]. Hybrid FNO designs report comparable improvements from explicitly encoded local structure: UNet-FNO improves over vanilla FNO on Darcy flow, Allen–Cahn, incompressible Navier–Stokes, and compressible Navier–Stokes [2503.17797], while LoGlo-FNO reports parameter reduction by up to \(50\%\) while matching baseline FNO accuracy and reports substantial gains on Kolmogorov flow, diffusion-reaction, and 3D turbulent radiative mixing [2504.04260].

## 6. Beyond forward prediction: system-level analysis, control, and current directions

A notable development is the use of local neural operators as short-time coarse timesteppers for equation-free computation. In this setting, the learned object is
$$
u(\mathbf{x},\Delta t)=\mathcal{S}_{\Delta t}[u_0;\lambda](\mathbf{x}),
$$
and fixed points are zeros of
$$
\psi(u;\lambda)=u-\mathcal{S}_T[u,\lambda].
$$
The learned timestepper is embedded inside Jacobian-free Newton-Krylov iterations,
$$
\nabla\psi(u^{(k)};\lambda)\,\delta^{(k)}=-\psi(u^{(k)};\lambda),
$$
with Jacobian-vector products approximated by finite differences, and Arnoldi iteration is used for leading eigenvalues. On Allen–Cahn, Liouville–Bratu–Gelfand, and FitzHugh–Nagumo, local-in-time, local-in-space, and patch operators were used to compute steady states, stability spectra, and bifurcation diagrams. Reported results include RandONet MSE around \(10^{-14}\) and median \(L^2\) error \(10^{-7}\) for a single-parameter Allen–Cahn case, homotopy-based recovery of the Bratu saddle-node at \(\lambda_c=3.51381\), and a Gap-Tooth RandONet training time of \(0.15\) s with MSE \(1.37\times10^{-11}\) [2505.02308].

The same short-time local-operator idea has been extended to control of distributed parameter systems. A learned solution operator
$$
v(\bm{x})=u(\bm{x},t+\Delta t)=\mathcal{S}_{\Delta t}[u(\cdot,t)](\bm{x})
$$
is used to compute steady states, dominant eigenspectra, and reduced linear models by Newton-Krylov and Arnoldi, after which dLQR and pole-placement controllers are designed on the reduced system and lifted back to the full nonlinear dynamics. In the parabolic Liouville–Bratu–Gelfand example with three Gaussian actuators, the NO-based controller stabilized the unstable steady state with final error around \(10^{-7}\), compared with near machine precision for the controller based on the exact finite-difference model [2509.23975]. This recasts local neural operators as computational kernels for coarse analysis rather than only as rollout surrogates.

Current work increasingly treats locality as something to be allocated across representation, kernel, and coordinates. ACT reports average relative error reductions of \(76.4\%\) for Transolver + ACT, \(38.4\%\) for FNO + ACT, and \(30.8\%\) for ConvNeXt-UNet + ACT across six PDE datasets, with layer-wise coordinate adaptation outperforming simple parameter scaling [2605.06203]. Patch-based latent reductions pursue a different route: localized PCA-Net decomposes solution fields into patches, applies PCA within each patch, and trains a neural operator in the reduced latent space, reducing end-to-end pipeline time by a factor of \(3.7\) to \(4\) relative to global PCA while requiring refinements such as overlap smoothing or CNN postprocessing to suppress block artifacts [2509.18110].

Several tensions remain stable across this literature. Locality that is too weak leaves models data-hungry, over-smooth, or unstable under long rollout; locality that is too strong can truncate the true dependence range, lose global coherence, or require expensive multiscale patch coupling. Some papers therefore advocate explicitly combining local and global mechanisms rather than choosing only one. A plausible implication is that the mature form of local neural-operator design is not a purely local architecture, but a structured decomposition in which local spatial interactions, local temporal evolution, and selected nonlocal channels are assigned distinct computational roles.

Source: https://www.emergentmind.com/topics/local-neural-operators