---
title: Convolutional Neural Operator
url: https://www.emergentmind.com/topics/convolutional-neural-operator
type: topic
---

# Convolutional Neural Operator

Convolutional neural operator (CNO) denotes a CNN-based neural-operator paradigm for learning mappings between function spaces, particularly PDE solution operators, rather than fixed-size vector-to-vector maps. In its strict formulation, a CNO is a modified U-Net-style neural operator acting between bandlimited function spaces, designed to preserve a correspondence between a continuous operator and its discrete implementation through continuous-discrete equivalence and alias-free multiresolution processing [2302.01178]. Subsequent literature uses the same label more broadly for convolutional realizations and extensions of operator learning, including physics-informed surrogates for the Helmholtz equation [2507.16431], dynamic local propagators for Maxwell simulation [2406.17810], multiscale Fourier-convolution hybrids [2408.00775], and transfer-learning adaptations for shifted PDE regimes [2512.17969].

## 1. Conceptual definition and scope

A neural operator learns a map between function spaces. In PDE settings, the input can be a coefficient field, forcing, geometry, source condition, or initial condition, and the output is a function such as a solution field, wavefield, or evolved state. The CNO program arose from the observation that convolution-based architectures, although highly successful in conventional machine learning, had been “largely ignored” for PDE operator learning because standard CNNs were regarded as inconsistent in function space [2302.01178].

The central claim of the original CNO formulation is that convolutional architectures are not intrinsically unsuitable for operator learning; rather, naive CNN implementations fail when the discrete network does not correspond to a well-defined operator on the underlying continuous function space. The resulting pathologies include grid dependence, aliasing, and lack of resolution invariance. CNO addresses this by constraining the architecture to operate on bandlimited function spaces and by redesigning convolution, activation, and multiresolution transfers so that discretization and model application commute [2302.01178].

In a narrower usage, “CNO” refers specifically to the architecture introduced in “Convolutional Neural Operators for robust and accurate learning of PDEs” [2302.01178]. In a broader usage, the term also covers convolutional neural-operator backbones embedded in application-specific pipelines. This broader usage includes a physics-informed CNO for frequency-domain seismic wavefield prediction [2507.16431], a causality-aware dynamic convolutional neural operator for photonic FDTD rollout [2406.17810], and a velocity-to-image seismic forward surrogate embedded in an inversion loop [2509.20238]. This suggests that “convolutional neural operator” functions both as the name of a specific alias-free architecture and as a wider design family centered on local convolutional operator approximation.

## 2. Continuous-discrete architecture

The original CNO is written as an operator
\[
\mathcal{G}: \mathcal{B}_w(D)\to \mathcal{B}_w(D),
\]
where \(\mathcal{B}_w(D)\) denotes a bandlimited function space. Abstractly, the network is composed as
\[
\mathcal{G}: u \mapsto P(u)=v_0 \mapsto v_1 \mapsto \cdots \mapsto v_L \mapsto Q(v_L)=\bar u,
\]
with layers of the form
\[
v_{l+1}=\mathcal{P}_l\circ \Sigma_l\circ \mathcal{K}_l(v_l).
\]
Here, \(\mathcal{K}_l\) is a convolution operator in physical space, \(\mathcal{P}_l\) is an upsampling or downsampling operator, \(\Sigma_l\) is a modified activation, \(P\) is a lifting map into latent channels, and \(Q\) is a projection back to the output function space [2302.01178].

The architecture is implemented as an operator U-Net with encoder-decoder structure, skip connections, and four named block types: downsampling blocks \(D\), upsampling blocks \(U\), ResNet blocks \(R\), and invariant blocks \(I\) [2302.01178]. The multiscale design is not merely architectural convenience. In the original formulation, skip connections transfer high-frequency information across scales, while the encoder progressively filters higher frequencies, yielding a genuinely multiscale operator [2302.01178].

A distinguishing architectural choice is that convolution is performed directly in physical space rather than via truncated global Fourier modes. In the seismic Helmholtz formulation, the convolutional layer is written discretely as
\[
K(i, j) = \sum_{m=0}^{k-1} \sum_{n=0}^{k-1} w(m, n)\, v(i+m, j+n),
\]
with trainable kernel weights \(w(m,n)\). That paper emphasizes locality, interpretability, and non-periodic boundaries as reasons to prefer physical-space convolution to Fourier neural operators in that setting [2507.16431].

The activation mechanism is also specialized. In the original CNO, a naive pointwise nonlinearity is avoided because it generates frequencies outside the prescribed bandlimit. Instead, activation is implemented by upsampling to a larger bandlimit, applying the pointwise nonlinearity, and downsampling back:
\[
\Sigma_{w,\bar w}f(x)= {}_{\bar w,w}\big(\sigma\circ {}_{w,\bar w}f\big)(x).
\]
Upsampling and downsampling are based on sinc interpolation and filtering, with
\[
h_w(x_0,x_1)=\operatorname{sinc}(2wx_0)\cdot \operatorname{sinc}(2wx_1),
\]
so that multiresolution transfers remain consistent with the bandlimited function-space model [2302.01178].

In application papers that use the CNO backbone more pragmatically, the same operator-level structure is retained but expressed in conventional deep-learning terms. The physics-informed Helmholtz work describes the operator as
\[
G : u \mapsto P(u) = v_0 \mapsto v_1 \mapsto \dots \mapsto v_L \mapsto Q(v_L) = \overline{u},
\]
with layer update
\[
v_{l+1} = V_l \circ \Sigma_l \circ K_l(v_l), \quad 0 \le l \le L-1,
\]
where \(K_l\) is a convolution operator, \(\Sigma_l\) is Leaky ReLU, and \(V_l\) changes resolution by upsampling or downsampling [2507.16431]. The continuity of the operator viewpoint across these formulations is one of the defining features of the CNO literature.

## 3. Approximation theory and operator consistency

The most distinctive theoretical contribution of the original CNO paper is the insistence on continuous-discrete equivalence. The model is constructed so that, for bandlimited functions sampled at sufficiently fine resolution, the discrete implementation commutes with the continuous operator. This yields representation equivalence. The paper states explicitly: “Convolutional Neural Operator \(\mathcal{G}: \mathcal{B}_w(D,\mathbb{R}^{d_{\mathcal X}})\to \mathcal{B}_w(D,\mathbb{R}^{d_{\mathcal Y}})\) is a Representation equivalent neural operator or ReNO” [2302.01178].

On the approximation side, the same paper proves a universality theorem for a broad class of PDE solution operators. Under regularity and stability assumptions, for every \(\varepsilon>0\) there exists a CNO \(G\) such that
\[
\|G^\dagger(a)-G(a)\|_{L^p(D)}<\varepsilon
\]
for all admissible coefficient fields \(a\) in bounded subsets of the relevant Sobolev space [2302.01178]. The proof projects the PDE operator onto finite Fourier or trigonometric polynomial spaces, approximates the resulting finite-dimensional map by a shallow neural network, realizes that map by a CNN, and then converts it into CNO form with sinc-based interpolation [2302.01178].

A complementary line of theory analyzes CNN-based operator learning in a constructive, discretized, Fourier-based setting. “Approximation bounds for convolutional neural networks in operator learning” studies operators of the form
\[
\Theta \subset \mathbb{R}^p \ni \boldsymbol{\mu} \mapsto u_{\boldsymbol{\mu}}\in H^s(\Omega),
\]
with the output discretized on a grid and approximated by a network \(\Phi:\mathbb{R}^p\to\mathbb{R}^{N_h}\). The key decomposition is
\[
\Phi = \Psi\circ \phi,
\]
where \(\phi\) is a fully connected network that learns coefficient-like information from parameters, while \(\Psi\) is a convolutional network that reconstructs the spatial field [2207.01546]. The main theorem gives explicit complexity scaling:
\[
\text{dense layers} \le C\log(1/\varepsilon), \qquad
\text{convolutional layers} \le C\log(1/h),
\]
with active weights bounded by
\[
C\,\varepsilon^{-2/(2s-1)}
\left[\varepsilon^{-p/r}\log(1/\varepsilon)+\log(1/h)\right],
\]
and channels bounded by \(C\,\varepsilon^{-2/(2s-1)}\) [2207.01546]. The same paper is explicit that this is not the full modern infinite-dimensional neural-operator theory; the result is discrete-output, 1D in the rigorous proofs, and inherits a curse-of-dimensionality factor \(\varepsilon^{-p/r}\) in the parameter dimension [2207.01546].

A further theoretical refinement concerns locality. “Neural Operators with Localized Integral and Differential Kernels” shows that a standard finite-stencil convolution with fixed kernel values collapses to a pointwise linear operator under grid refinement. To recover a genuine differential operator, the kernel must be centered by subtracting its mean and rescaled by \(1/h\); for localized integral operators, the kernel must instead be represented continuously and sampled on arbitrary meshes through DISCO-style discrete-continuous convolutions [2402.16845]. This is directly relevant to CNO-type models because it clarifies when a convolution layer is merely grid-bound and when it defines a stable function-space operator.

## 4. Architectural variants and domain-specific extensions

One major extension is physics-informed regularization. In “An effective physics-informed neural operator framework for predicting wavefields,” the convolutional backbone is kept intact but trained with an additional PDE-residual term derived from the scattered-field Helmholtz equation [2507.16431]. The learned map is
\[
(U_0^{\mathrm{Re}},U_0^{\mathrm{Im}},v)\longrightarrow (\delta U^{\mathrm{Re}},\delta U^{\mathrm{Im}}),
\]
where \(U_0\) is the analytically computed background wavefield in a homogeneous medium and \(\delta U\) is the scattered wavefield [2507.16431]. The total objective is
\[
J = J_{\text{data}} + \lambda J_{\text{pde}},
\]
with the Laplacian evaluated on the grid by an eighth-order finite-difference stencil rather than automatic differentiation [2507.16431]. The modification is therefore not a new operator architecture but a physics-informed training strategy layered onto a standard CNO.

A second extension localizes the operator even more aggressively in space-time. PIC2O-Sim formulates Maxwell simulation as a causality-constrained, local, permittivity-conditioned propagation problem and uses a causality-aware dynamic convolutional neural operator as backbone [2406.17810]. Its position-adaptive convolution is
\[
z^{l}(i)=\sum_{j \in \Omega(i)} \big(K\left(\mathbf{f}_i, \mathbf{f}_j\right)(\epsilon_r) \mathbf{W}^T(j)\big) \cdot v^l(j),
\]
with a Gaussian similarity kernel
\[
K\left(\mathbf{f}_i, \mathbf{f}_j\right)(\epsilon_r)=\exp \left(-\frac{1}{2}\left(\mathbf{f}_i-\mathbf{f}_j\right)^{\top}\left(\mathbf{f}_i-\mathbf{f}_j\right)\right).
\]
The receptive field is chosen to honor the light cone, with a radius estimate
\[
R \approx \frac{Tc_0}{\sqrt{\epsilon_r^{wg}}},
\]
and the paper recommends a receptive field about “30 pixels larger” than the theoretical value for best fidelity [2406.17810]. This is a CNO in a strongly physics-shaped sense: local kernels model finite-speed propagation and dynamic conditioning models permittivity-dependent propagation rules.

Other variants hybridize convolution with spectral components. CFNO, proposed for full-chip mask optimization, splits layouts into non-overlapping tokens, applies a token-shared Fourier neural operator to each token, and then mixes token embeddings by token-wise convolution [2207.04056]. DCNO, aimed at multiscale PDEs, alternates Fourier layers with dilated convolution blocks using a hierarchical dilation schedule such as \((1,3,9,3,1)\) [2408.00775]. In both cases, convolution is used to restore or preserve local and high-frequency structure that low-mode spectral truncation alone tends to suppress.

The transfer-learning literature has treated CNO as a pretrained operator backbone that can be adapted with few target samples. “Convolutional-neural-operator-based transfer learning for solving PDEs” investigates fine-tuning, LoRA, and neuron linear transformation (NLT), with NLT updating pretrained weights by
\[
W_t = f\times W_s + b.
\]
That study reports that NLT achieves the highest surrogate accuracy across Kuramoto-Sivashinsky, Brusselator, and Navier-Stokes transfer settings [2512.17969].

CNO has also been embedded into inversion pipelines. In “Velocity model building from seismic images using a Convolutional Neural Operator,” the learned operator maps velocity information to RTM images and is frozen inside an optimization loop, where gradients with respect to the velocity input are obtained by automatic differentiation rather than by an adjoint-state solver [2509.20238]. In that case the CNO serves as a differentiable surrogate forward operator rather than as an end-to-end inverse map.

## 5. Empirical performance and application areas

Empirical work on CNOs spans benchmark PDE operator learning, frequency-domain seismic wavefield prediction, time-domain photonic simulation, lithography mask optimization, multiscale elliptic and Helmholtz problems, and seismic inversion. The reported results consistently emphasize three properties: resolution robustness, better handling of high-frequency or localized structure than purely spectral baselines, and practical acceleration relative to classical solvers or numerical optimization pipelines.

| Variant | Domain | Reported result |
|---|---|---|
| CNO benchmarks [2302.01178] | Representative PDE Benchmarks | On Poisson, CNO outperforms FNO by nearly a factor of 20 in test error |
| PICNO [2507.16431] | Helmholtz wavefield prediction | Test relative \(L_2\) errors: CNO \(0.25,0.34,0.50\) vs PICNO \(0.18,0.22,0.23\) at \(8,10,12\) Hz |
| PIC2O-Sim [2406.17810] | Photonic FDTD simulation | 51.16% lower average normalized \(L_2\) error, 95.74% fewer parameters than FNO, and 308\(\times\)–632\(\times\) speedup over Meep |
| CFNO [2207.04056] | Full-chip mask optimization | Throughput 138.9 \(\mu m^2/s\), versus 0.01 for levelsetGPU and 0.22 for A2-ILT |
| DCNO [2408.00775] | Multiscale PDEs | Relative \(L^2\) error \((\times10^{-2})\): Darcy rough 0.531 and trigonometric 0.541 |
| Seismic inversion with CNO [2509.20238] | Velocity model building from RTM images | About 15 seconds for a single velocity model on one NVIDIA A100 GPU, versus about 2.5 hours for the conventional FWI comparison |

The benchmark study that introduced CNO reports strong performance across Poisson, wave, smooth and discontinuous transport, Navier-Stokes, Darcy flow, and compressible Euler, with especially notable gains in multiscale settings and out-of-distribution generalization. It also reports that CNO error is essentially invariant to resolution in the Navier-Stokes experiment, while FNO and U-Net are more resolution dependent, and that CNO tracks the output Fourier spectrum more faithfully, with less spurious spectral amplification than FNO and U-Net [2302.01178].

The seismic Helmholtz literature offers a more targeted view of why physics-informed CNO variants matter. In a deliberately limited-data regime, PICNO is reported to reduce average relative \(L_2\) error by \(27.4\%\), \(35.2\%\), and \(53.1\%\) at \(8\), \(10\), and \(12\) Hz, respectively, relative to a purely data-driven CNO, with the advantage becoming stronger as frequency increases [2507.16431]. The same study emphasizes improved out-of-distribution behavior on a velocity model with faults and sharp discontinuities absent from training [2507.16431].

The photonics literature emphasizes a different empirical axis: long autoregressive rollout under local causal dynamics. PIC2O-Sim reports test errors of 0.052 on MMI, 0.085 on MRR, and 0.086 on Metaline, outperforming FNO, F-FNO, KNO, NeurOLight, SimpleCNN, and SineNet while using 2.4M–4.4M parameters instead of the 146.4M–340M reported for FNO [2406.17810]. Its ablations show that the convolutional field encoder, the dynamic local backbone, two-stage partitioned time bundling, and cross-stage hidden-state propagation all contribute materially to rollout fidelity [2406.17810].

For multiscale PDEs, DCNO reports strong results on rough elliptic, inverse, Navier-Stokes, and Helmholtz problems. On the Darcy rough and multiscale trigonometric elliptic benchmarks, the relative \(L^2\) errors \((\times 10^{-2})\) are 0.531 and 0.541 for DCNO, compared with 1.749 and 1.744 for FNO, and the paper states improvements over FNO of about 71% and 69% [2408.00775]. The same work reports that DCNO’s relative error remains approximately invariant with input resolution, aligning it with the broader neural-operator objective of mesh-independent inference [2408.00775].

## 6. Limitations, ambiguities, and research directions

A recurrent ambiguity is terminological. In the original formulation, CNO is a bandlimited, alias-free, representation-equivalent neural operator with carefully defined activation and multiresolution transfers [2302.01178]. In later application papers, the same term may refer to a conventional convolutional backbone used in an operator-learning setting, sometimes with physical-space convolution, sometimes with dilated or dynamic kernels, and sometimes with additional Fourier branches or PDE-regularized objectives. This suggests that the field has not converged on a single canonical definition.

Several limitations are explicit in the theory. The constructive approximation bounds for CNN operator learning are derived for discretized outputs and 1D proofs, not for the full continuous infinite-dimensional setting, and the dense block still incurs a factor \(\varepsilon^{-p/r}\), so the method remains exposed to high-dimensional parameter dependence [2207.01546]. Even in the broader neural-operator setting, localized-kernel theory shows that a naive fixed-stencil convolution does not automatically define a stable function-space operator under refinement; without appropriate scaling or continuous kernel parameterization, it collapses to a pointwise map [2402.16845].

Generalization under distribution shift is also a live issue. The few-shot transfer study reports that a source-trained CNO can generalize poorly when applied directly to shifted target distributions: for Navier-Stokes, the relative \(L_1\) test error rises from \(1.6645\%\) on source data to as high as \(11.9493\%\) on target data without transfer [2512.17969]. The same paper presents transfer adaptation, especially NLT, as a remedy rather than an intrinsic property of the original CNO [2512.17969].

Application papers disclose more domain-specific constraints. The physics-informed Helmholtz study notes that PICNO predictions can be somewhat smoother than the reference wavefields, likely because of limited training diversity and the smoothing tendency of convolutional operators [2507.16431]. The mask-optimization CFNO framework assumes binary layout inputs and depends on a lithography simulator to decide whether a model-generated mask is better than the legacy label, which makes its litho-guided self-training pipeline domain-specific rather than generic [2207.04056]. The seismic inversion framework based on a frozen CNO forward surrogate depends strongly on the quality of the initial/background model, on the representativeness of the synthetic training set, and, because it uses RTM images, does not capture more complex wave phenomena such as multiples or mode conversions [2509.20238].

The current research trajectory therefore points in several directions already visible in the literature: stricter treatment of locality and operator consistency, better high-frequency retention, physics-informed training objectives, adaptation under distribution shift, and embedding learned forward operators inside optimization loops. Across these directions, the underlying objective remains stable: to preserve the operator-learning character of neural operators while exploiting the locality, multiscale hierarchy, and implementation efficiency of convolutional architectures.

Source: https://www.emergentmind.com/topics/convolutional-neural-operator