---
title: Composite Operator-Based Neural Network (CPNN)
url: https://www.emergentmind.com/topics/composite-operator-based-neural-network-cpnn
type: topic
---

# Composite Operator-Based Neural Network (CPNN)

Searching arXiv for the cited CPNN-related papers to ground the article in recent literature.
arXiv search: 2507.04682 Composite Operator-Based Neural Network stormwater dynamics
Composite Operator-Based Neural Network (CPNN) denotes, in the literature surveyed here, a composite operator-learning paradigm in which a target mapping is represented by coordinated sub-operators rather than by a single monolithic network. In its explicit stormwater-infrastructure formulation, CPNN combines a multi-input operator encoder with a fully connected decoder to predict unsteady three-dimensional hydrodynamics and particulate matter transport in a hydrodynamic separator [2507.04682]. Related work uses closely aligned composite-neural-operator constructions for multiscale bubble growth, structural seismic response prediction, and dual-path neural operators, which suggests that CPNN is best understood as an architectural principle centered on operator composition, separable encoding, and learnable fusion rather than as one universally fixed model family [2403.13299] [2506.10569] [2507.12719].

## 1. Terminology and conceptual scope

Within the surveyed literature, the most explicit use of the term “Composite Operator-Based Neural Network” appears in a stormwater-treatment study that casts prediction as learning nonlinear operators from parameterized event descriptors, particulate class, time, and spatial coordinates to spatiotemporal output fields [2507.04682]. That work uses the acronym CPNN for a concrete architecture, not merely for a loose design metaphor.

A broader antecedent appears in the “composite neural network” framework, where pre-trained and non-instantiated neural modules are arranged as a rooted directed acyclic graph, with linear or affine combiners and pointwise activations connecting heterogeneous components [1910.09739]. In that formulation, pre-trained modules are treated as frozen operators and only a small number of combiner parameters are learned end-to-end. This provides an operator-centric interpretation of composite modeling even though the paper does not use the exact CPNN acronym.

The nomenclature is not uniform across fields. A neuroevolution paper explicitly states that “Composite Operator-Based Neural Network (CPNN) does not correspond to a standard model in the neuroevolution literature” and that, in that context, the phrase is “almost certainly a misnomer for Compositional Pattern Producing Networks (CPPNs)” [1606.02580]. This distinction is important because operator-based CPNN and coordinate-generating CPPN describe different research lineages.

## 2. Mathematical formulation as operator composition

In the stormwater formulation, the task is cast as learning a nonlinear operator
\[
\mathcal{M}:\mathbb{X}\rightarrow \mathbb{Y},
\]
where \(\mathbb{X}\) comprises parameterized inputs and \(\mathbb{Y}\) comprises outputs over all cases, times, and spatial samples [2507.04682]. Two separate CPNNs are trained: one for hydrodynamics and one for particulate-matter transport. The hydraulic operator is written as
\[
O_{\mathrm{hyd}}:\mathcal{X}_{\mathrm{hyd}} \rightarrow |\mathbf{u}|(\mathbf{x},t),
\]
with \(\mathcal{X}_{\mathrm{hyd}}=\{\mathbf{p},\mathbf{T},\mathbf{q}\}\), \(\mathbf{p}=[\lambda,k,\theta,C_0,k_d]\), \(\mathbf{T}=[t]\), and \(\mathbf{q}=[x,y,z]\). The PM operator is written as
\[
O_{\mathrm{PM}}:\mathcal{X}_{\mathrm{PM}} \rightarrow c(\mathbf{x},t),
\]
with \(\mathcal{X}_{\mathrm{PM}}=\{\mathbf{p},\mathbf{cl},\mathbf{T},\mathbf{q}\}\) and \(\mathbf{cl}=[w_s]\).

The paper positions CPNN against three increasingly structured operator parameterizations:
\[
\mathrm{ANN}(\mathbf{p},\mathbf{cl},\mathbf{T},\mathbf{q})=\mathbf{NN}(\mathbf{p}\times \mathbf{cl}\times \mathbf{T}\times \mathbf{q}),
\]
\[
\mathrm{DeepONet}(\mathbf{p},\mathbf{cl},\mathbf{T},\mathbf{q})=\mathbf{Br}(\mathbf{p}\times \mathbf{cl}\times \mathbf{T})\odot \mathbf{Tr}(\mathbf{q}),
\]
\[
\mathrm{MIONet}(\mathbf{p},\mathbf{cl},\mathbf{T},\mathbf{q})=\mathbf{Br1}(\mathbf{p})\odot \mathbf{Br2}(\mathbf{cl})\odot \mathbf{Tr1}(\mathbf{T})\odot \mathbf{Tr2}(\mathbf{q}),
\]
where \(\times\) denotes Cartesian product over inputs and \(\odot\) denotes element-wise Hadamard product over latent embeddings. The CPNN extends the MIONet encoder with a decoder:
\[
\mathbf{y}(\mathbf{p},\mathbf{cl},\mathbf{T},\mathbf{q};\boldsymbol{\Theta})
=
\mathbf{W}_m
\big\{
\mathbf{H}_{m-1}\circ \cdots \circ \mathbf{H}_1 \circ \mathbf{M}
\big\}
(\mathbf{p},\mathbf{cl},\mathbf{T},\mathbf{q})
+
\mathbf{b}_m,
\]
\[
\mathbf{H}_j(\mathbf{x}_j)=\zeta(\mathbf{W}_j\mathbf{x}_j+\mathbf{b}_j),
\]
with \(\mathbf{M}\) the MIONet encoder and \(\zeta\) the activation; Tanh is used, and Leaky ReLU is also investigated.

A related operator-composition formalism appears in dual-path neural operators, where a residual path and a dense path are run in parallel:
\[
U_{k+1}(x)=G_k(U_k)(x)+U_k(x), \qquad
V_{k+1}(x)=G_k([V_0,V_1,\dots,V_k])(x),
\]
followed by
\[
O(x)=F_{\mathrm{fuse}}(O_{\mathrm{res}}(x),O_{\mathrm{dense}}(x)).
\]
This parallel composite view is not identical to the stormwater CPNN, but it formalizes the same core idea that complex solution operators can be constructed from simpler operator blocks via composition and fusion [2507.12719].

## 3. Architectural realization in the stormwater CPNN

The stormwater CPNN uses an encoder-decoder decomposition in which two branch networks encode event parameters \(\mathbf{p}\) and PM class \(\mathbf{cl}\), and two trunk networks encode time \(\mathbf{T}\) and spatial coordinates \(\mathbf{q}\) [2507.04682]. Their latent outputs are merged by a Hadamard product and passed to a fully connected decoder. The architecture is explicitly “composite” because the input groups are embedded separately and only then composed.

The encoder structure is motivated by operator learning rather than by physics-informed residual minimization. The CFD labels come from unsteady RANS hydrodynamics coupled with Euler–Euler PM transport under one-way coupling, but the CPNN itself is trained without PINN terms. The PM operator does not explicitly take predicted \(|\mathbf{u}|\) as input; instead, both hydraulic and PM operators share the same encoder inputs, and PM transport dependencies on hydraulics are learned implicitly from the CFD-generated labels.

| Input group | Symbol | Mini-batch shape |
|---|---|---|
| Event parameters | \(\mathbf{p}\) | \((N_L^{b},1,1,1,5)\) |
| PM class | \(\mathbf{cl}\) | \((1,N_c^{b},1,1,1)\) |
| Time | \(\mathbf{T}\) | \((1,1,N_t^{b},1,1)\) |
| Spatial coordinates | \(\mathbf{q}\) | \((N_L^{b},1,1,N_s^{b},3)\) |

After broadcasting and Hadamard composition, the merged latent tensor has shape \((N_L^{b},N_c^{b},N_t^{b},N_s^{b},N_h)\). The best Optuna configuration uses \(N_l^e=2\) MIONet encoding layers, \(N_l^f=6\) FCNN layers, \(N_h=92\) hidden neurons, learning rate \(lr=0.002\), decay rate \(\gamma=0.984\), and mini-batch sizes \(N_L^{b}=226\), \(N_t^{b}=227\), and \(N_s^{b}=195\). Two separate networks are used for \(|\mathbf{u}|\) and \(c\), which yielded better PM performance and a smaller memory footprint than a joint network.

## 4. Governing physics, data generation, and optimization

The stormwater dataset is generated from \(M=640\) unsteady \(3\)D URANS simulations of a full-scale hydrodynamic separator with diameter and depth \(1.21\ \mathrm{m}\), inlet and outlet on the centerline, \(O=360\) time instances sampled every \(10\ \mathrm{s}\) over one hour, and \(N=8{,}000\) Latin-hypercube spatial samples per case [2507.04682]. Hydrograph and pollutograph parameters are sampled by Latin hypercube sampling over the ranges \(\lambda\in[0.0017,0.2012]\), \(k\in[1.1,99.3]\), \(\theta\in[0.23,51.5]\), \(C_0\in[0.1072,3.6963]\), and \(k_d\in[0.5,1.0]\). The PM phase is represented by nine classes with terminal velocities \(w_s\) from \(1\times 10^{-6}\ \mathrm{m/s}\) to \(0.1\ \mathrm{m/s}\).

The paper states that the hydraulics are modeled by incompressible URANS and PM by advection–diffusion with settling and source/sink terms. Canonical forms are given as
\[
\nabla\cdot \mathbf{u}=0,
\]
\[
\rho\left(\frac{\partial \mathbf{u}}{\partial t}+(\mathbf{u}\cdot\nabla)\mathbf{u}\right)
=
-\nabla p+\mu\nabla^2\mathbf{u}+\mathbf{f}_{\mathrm{RANS}},
\]
and
\[
\frac{\partial C}{\partial t}+\nabla\cdot(\mathbf{u}C)
=
\nabla\cdot(D\nabla C)+S(C,\mathbf{x},t).
\]
The learned model is therefore supervised by physics-resolved data, but it is not trained through explicit PDE residual constraints.

The dataset is split into \(512\) training cases, \(64\) validation cases, and \(64\) test cases. Inputs \(\mathbf{p}\), \(\mathbf{cl}\), \(\mathbf{T}\), and \(\mathbf{q}\) are standardized to zero mean and unit variance. Training uses PyTorch with mixed precision, Adam, and standardized MSE. The representative mini-batch loss is
\[
\mathcal{L}_{\mathrm{MSE}}
=
\frac{1}{N_L^{b}N_c^{b}N_t^{b}N_s^{b}}
\sum_{l,c,t,s}
\left(\hat{y}_{lcts}-y_{lcts}\right)^2.
\]
Hyperparameter search uses Optuna’s TPE with \(140\) trials, each trained for \(25{,}000\) iterations. Baseline comparison models with approximately \(365\mathrm{k}\) parameters are trained for \(40{,}000\) iterations.

A distinctive feature of the framework is its direct use of automatic differentiation. The CPNN can compute
\[
\frac{\partial c(\mathbf{x},t)}{\partial \lambda},\quad
\frac{\partial c(\mathbf{x},t)}{\partial k},\quad
\frac{\partial c(\mathbf{x},t)}{\partial \theta},\quad
\frac{\partial c(\mathbf{x},t)}{\partial C_0},\quad
\frac{\partial c(\mathbf{x},t)}{\partial k_d},
\]
as well as derivatives with respect to \(w_s\), \(t\), and \(\mathbf{q}\). In the reported sensitivity analysis, doubling \(\lambda\) accelerates and strengthens the first flush; increasing \(k\) and \(\theta\) lowers and delays the hydrograph peak; doubling \(C_0\) uniformly raises concentrations where flow exists; and increasing \(k_d\) has a smaller overall impact.

## 5. Empirical performance, error structure, and workflow implications

Across dataset splits, the stormwater CPNN reports \(R^2\) in \([0.953,0.997]\) for concentration \(c\) and in \([0.989,0.994]\) for velocity magnitude \(|\mathbf{u}|\) [2507.04682]. Case-wise test performance further shows that \(95.2\%\) of hydraulic test cases have \(R^2>0.8\), \(4.8\%\) fall in the medium category, and none are in the low category; for PM concentration, \(72.6\%\) of cases have \(R^2>0.8\), \(22.6\%\) lie in \([0.4,0.8]\), and \(4.8\%\) are below \(0.4\). The paper uses
\[
R^2
=
1-\frac{\sum_i (y_i-\hat{y}_i)^2}{\sum_i (y_i-\bar{y})^2}.
\]

The main baseline comparison is between ANN, MIONet, and CPNN. Eliminating explicit Cartesian-product redundancy reduces the total input footprint from \(52.6\ \mathrm{GB}\) in ANN to \(0.05\ \mathrm{GB}\) in MIONet and CPNN, a reduction of more than \(99\%\). MIONet trains faster, but CPNN is more expressive because the FCNN decoder processes the expanded latent tensor. The reported validation MSE is approximately \(6\times 10^{-5}\) for CPNN versus approximately \(5.7\times 10^{-4}\) for MIONet. ANN and CPNN have similar peak per-batch VRAM, exceeding \(10\ \mathrm{GB}\).

The error analysis is explicit about failure modes. Dominant jet flows are learned well, but fine circulation structures in the tank interior can be missed. PM dispersion near inlet-jet impingement on the outlet wall is challenging under complex unsteady loading. Extreme low-flow or very small-\(\theta\) events can be mispredicted, including premature settling in the inlet pipe when the network underpredicts \(Q_{\mathrm{inlet}}\). The paper attributes this to multiple-orders-of-magnitude variation and to the lower contribution of low-range samples to the total MSE; no explicit loss reweighting is used.

The workflow implications are practical rather than purely methodological. The paper outlines continuous, event-by-event evaluation: long-term hydrograph and pollutograph records are segmented into events, each event is parameterized, CPNN is run per event, and outlet suspended-solids discharge is aggregated into continuous effluent metrics. This establishes CPNN as a surrogate for continuous, long-term performance assessment of stormwater infrastructure rather than only as a one-off emulator of individual CFD simulations.

## 6. Related formulations, extensions, and conceptual boundaries

Several recent papers instantiate closely related composite-operator ideas in other scientific domains. In multiscale bubble dynamics, a “composite neural operator model” combines a DeepONet-style mean operator \(G_{\text{mean}}\) with an LSTM fluctuation generator \(G_{\text{fluc}}\), producing
\[
\hat{R}(t)=G_{\text{mean}}(u)(t)+s(R_0)\,G_{\text{fluc}}(u)(t),
\]
and reports “99% accuracy for the time evaluation of the bubble radius” while reproducing size-dependent correlated fluctuations [2403.13299]. In structural dynamics, a composite learning framework combines a preprocessing physics operator, a Fourier Neural Operator for discrepancy learning, and a linear-regression postprocessor,
\[
\hat{\mathbf{u}}(t)=\mathcal{R}\Big(\mathbf{u}_p(t)+\mathcal{N}_\theta(\text{inputs})(t)\Big),
\]
with reported improvements such as top-story RMSE \(0.0187\ \mathrm{m}\rightarrow 0.0102\ \mathrm{m}\) and relative \(L^2\) \(0.9582\rightarrow 0.5245\) for the five-story Bouc–Wen benchmark [2506.10569]. In PDE operator learning, DPNO composes residual and dense operator paths in parallel and reports relative \(L^2\) improvements exceeding \(30\%\) on certain Burgers and Darcy benchmarks [2507.12719].

| Work | Composite structure | Reported emphasis |
|---|---|---|
| [2507.04682] | MIONet encoder + FCNN decoder | Unsteady hydrodynamics and PM transport |
| [2403.13299] | DeepONet mean operator + LSTM fluctuation generator | Multiscale bubble growth with correlated fluctuations |
| [2506.10569] | Physics preprocessing + FNO correction + regression postprocessing | Trajectory-level seismic response |
| [2507.12719] | Parallel residual and dense operator paths with fusion | PDE operator approximation |

A distinct theoretical line defines a composite neural network as a rooted DAG of pre-trained and trainable components, proves that such a network performs better than any individual pre-trained component with a high probability bound, and shows that adding an extra pre-trained component will not degrade overall performance with high probability [1910.09739]. This suggests that composite-operator architectures can be viewed simultaneously as empirical design patterns and as objects of formal study.

A recurring misconception is acronymic rather than architectural. CPNN in the operator-learning sense should not be conflated with CPPN in neuroevolution. The latter refers to Compositional Pattern Producing Networks, a coordinate-based generative encoding later extended to Differentiable Pattern Producing Networks, and the neuroevolution paper explicitly rejects “Composite Operator-Based Neural Network” as a standard label in that literature [1606.02580]. The distinction is substantive: operator-based CPNN composes scientific surrogate operators, whereas CPPN generates structured patterns or network weights from spatial coordinates.

Taken together, these works indicate that CPNN presently names a family resemblance more than a fully standardized taxonomy. The common invariant is the decomposition of a difficult map into coordinated operators—branches, trunks, physics preprocessors, stochastic fluctuation modules, residual paths, dense paths, or frozen expert modules—followed by learnable recombination.

Source: https://www.emergentmind.com/topics/composite-operator-based-neural-network-cpnn