---
title: Multimodal Neural Operator (MNO)
url: https://www.emergentmind.com/topics/multimodal-neural-operator-mno
type: topic
---

# Multimodal Neural Operator (MNO)

Searching arXiv for the cited MNO-related papers and terminology.
Search query: "2507.11870 Multimodal Neural Operator MNO"
Multimodal neural operator (MNO) denotes an operator-learning framework in which multiple heterogeneous inputs jointly condition a learned map between function spaces. In its most specific use, the term refers to the architecture introduced in “MNO : A Multi-modal Neural Operator for Parametric Nonlinear BVPs,” where the learned operator maps PDE coefficients, right-hand sides, and boundary data to the solution of a parametric nonlinear boundary value problem in a unified model [2507.11870]. More broadly, the term has been used for operator learners that combine stimulus functions with structured latent descriptors, as in NOBLE for neuron dynamics [2506.04536]. The acronym is also overloaded in adjacent theory papers, where “MNO” denotes “Multiple Neural Operators” or “Multiple Nonlinear Operator network” rather than “multimodal”; those works address related questions of conditioning a single operator learner on descriptors of operator families [2510.25379][2604.01961][2605.22724].

## 1. Formal definition and problem class

In the boundary-value setting, MNO is formulated for parametric nonlinear BVPs on a domain $\Omega \subset \mathbb{R}$, with $\partial \Omega = \{0,1\}$ in the reported 1D experiments. The governing equations are written as
$$
A(u;\theta_a)=f \text{ in } \Omega,\qquad B(u;\theta_b)=g \text{ on } \partial\Omega,
$$
and instantiated as
$$
D_1(x,u;a)=c \text{ for } x\in\Omega,\qquad D_2(x,u;f)=g \text{ for } x\in\partial\Omega.
$$
The learned solution operator is
$$
G:(\theta_a,f,g,\theta_b)\mapsto u,
$$
while the specific multi-parameter operator learned by the architecture is
$$
A^\dagger:(a,c,f,g)\mapsto u.
$$
The central claim is that coefficients such as $a$ parametrize operators acting on $u$, whereas $c$ and $g$ parametrize the range; this modality mismatch is one of the stated reasons why standard unimodal neural operators become difficult to extend to simultaneous variation in coefficients, sources, and boundary terms [2507.11870].

The reported examples cover three increasingly structured settings. The first is the linear 1D Poisson problem with constant coefficients and Dirichlet boundary conditions, in which the map is $c \mapsto u$. The second is linear 1D Darcy flow,
$$
-\nabla\cdot(a(x)\nabla u(x))=c(x),\qquad x\in(0,1),\qquad u(0)=u_0,\ u(1)=u_1,
$$
with the learned map $(a,c)\mapsto u$. The third is a nonlinear first-order BVP with an integral boundary condition,
$$
a(x)u'(x)+b(x)|u(x)|=c(x),\qquad \int_0^1 f(x)u(x)\,dx=g,
$$
with the full multimodal map $(a,b,c,f,g)\mapsto u$ [2507.11870].

A closely related but domain-specific definition appears in NOBLE, where a multimodal operator maps a stimulus function and modality descriptors of a neuron to a voltage trajectory. There the operator is written as
$$
\mathcal{T}_\theta:(\mathbf{z},I(\cdot))\mapsto V(\cdot),
$$
with $\mathbf{z}$ a biologically informed latent vector and $I(\cdot)$ a current-injection time series [2506.04536]. This broader usage preserves the same structural idea: multiple modalities are lifted into a common operator model rather than treated as isolated regression inputs.

## 2. Hierarchical architecture for parametric BVPs

The MNO architecture for BVPs is built in three stages: a Generalized FMM (GFMM) block, a Unimodal Neural Operator (UNO) formed by stacking GFMM blocks, and a multimodal fusion mechanism that couples a coefficient branch to an RHS branch across the hierarchy [2507.11870]. The construction is motivated by the Fast Multipole Method, specifically by the rank structure of discretized PDE operators and the corresponding upward and downward signal flow.

In the paper’s 1D GFMM, an input $c\in\mathbb{R}^D$ is partitioned into $M=2^L$ blocks of size $P=D/M$. The block uses hierarchical encoder and decoder layers with bridge operators at each level. The encoder computes
$$
h^l_i = E^l_{2i-1} h^{l-1}_{2i-1} + E^l_{2i} h^{l-1}_{2i},
$$
the top bridge applies
$$
z^L = B^L h^L,
$$
and the decoder propagates
$$
z^l_i = D^l_i z^{l+1}_{\lceil i/2\rceil},\qquad z^l=z^l+B^l h^l,
$$
down to $l=0$, with output $u=z^0$. Near-field interactions are carried by the bridge operators $B^l$, which are implemented as banded or blocked operators, while far-field interactions are handled by the encoder and decoder blocks $E_i^l$ and $D_i^l$ through hierarchical aggregation and translation [2507.11870].

The reported parameter count for a linear 1D GFMM block is
$$
(10\cdot 2^L - 2L - 9)P^2,
$$
in contrast to a dense layer with
$$
D^2 = 2^{2L}P^2.
$$
The paper presents this as the main source of parameter efficiency. UNO then stacks multiple GFMM blocks, with a multi-channel extension in which a basis transform becomes a $4$-D tensor $F\in\mathbb{R}^{C_{\text{out}}\times C_{\text{in}}\times P\times P}$ acting by channel summation. In that form UNO learns single-parameter maps such as $c\mapsto u$ or $a\mapsto u$ [2507.11870].

MNO extends UNO by using two branches. The coefficient branch ingests modalities such as $a$, $b$, and $f$, and produces latent basis representations at each hierarchical level. The RHS branch ingests $c$ and $g$ and maps to $u$. The defining multimodal step is an additive fusion in which coefficient-dependent latent corrections perturb the RHS-branch weights before each basis transform:
$$
z_i=\sum_{j=1}^{C_{\text{in}}}(F_{ij}+\epsilon)y_j,\qquad z_i\leftarrow \phi(z_i),
$$
where $\epsilon\in\mathbb{R}^{P\times P}$ is produced by the coefficient branch at the aligned level. The implemented fusion is therefore additive gating via $\epsilon$ rather than cross-attention or tensor fusion [2507.11870].

## 3. Optimization, discretization, and implementation

Training in the BVP paper is purely data-driven and supervised. The loss is mean squared error on the predicted solution,
$$
\mathcal{L}=\|\hat{u}-u\|_2^2,
$$
optimized with Adam. The initial learning rate is $1\text{e-}3$, and in the Poisson experiment it is decayed to $1\text{e-}4$ after $20\text{k}$ iterations. Reported evaluation metrics are the backward error
$$
\epsilon_{be}=\frac{\|A\hat{u}-c\|}{\|A\|\|\hat{u}\|+\|c\|},
$$
the residual error $\epsilon_{res}=\|D(x,\hat{u})-c(x)\|$, and the relative error
$$
\epsilon_{rel}=\frac{\|\hat{u}-u\|}{\|u\|}.
$$
No physics-informed residual terms are added to the loss [2507.11870].

Synthetic data are generated by “solution sampling.” The solution is drawn as
$$
u(x)=\sum_{k=1}^{N_\alpha}\alpha_k T_k(x),
$$
where $T_k$ are Chebyshev polynomials and $\alpha_k\sim\mathcal{U}[-1,1]$; coefficients are then sampled per problem, and $c$ and $g$ are generated by finite differences applied to the operators $D_1$ and $D_2$. The coefficients $\alpha_k$ are resampled every iteration, which the paper describes as regularization against overfitting. In 1D, experiments use a uniform grid of $D=256$ points on $[0,1]$ and the basis $T_1,\ldots,T_{16}$. The appendix reports preliminary 2D GFMM results on a $128\times128$ grid using a tensor-product quadtree with Morton ordering, block size $8$, and four encoder-decoder levels, but the paper explicitly does not claim general resolution-agnostic behavior [2507.11870].

The default 1D hierarchy uses depth $L=4$ and block size $P=16$, with block-banded bridges such as tri-diagonal bridges. In the implemented multimodal configuration, the coefficient branch receives $[a,b,f]$ as channels and the RHS branch receives $[c,g]$. The nonlinear GFMM uses the rational activation
$$
\phi(x)=\frac{x}{1+|x|},
$$
which the paper motivates by the observation that inverse operators for linear PDEs depend rationally on coefficients and reports as empirically superior to ReLU for multimodal tasks. Training uses single precision on two NVIDIA TITAN RTX GPUs [2507.11870].

## 4. Empirical behavior on linear and nonlinear boundary value problems

In the discrete 1D Poisson experiment, the paper compares UNO, FNO, and DeepONet at similar parameter scales. UNO, configured as two linear GFMM blocks with $P=16$ and $L=4$, has $73{,}216$ parameters; the reported FNO has $139{,}713$ parameters, and DeepONet has $132{,}224$. Under solution sampling with in-distribution $u=\alpha_k T_k$, the reported errors are $\epsilon_{rel}=8.24\text{e-}03$ and $\epsilon_{be}=1.72\text{e-}03$ for FNO, $\epsilon_{rel}=2.05\text{e-}03$ and $\epsilon_{be}=1.60\text{e-}03$ for DeepONet, and $\epsilon_{rel}=5.32\text{e-}06$ and $\epsilon_{be}=1.12\text{e-}04$ for UNO. On OOD solution sampling with $u=\sum \alpha_k T_k$, UNO remains at $\epsilon_{rel}=5.72\text{e-}06$ and $\epsilon_{be}=1.14\text{e-}04$, whereas FNO and DeepONet degrade more strongly. Under RHS-sampled OOD, all models deteriorate, but UNO still yields lower backward error than the baselines [2507.11870].

For 1D Darcy flow, the comparison is between multimodal MNO and several unimodal UNOs that receive only $c$ while being trained under fixed or mixed coefficient distributions. On tests with quadratic coefficients $a\sim a_1$, MNO reports $\epsilon_{rel}=(4.42\pm0.03)\text{e-}03$ and $\epsilon_{res}=(3.77\pm0.06)\text{e-}04$, compared with $(2.71\pm0.04)\text{e-}02$ and $(6.86\pm0.07)\text{e-}04$ for UNO-aQ, and markedly larger errors for UNO-aLN and UNO-mix. On tests with log-normal coefficients $a\sim a_2$, MNO reports $\epsilon_{rel}=(3.37\pm0.07)\text{e-}02$ and $\epsilon_{res}=(1.53\pm0.01)\text{e-}03$, while the unimodal baselines show much larger relative errors, including $(4.07\pm0.02)\text{e+}00$ for UNO-aQ and $(1.95\pm0.002)\text{e+}01$ for UNO-aLN. The stated interpretation is that unimodal training cannot cope with coefficient shifts, whereas MNO learns $(a,c)\mapsto u$ across heterogeneous $a$ distributions [2507.11870].

The nonlinear BVP provides the most complete multimodal test. When $a,b\sim\mathcal{P}_{tr}$ and $f\sim\mathcal{P}_{tr}$, UNO reports $\epsilon_{rel}=(4.1\pm0.07)\text{e-}02$, $\epsilon_{res}^{int}=(4.8\pm0.04)\text{e+}00$, and $\epsilon_{res}^{bnd}=(1.4\pm0.05)\text{e-}02$, whereas MNO reports $\epsilon_{rel}=(7.0\pm0.02)\text{e-}02$, $\epsilon_{res}^{int}=(3.8\pm0.06)\text{e-}01$, and $\epsilon_{res}^{bnd}=(8.4\pm0.09)\text{e-}03$. Under simultaneous OOD shifts in both $(a,b)$ and $f$, UNO degrades to $\epsilon_{rel}=(2.8\pm0.06)\text{e+}01$, $\epsilon_{res}^{int}=(1.9\pm0.001)\text{e+}02$, and $\epsilon_{res}^{bnd}=(7.3\pm0.01)\text{e-}02$, while MNO remains at $\epsilon_{rel}=(1.3\pm0.09)\text{e-}01$, $\epsilon_{res}^{int}=(5.5\pm0.14)\text{e-}01$, and $\epsilon_{res}^{bnd}=(1.2\pm0.42)\text{e-}03$ [2507.11870].

The paper also isolates the gap between solution-sampled and RHS-sampled OOD regimes. For Poisson, residual errors rise from $2.83\text{e-}05$ to $4.96\text{e-}01$ for UNO; for Darcy, from $3.93\text{e-}04$ to $9.22\text{e-}02$ for MNO; and for the nonlinear BVP, from $4.12\text{e-}01$ to $2.97\text{e+}00$ for MNO. This indicates that multimodal conditioning improves robustness, but does not remove the difficulty of RHS-sampled OOD generalization [2507.11870].

## 5. Broader multimodal operator formulations

The broader concept of multimodal operator learning predates the specific GFMM-based MNO. MIONet studies operators defined on a product of Banach spaces,
$$
\mathcal{G}:X_1\times X_2\times \cdots \times X_n \to Y,
$$
and proves a universal approximation theorem for continuous multiple-input operators on compact product sets. Its low-rank realization uses several branch nets, one per modality, and a trunk net for the output domain, with the forward map written as an elementwise tensor-product factorization of branch features and trunk features. In the low-rank form, the approximation is
$$
\tilde{\mathcal{G}}(v_1,\ldots,v_n)(y)=\sum_{k=1}^{p}\left(\prod_{i=1}^{n}\tilde{g}_{i,k}(\varphi_{q_i}^i(v_i))\right)\tilde{u}_k(y)+b.
$$
This establishes a direct antecedent for multimodal operator learning in the sense of multiple functional inputs, although the later GFMM-based MNO uses a different hierarchical mechanism and a different fusion rule [2202.06137].

NOBLE provides a second, domain-specific instantiation of MNO in computational neuroscience. It conditions a temporal FNO on a biologically informed latent vector $\mathbf{z}=(I_{thr},s_{thr})$ together with a current-injection time series $I(t)$, after converting both to frequency-modulated, time-aligned sinusoidal embeddings. The operator learner then predicts somatic voltage trajectories $V(t)$. In the reported configuration, NOBLE uses a 1D FNO with 12 layers, 24 hidden channels, and 256 retained Fourier modes, for approximately $1.8\text{M}$ parameters. It is trained on $37{,}800$ samples generated from 60 hall-of-fame PVALB biophysical models built on NEURON using the BioNet framework, with 50 models for training and 10 for testing. Reported performance includes a test $L^2$ relative error of $2.18\%$ on held-out current injections for the 50 training HoF models and a measured $4200\times$ speedup over the numerical solver at batch size 1000. Morphology and transcriptomics are used upstream in data generation and validation, but in this instantiation they are not direct operator inputs [2506.04536].

These two lines of work show that “multimodal” can refer either to jointly varying PDE coefficients, sources, and boundary operators, or to stimulus functions conditioned on interpretable latent descriptors. In both cases, the operative distinction from standard unimodal operator learning is that the learned map is defined on a product of heterogeneous modalities rather than on a single functional argument.

## 6. Theoretical and terminological context

A terminological complication is that several recent theory papers use the acronym “MNO” differently. “A Deep Learning Framework for Multi-Operator Learning: Architectures and Approximation Theory” defines MNO as a “Multiple Nonlinear Operator network,” with the separable form
$$
\mathrm{MNO}[\alpha][u](x)=\sum_{p=1}^{P}\sum_{k=1}^{H^{(p)}} l_p(\alpha)\, b_{pk}(u)\, \tau_{pk}(x),
$$
where $\alpha$ is an operator descriptor, $u$ is an input function, and $x$ is a query location. That work distinguishes multiple operator learning from learning several distinct single operators, establishes universal approximation results in continuous and measurable settings, and derives worst-case Lipschitz scaling laws for approximation complexity [2510.25379].

The later papers “Generalization Bounds and Statistical Guarantees for Multi-Task and Multiple Operator Learning with MNO Networks” and “Multiple Neural Operators Achieve Near-Optimal Rates for Multi-Task Learning” analyze related separable architectures under hierarchical sampling of triples $(\alpha,u,x)$. Their MNO processes these three modalities through distinct subnetworks and recombines them multiplicatively, yielding explicit approximation-estimation tradeoffs and learning-rate statements in the operator-sampling budget $n_\alpha$. One reported rate is
$$
\mathbb{E}[\text{test error}]=\mathcal{O}\!\left(\left(\frac{\log\log n_\alpha}{\log\log\log n_\alpha}\right)^{-2/d_W}\right),
$$
while the later near-optimality paper states that shared representations across tasks do not increase the overall cost and that multi-task operator learning follows the same scaling laws as single operator learning up to logarithmic factors [2604.01961][2605.22724].

This theoretical literature is not about the GFMM-based multimodal BVP architecture specifically. It is instead about separable multi-operator conditioning, where $\alpha$ plays the role of an operator or task descriptor. The overlap is conceptual rather than architectural. A plausible implication is that the multimodal BVP MNO can be viewed as one concrete engineering realization of the broader problem of learning conditioned operator families, but its additive hierarchical fusion and rational activations are not the objects analyzed in those generalization papers.

## 7. Limitations and open questions

The BVP MNO paper states several limitations directly. The demonstrations are primarily 1D, with only preliminary 2D GFMM results in the appendix; future work is identified as higher dimensions, time-dependent PDEs, and diverse geometries. Generalization to RHS-sampled OOD remains challenging, and the paper notes that blending with iterative solvers can improve robustness. It also states that no formal approximation or stability theorems for MNO are proved, and that more rigorous analysis of activation choices and theoretical guarantees is planned [2507.11870].

NOBLE is limited in scope to somatic voltage responses to current injections for a single PVALB neuron’s population of hall-of-fame models. Its multimodal conditioning is also narrower than the label may suggest: the direct inputs are electrophysiological latent features and stimulus only, while morphology and transcriptomics are not yet embedded as model inputs. The paper leaves handling missing modalities, synaptic input conductances, multi-neuron interactions, dendritic recordings, and extrapolation outside the convex hull of training latent features for future work [2506.04536].

The theory papers impose bounded-domain, Lipschitz, separability, clipping, and independence assumptions, and they explicitly identify the extension to non-separable architectures such as attention-based multimodal operators as an open direction [2604.01961]. Taken together, these limitations mark a current division in the literature: multimodal operator architectures have advanced empirically in PDEs and biological dynamics, while rigorous guarantees are stronger for separable multiple-operator models than for the fast-multipole-inspired fusion architectures now used in practice.

Source: https://www.emergentmind.com/topics/multimodal-neural-operator-mno