--- title: Nested Operator Inference (OpInf) url: https://www.emergentmind.com/topics/nested-operator-inference-opinf type: topic --- # Nested Operator Inference (OpInf) Searching arXiv for the cited Nested OpInf papers to ground the article in the current literature. Nested Operator Inference (OpInf) denotes a family of reduced-order modeling procedures in which operator inference is organized through an explicit hierarchy rather than executed as a single monolithic regression. In the hierarchical formulation, the method exploits the inherent hierarchy within the reduced space to iteratively construct initial guesses for the OpInf learning problem that prioritize the interactions of the dominant modes, and the initial guess computed for any target reduced dimension corresponds to a ROM with provably smaller or equal snapshot reconstruction error than with standard OpInf [2508.11542]. A related formulation embeds pre-trained subdomain-local OpInf ROMs inside an overlapping Schwarz alternating method, so that reduced models and high-fidelity models are alternated within each domain-decomposition iteration rather than trained or advanced in isolation [2510.05350]. In these 2025 formulations, “nested” therefore refers either to progression along a POD hierarchy or to embedding OpInf advances inside an outer Schwarz loop. ## 1. Terminological scope and problem setting The term has two distinct uses in the cited literature. In "Nested Operator Inference for Adaptive Data-Driven Learning of Reduced-order Models" [2508.11542], nestedness is internal to the reduced space: one learns ROM operators block by block, starting with the smallest subspace \(V_1\), then \(V_2,\dots,V_r\), and uses operators from \(V_{s-1}\) as an initial guess for \(V_s\). In "Domain Decomposition-Based Coupling of High-Fidelity Finite Element and Reduced Order Operator Inference Models Using the Schwarz Alternating Method" [2510.05350], nestedness is algorithmic: high-fidelity FE solves and low-dimensional OpInf ROM advances are interleaved within each Schwarz iteration. The later solid-dynamics work "Hybrid coupling with operator inference and the overlapping Schwarz alternating method" extends this hybrid viewpoint to FOM–ROM and ROM–ROM couplings on overlapping subdomains [2511.20687]. This distinction matters because the two formulations address different bottlenecks. The hierarchical formulation is motivated by ill-conditioning in large-\(r\) OpInf regression systems and by the hierarchy of POD modes. The Schwarz-embedded formulation is motivated by multiscale coupling, geometry and mesh flexibility, and the localization of expensive high-fidelity solves to difficult regions. A common ambiguity is therefore terminological rather than mathematical: nested OpInf is not a single regression formula, but a broader organizational principle for how OpInf is trained or deployed. ## 2. Operator Inference background and the source of nesting The hierarchical paper formulates the full-order model from snapshot data \(x(t_1),\dots,x(t_K)\in\mathbb R^n\) of a high-dimensional dynamical system $$ \dot x(t)=\mathbf c+\mathbf A x(t)+\mathbf H[x(t)\otimes x(t)],\qquad x(0)=x_0, $$ with \(\mathbf c\in\mathbb R^n\), \(\mathbf A\in\mathbb R^{n\times n}\), and \(\mathbf H\in\mathbb R^{n\times n^2}\). A POD basis $$ V_r=[v_1,\dots,v_r]\in\mathbb R^{n\times r},\qquad V_r^T V_r=I_r, $$ is chosen so that the projection error \(\sum_{k=1}^K\|x(t_k)-V_rV_r^T x(t_k)\|^2\) is minimal among all \(r\)-dimensional subspaces. The reduced state \(\hat x_r(t)\in\mathbb R^r\) then satisfies a ROM with operators \(\hat c_r\), \(\hat A_r\), and \(\hat H_r\) obtained by projection or learned from data [2508.11542]. Standard OpInf constructs a data matrix $$ D_r= \begin{bmatrix} 1 & p_r(t_1) & [p_r(t_1)\otimes p_r(t_1)]\\ \vdots & \vdots & \vdots\\ 1 & p_r(t_K) & [p_r(t_K)\otimes p_r(t_K)] \end{bmatrix}, \qquad R_r= \begin{bmatrix} \dot p_r(t_1)\\ \vdots\\ \dot p_r(t_K) \end{bmatrix}, $$ where \(p_r(t_k)=V_r^T x(t_k)\), and solves a regularized least-squares problem for \(\hat c_r,\hat A_r,\hat H_r\). Under mild conditions this recovers the Galerkin-projected operators. The central difficulty is that, as \(r\) grows, the smallest singular value of \(D_r\) decays, making OpInf unstable or requiring heavy regularization. The nested formulation is introduced precisely to exploit the fact that the POD projection error decays rapidly for small \(s\) and more slowly for larger \(s\), so that dominant-mode interactions can be learned first on better-conditioned subproblems [2508.11542]. ## 3. Hierarchical mathematical formulation For \(2\le s\le r\), nested OpInf writes the operators at level \(s\) as zero-padded expansions of the operators at level \(s-1\) plus increments: $$ \widehat c_s= \begin{pmatrix} \widehat c_{s-1}\\ 0 \end{pmatrix} +\Delta_s^c,\qquad \widehat A_s= \begin{pmatrix} \widehat A_{s-1}&0\\ 0&0 \end{pmatrix} +\Delta_s^A, $$ and similarly for \(\widehat H_s\). The zero-padded quantities define the natural initial guess \(\hat c_s^{(0)},\hat A_s^{(0)},\hat H_s^{(0)}\). Instead of regularizing directly toward zero, the nested objective regularizes the deviation from this inherited model: $$ \min_{\widehat c_s,\widehat A_s,\widehat H_s} \big\|D_s[\widehat c_s,\widehat A_s,\widehat H_s]-R_s\big\|_F^2 +\omega_c^2\|\widehat c_s-\widehat c_s^{(0)}\|_2^2 +\omega_A^2\|\widehat A_s-\widehat A_s^{(0)}\|_F^2 +\omega_H^2\|\widehat H_s-\widehat H_s^{(0)}\|_F^2. $$ Equivalently, one may optimize the increment \(\Delta_s=[\Delta_s^c,\Delta_s^A,\Delta_s^H]\) toward matching \(R_s-R_s^{(0)}\) [2508.11542]. This reformulation changes the role of regularization. In standard OpInf, all blocks are regularized uniformly toward the zero operator. In nested OpInf, previously learned dominant interactions are retained as the default state, while regularization is concentrated on the newly introduced directions. The paper explicitly characterizes this as a structured form of regularization. A plausible implication is that the method separates stabilization of sensitive high-index modes from preservation of already learned low-index dynamics. ## 4. Algorithmic realization, warm-starts, and guarantees Algorithmically, nested OpInf accepts a target dimension \(r\), the POD basis \(V_r\), projected snapshots \(P_r\), derivative matrix \(R_r\), a weight grid \(\{(\omega_c^{(i)},\omega_A^{(i)},\omega_H^{(i)})\}_{i=1}^{n_\omega}\), and optionally a starting dimension \(r_0\le r\) with pre-existing initial guesses. For each \(s=r_0,\dots,r\), the algorithm restricts \(P_r\) and \(R_r\) to the first \(s\) columns, forms \(D_s\), constructs the base initial guess by zero-padding the accepted \(s-1\) model, evaluates the base ROM error \(\delta_s^{(0)}\), solves the nested least-squares problem for each weight triple, integrates the resulting ROM to compute the error \(\delta_s^{(i)}\) and conditioning \(\sigma_s^{(i)}\), and selects the index $$ i^*=\arg\max_{\substack{0\le i\le n_\omega\\ \delta_s^{(i)}\le (1+\bar\delta)\min_j \delta_s^{(j)}}} \sigma_s^{(i)}, $$ that is, the best stability among those achieving near-optimal error [2508.11542]. The same framework supports warm-starts. One can choose \(r_0500\times\) (\(<16\) ms versus \(8\) s). On the training interval \([0,0.2]\), standard OpInf has mean and max reconstruction errors of \(0.112\%\) and \(0.178\%\), whereas nested OpInf has \(0.005\%\) and \(0.008\%\), described as approximately \(22\times\) smaller mean error. Extrapolated to \(t=1.0\), standard OpInf yields mean \(0.209\%\) and max \(1.616\%\), while nested OpInf yields mean \(0.070\%\) and max \(0.397\%\). The effectivity \(\|\text{ROM error}\|/\|\text{POD projection error}\|\) is reported as up to \(1825\), mean \(\sim 51\) for standard OpInf, and up to \(91\), mean \(\sim 2\!-\!12\) for nested OpInf. The paper further states that, for \(r\ge 3\), standard OpInf stagnates at \(\sim 0.2\%\), while nested OpInf continues to improve [2508.11542]. For the Greenland ice sheet model, the state dimension is \(n=20{,}455\) for ice thickness, plus \(2n\) for velocity, with adaptive time stepping from 2015 to 2050. Training uses 17 parameter values and approximately 7000 snapshots of thickness change from 2020. The thickness POD basis with \(r=30\) captures \(99.990\%\) of snapshot energy, while the velocity basis \(W\in\mathbb R^{2n\times 4}\) captures \(99.843\%\). The reduced model has the affine-parameterized form $$ \dot{\hat x}_r(t;z)=\hat m_r(t)+\sum_{j=0}^4 \theta_j(z)\,\hat c_{r,j} +\sum_{j=0}^4 \theta_j(z)\,\hat A_{r,j}\,\hat x_r, $$ with \(\theta_0(z)=1\) and \(\theta_j(z)=w_j^T\bar v(2020;z)\). The paper reports learning \(35\) constant vectors \(\hat m_{r,j}\in\mathbb R^r\) and \(5\) matrices \(\hat c_{r,j},\hat A_{r,j}\), for approximately \(550\) degrees of freedom, from a data matrix \(D_r\in\mathbb R^{6976\times 185}\) with \(\sigma_{\min}(D_r)\approx 1.2\cdot 10^{-5}\) [2508.11542]. The corresponding performance numbers are an offline cost of \(18.4\) min, online speed-up from approximately \(12{,}000\times\) in the worst case to approximately \(19{,}700\times\) on average, and time-averaged relative errors of \(1.65\%\!-\!3.29\%\) on training parameters and \(1.66\%\!-\!7.54\%\) on test parameters, with average \(3.14\%\). The paper states that effectivity remains below \(10\) for all times and parameters and that, despite model-form approximations such as stationary velocity and annual SMB, nested OpInf yields ROM accuracy close to POD projection limits. A plausible implication is that the hierarchical strategy is especially useful when the reduced dimension is large enough for monolithic OpInf to become ill-conditioned, but the dominant POD subspace remains strongly informative. ## 6. Schwarz-embedded nested OpInf in domain decomposition A second line of work places OpInf inside an overlapping Schwarz alternating method rather than inside a hierarchy of reduced dimensions. For the unsteady convection–diffusion–reaction problem on \(\Omega\subset\mathbb R^2\), $$ \frac{\partial u}{\partial t}-\epsilon \Delta u+b\cdot \nabla u+\sigma u=f, $$ the FE semi-discretization on a subdomain \(\Omega_i\) is $$ M_i \frac{dv_i}{dt}+K_i v_i=B_i g_i+f_i, $$ while the reduced OpInf model is $$ \frac{dx_i}{dt}=\hat K_i x_i+\hat B_i g_i+\hat f_i,\qquad v_i=\Psi_i x_i. $$ The reduced operators are inferred from snapshot data \(\{v_i,g_i,dv_i/dt\}_{i=1}^{n_t}\) by solving a Tikhonov-regularized least-squares problem. The online algorithm then nests two loops: a time-stepping loop and a Schwarz iteration loop. At each Schwarz iteration, each subdomain is solved sequentially as FE or ROM depending on its designation, the solution trace on the interface is extracted, and that trace becomes Dirichlet input for the neighboring subdomain at the next subsolve. No re-training occurs online [2510.05350]. The reported numerical example uses \(\Omega=[0,1]^2\), \(T=5.0\), \(\epsilon=10^{-2}\), \(\sigma=10^{-3}\), \(b=(\cos \pi/3,\sin \pi/3)\), \(u_0=0\), homogeneous \(f=0\), four overlapping square subdomains, and a uniform FE mesh with \(h=1/50\) in each subdomain. The upper-right block \(\Omega_4\), which contains the boundary layer, is kept as FE, while \(\Omega_1,\Omega_2,\Omega_3\) are ROM. ROM training uses the time window \([0,0.5]\), snapshots every \(\Delta t=0.01\), \(n_t=50\), POD basis dimension \(r=10\), and unregularized inference \(\lambda=0\). For comparison, the monolithic OpInf ROM uses \(r=30\) and \(\lambda=10^{-1}\). At \(T=5.0\), the reported CPU times and time-averaged relative pointwise errors versus a monolithic FE run are \(18.7\) s and \(\mathcal O(10^{-14})\) for all-FE Schwarz, \(8.9\) s and \(\mathcal O(10^{-4})\) for OpInf-FE Schwarz, and \(0.2\) s and \(\mathcal O(10^{-1})\) for monolithic OpInf. The paper states that the hybrid OpInf-FE method is approximately \(2\times\) faster than all-FE Schwarz, retains high accuracy without any regularization, and that the monolithic OpInf ROM is unstable or inaccurate even with large basis and tuning of \(\lambda\) [2510.05350]. The 3D solid-dynamics extension formulates each subdomain-local FOM as $$ M_i \ddot u_i(t)+K_i(u_i(t))=f_i(t), $$ augmented by Dirichlet data on \(\Gamma_i^D\), and postulates an up-to-cubic reduced model $$ \bar M_i \ddot{\hat u}_i+\bar K_i \hat u_i+\bar H_i \hat u_i^{\otimes 2}+\bar C_i \hat u_i^{\otimes 3} =\bar B_i [M_i^T G_i^D;\,N_i^T G_i^S](t). $$ Snapshots are gathered from a FOM–FOM Schwarz-coupled run; subdomain and boundary POD bases are computed by thin SVD; and the reduced operators are learned through regularized least squares using finite-difference approximations of acceleration. The overlapping Schwarz algorithm then alternates subdomain solves on controller time steps, with spatial and temporal projection operators transferring interface data across nonmatching meshes and time grids [2511.20687]. For that solid-dynamics setting, the paper reports four test problems—clamped beam, bolted joint, torsion bar, and tension specimen—and defines the time-integrated relative error $$ \mathcal E_\Omega(u)= \left[\sum_{k=0}^{\tau}\|u(t_k)-u_{\mathrm{ref}}(t_k)\|^2\right]^{1/2} \bigg/ \left[\sum_{k=0}^{\tau}\|u_{\mathrm{ref}}(t_k)\|^2\right]^{1/2}. $$ The reported observations are that FOM–FOM couplings typically require approximately \(3\!-\!4\) Schwarz iterations, ROM–ROM couplings often converge in \(2\) iterations, FOM–ROM couplings achieve \(1\!-\!5\times\) speedups, and ROM–ROM couplings attain \(10\!-\!10^6\times\) speedups at less than or equal to \(1\!-\!5\%\) global error. The paper attributes the reduction in Schwarz iterations to smoother subdomain solutions under OpInf ROM coupling. This suggests that, in the Schwarz setting, nestedness is not only a deployment strategy for local surrogates but also a mechanism that can empirically alter interface convergence behavior [2511.20687]. ## 7. Limitations, generalizations, and open directions The hierarchical nested OpInf paper states several limitations directly. It requires a nested basis hierarchy such as POD; heavily nonlinear systems may still require additional stabilization such as reprojection; and the method is most beneficial when the target reduced dimension is large enough to cause ill-conditioning in a monolithic OpInf solve, when a natural hierarchy of modes is available, and when one needs on-the-fly expansion or warm-start functionality. Reported extensions include block-wise regularization, adaptive weight grids, multi-fidelity snapshot selection, application to non-polynomial operators via EIM/DEIM, and the use of IterativeUpdates to correct early-iteration divergence by matching ROM roll-outs [2508.11542]. The Schwarz-based studies report a different set of limitations. The FE–OpInf convection–diffusion–reaction study requires an offline FE training phase on each ROM subdomain, is presently linear, and notes that extension to non-linear PDEs will require inferring nonlinear operators. It also remarks that the Schwarz method is sequential in subdomains, and identifies parallel overlap Schwarz or optimized transmission conditions such as Robin and Neumann as possible accelerations. Listed future developments include non-overlapping Schwarz via Mortar methods, parallel asynchronous Schwarz, data-adaptive basis enrichment or online operator update for strong parameter variations, and extension to multi-physics problems such as Navier–Stokes and thermo-elasticity [2510.05350]. The solid-dynamics coupling paper likewise points to non-overlapping and optimized Schwarz, additive Schwarz for parallel scalability, online switching between OpInf ROM and high-fidelity FOM driven by error indicators, and alternative subdomain surrogates including symplectic or Hamiltonian-preserving neural surrogates, PGD, POD–Galerkin, and physics-informed networks. Taken together, these directions indicate that nested OpInf has become a label for two converging research programs: one centered on hierarchical regularization and warm-start learning in reduced coordinates, and the other centered on hybrid multi-fidelity deployment within domain decomposition. A plausible implication is that future work may combine both senses of nesting simultaneously, using hierarchical operator learning inside each subdomain ROM while embedding those ROMs inside optimized Schwarz couplings [2511.20687]. Source: https://www.emergentmind.com/topics/nested-operator-inference-opinf