---
title: 'Finite-Basis PINNs: Scalable PDE Solvers'
url: https://www.emergentmind.com/topics/finite-basis-physics-informed-neural-networks-fbpinns
type: topic
---

# Finite-Basis PINNs: Scalable PDE Solvers

Finite-Basis Physics-Informed Neural Networks (FBPINNs) generalize the standard physics-informed neural network (PINN) paradigm by introducing explicit domain decomposition and an overlapping, partition-of-unity architecture. This approach divides the computational domain into multiple overlapping subdomains, each equipped with a localized neural network and blended globally via smooth window functions. FBPINNs provide scalable, mesh-free, and automated frameworks for solving partial differential equations (PDEs) and related inverse problems, demonstrating improved accuracy, training efficiency, and scalability—especially for high-frequency, multiscale, and large-domain problems—relative to conventional monolithic PINNs [2107.07871, 2306.05486, 2511.15445].

## 1. Mathematical Foundations and Core Ansatz

FBPINNs begin by decomposing the global domain $\Omega \subset \mathbb{R}^d$ into $J$ overlapping subdomains $\{\Omega_j\}_{j=1}^J$. Each subdomain $\Omega_j$ is assigned a smooth partition-of-unity window function $\phi_j(\mathbf{x})$ with compact support, satisfying:
\[
0 \leq \phi_j(\mathbf{x}) \leq 1, \quad \operatorname{supp}(\phi_j) \subset \Omega_j, \quad \sum_{j=1}^J\phi_j(\mathbf{x}) = 1, \quad \forall \mathbf{x} \in \Omega
\]
The global trial solution is constructed as:
\[
\hat u(\mathbf{x};\theta) = \sum_{j=1}^J \phi_j(\mathbf{x})\, N_j(\mathbf{x};\theta_j), \qquad \theta = (\theta_1,\dots,\theta_J)
\]
Here, $N_j(\mathbf{x};\theta_j)$ is a small neural network (perceptron or other architecture) localized to $\Omega_j$. The blending via $\phi_j$ ensures $C^k$ global continuity without explicit interface penalties. This ansatz is inspired by classical finite element and domain decomposition methods but employs neural networks to represent the finite basis functions within each patch [2107.07871, 2211.05560, 2306.05486, 2511.15445].

## 2. Window Functions, Local Rescaling, and Partition-of-Unity

A key architectural aspect of FBPINNs is the choice of partition-of-unity (window) functions, which enable seamless gluing of subdomain solutions. A common choice is squared cosine windows:
\[
\hat\varphi_j(\mathbf{x}) = \prod_{n=1}^d \left[1+\cos\left(\pi \frac{x_n-\mu_{j,n}}{\psi_{j,n}}\right)\right]^2, \quad
\varphi_j(\mathbf{x}) = \frac{ \hat\varphi_j(\mathbf{x}) }{ \sum_{m=1}^J \hat\varphi_m(\mathbf{x}) }
\]
where $\mu_{j,n}$ and $\psi_{j,n}$ denote the center and half-width of $\Omega_j$ in direction $n$, and the overlap ratio $\eta>1$ controls the blending width [2511.15445, 2306.05486]. The partition-of-unity guarantees global coverage and smooth transitions. Local rescaling ("per-patch normalization") maps each subdomain to a canonical coordinate system (e.g., $[-1,1]^d$), mitigating the spectral bias and allowing each local network to efficiently approximate high-frequency local features [2107.07871, 2306.05486, 2211.05560].

## 3. Loss Functions and Training Schedules

The composite loss functional in FBPINNs consists of physics-informed residuals evaluated at collocation points (interior and boundary), with optional data-fitting or parameter constraints for inverse problems:
\[
L(\theta) = \lambda_{\text{PDE}} \sum_{i=1}^{N_I}\left| \mathcal{N}[\hat u(\mathbf{x}_i;\theta)] - f(\mathbf{x}_i) \right|^2
+ \sum_{k=1}^K \lambda_{B,k} \sum_{i=1}^{N_B^k} \left| \mathcal{B}_k[\hat u(\mathbf{x}_i^{(k)};\theta)] - g_k(\mathbf{x}_i^{(k)}) \right|^2
\]
where $\mathcal{N}[\cdot]$ is the differential operator, and possibly additional data or parameter constraints [2409.01949, 2211.05560, 2410.01599]. The overlapping architecture naturally enforces interface smoothness, requiring no additional "gluing" penalties.

FBPINN training exploits Schwarz-type iterative schedules:
- **Additive Schwarz (fully parallel):** all subdomains updated simultaneously.
- **Multiplicative Schwarz (sequential):** one subdomain updated at a time.
- **Hybrid Schwarz (coloring):** updates on non-overlapping subdomain sets in parallel [2211.05560].

Multilevel extensions introduce hierarchies of coarse-to-fine domain decompositions, enhancing global communication between subdomains and improving scalability for problems with large $J$ [2306.05486, 2511.15445].

## 4. Algorithmic Extensions: ELM Linearization and Preconditioned Training

Recent work extends FBPINNs in two orthogonal directions:
- **ELM-FBPINN**: Each subdomain network is replaced by an Extreme Learning Machine (single hidden layer with random weights, only training linear coefficients). The global problem then becomes a high-dimensional, but sparse, linear or least-squares system, drastically reducing training time. This yields orders-of-magnitude speedup and retains scalability with respect to the number of subdomains but is currently demonstrated only on 1D examples [2409.01949].
- **Multi-Preconditioned LBFGS (MP-LBFGS)**: For standard nonlinear FBPINNs (with general MLP subnetworks), parallel, subdomain-local quasi-Newton corrections are constructed and optimally combined through a subspace minimization. MP-LBFGS reduces global epochs and communication, accelerates convergence, and achieves lower final validation error compared to standard LBFGS, especially for large numbers of subdomains [2601.08709].

## 5. Theoretical Justification and Spectral Bias Mitigation

The domain decomposition structure of FBPINNs directly addresses the spectral bias of neural networks. By localizing the representation, high-frequency modes of the global solution correspond to lower-frequency modes within each rescaled patch. This accelerates convergence and enables accurate resolution of multi-scale and oscillatory solutions without excessively enlarging network size or collocation density [2107.07871, 2211.05560, 2401.07888, 2306.05486, 2511.15445]. Multilevel and coarse-space correction strategies further restore scalability, with coarse global networks capturing global (low-frequency) modes and local subnetworks capturing high-frequency or residual content [2211.05560, 2306.05486].

## 6. Empirical Performance and Applications

Empirical evaluations consistently demonstrate that FBPINNs outperform standard PINNs in accuracy, efficiency, and data requirements for problems involving high-frequency features, multiscale structure, and larger domains. Representative results include:
- For the Helmholtz equation at moderate frequency, FBPINNs reduce relative $L^2$ errors (e.g., $2.9 \times 10^{-2} \to 1.6 \times 10^{-2}$ in real part) compared to PINNs under both Adam+L-BFGS and ENGD optimization [2511.15445].
- Multi-level FBPINNs further improve scaling and reduce error, consistently achieving one to two orders-of-magnitude lower errors at comparable cost and rapid convergence, even in the presence of many subdomains [2306.05486, 2401.07888].
- Parameter identification and model discovery via domain-decomposed FBPINNs yields lower MSE and enhanced robustness to noise, especially when data is quasi-stationary or sparse [2410.01599].

In addition, FBPINN concepts have been adapted to Kolmogorov-Arnold Networks ("FBKANs") and operator learning architectures, retaining the core domain decomposition, windowing, and parallelization strategies [2406.19662, 2401.07888].

## 7. Practical Considerations, Limitations, and Future Directions

FBPINNs inherit key advantages:
- Scalability to large and multi-scale problems via parallelizable, patch-wise neural architectures.
- Robust mitigation of spectral bias.
- Automatic imposition of continuity and smoothness across subdomains.

However, challenges include:
- Only moderate error reduction at very high frequencies; performance plateaus for extremely oscillatory regimes.
- Sensitivity to overlap ratio and smoothness of window functions.
- In some settings, training the imaginary component (e.g., in Helmholtz) remains challenging [2511.15445].
- For ELM-FBPINN, application to higher-dimensional PDEs, best practices for random initialization, and ill-conditioning in complex geometries remain open questions [2409.01949].

Prospective extensions include:
- Full multilevel (coarse-to-fine) domain decompositions [2306.05486, 2511.15445].
- Adaptive overlap or windowing strategies.
- Physics-informed operator networks using FBPINN-style domain partitioning [2401.07888].
- Further algorithmic improvements in nonlinear preconditioning, communication patterns, and robust hyperparameter selection in large-scale high-performance computing environments [2601.08709].

FBPINNs thus represent a principled, domain decomposition-inspired advance in physics-informed machine learning, providing a pathway to mesh-free, scalable, and accurate neural solvers for challenging PDEs and inverse problems spanning high-frequency, multi-scale, and data-sparse regimes [2107.07871, 2306.05486, 2511.15445].

Source: https://www.emergentmind.com/topics/finite-basis-physics-informed-neural-networks-fbpinns