---
title: Physics-Informed Broad Learning System
url: https://www.emergentmind.com/topics/physics-informed-broad-learning-system-pibls
type: topic
---

# Physics-Informed Broad Learning System

Searching arXiv for the specified paper and closely related work to ground the article.
arxiv_search(query="Physics-Informed Broad Learning System partial differential equations", max_results=5)
arxiv_search(query="2606.19754", max_results=10)
Physics-Informed Broad Learning System (PIBLS) is a physics-informed, backpropagation-free solver for partial differential equations (PDEs) built on the Broad Learning System (BLS) architecture. It preserves the physics-informed idea of Physics-Informed Neural Networks (PINNs)—enforcing the PDE, boundary conditions, and initial conditions through residuals—but replaces the usual deep network and iterative gradient descent with a single-step least-squares solve for the output weights. In the reported formulation, PIBLS uses a shallow-but-wide BLS, keeps the internal random basis fixed, trains only the final linear output weights, and solves those weights by least squares rather than gradient-based optimization. It is presented as mesh-free like PINNs but not iterative, with the stated aim of combining the physics enforcement of PINNs, the speed of closed-form/randomized solvers, and stronger expressive power through the broad basis of BLS [2606.19754].

## 1. Conceptual position among PDE solvers

PIBLS is introduced against two established baselines for PDE computation: traditional mesh-based numerical solvers and PINNs. Classical solvers such as FEM, FVM, and FDM require mesh generation or discretization, incur high cost for fine resolution, and are typically PDE-specific and mesh-dependent. PINNs offer a mesh-free alternative by approximating the PDE solution \(u(\boldsymbol{x})\) with a deep neural network \(\hat{u}(\boldsymbol{x};\theta)\) and training \(\theta\) by minimizing a physics-informed loss using backpropagation, often with Adam and L-BFGS. PIBLS retains the residual-based enforcement of governing equations and constraints, but changes the optimization mechanism fundamentally [2606.19754].

Relative to PINNs, PIBLS uses a shallow-but-wide BLS instead of a deep network, keeps the internal random basis fixed, trains only the final linear output weights, and solves those weights by least squares rather than gradient-based optimization. The reported motivation is to eliminate PINN issues identified in the formulation: slow convergence, sensitivity to optimization hyperparameters, pathological loss landscapes, and gradient vanishing or imbalance. The conceptual novelty is summarized as follows: PIBLS turns PDE solving into a direct linear algebra problem over a rich random basis, with physics enforced through residual equations.

This positioning suggests that PIBLS occupies an intermediate methodological space. It remains physics-informed and mesh-free, as in PINNs, but its computational core is closer to randomized linear-algebraic solvers than to deep-network training.

## 2. Physics-informed direct least-squares formulation

The reported framework considers a general PDE with differential, boundary, and initial operators:
\[
\begin{aligned}
\mathcal{N}[u(\boldsymbol{x})] &= f(\boldsymbol{x}), \quad \boldsymbol{x} \in \Omega,\\
\mathcal{B}[u(\boldsymbol{x})] &= g(\boldsymbol{x}), \quad \boldsymbol{x} \in \partial \Omega_B,\\
\mathcal{I}[u(\boldsymbol{x})] &= s(\boldsymbol{x}), \quad \boldsymbol{x} \in \partial \Omega_I.
\end{aligned}
\]

PIBLS predicts
\[
\hat{u}(\boldsymbol{x}) = \mathbf{A}(\boldsymbol{x}) \mathbf{W}_{\text{out}},
\]
where \(\mathbf{A}\) is the BLS basis matrix and \(\mathbf{W}_{\text{out}}\) are the only trainable parameters. At collocation points, the residuals are defined by
\[
\begin{aligned}
r_{\mathcal{N}}(\boldsymbol{x}_i) &= \mathcal{N}[\hat{u}(\boldsymbol{x}_i)] - f(\boldsymbol{x}_i),\\
r_{\mathcal{B}}(\boldsymbol{x}_j) &= \mathcal{B}[\hat{u}(\boldsymbol{x}_j)] - g(\boldsymbol{x}_j),\\
r_{\mathcal{I}}(\boldsymbol{x}_k) &= \mathcal{I}[\hat{u}(\boldsymbol{x}_k)] - s(\boldsymbol{x}_k).
\end{aligned}
\]

For linear PDEs, the key identity is
\[
\mathcal{O}[\hat{u}(\boldsymbol{x})]
=
\mathcal{O}[\mathbf{A}\mathbf{W}_{\text{out}}]
=
\mathcal{O}[\mathbf{A}]\,\mathbf{W}_{\text{out}},
\qquad
\mathcal{O}\in\{\mathcal{N},\mathcal{B},\mathcal{I}\}.
\]
All conditions are then stacked into a single linear system,
\[
\mathbf{A}_{\text{sys}}\mathbf{W}_{\text{out}} = \mathbf{T},
\]
with
\[
\mathbf{A}_{\text{sys}} =
\begin{bmatrix}
\mathcal{N}[\mathbf{A}_f]\\
\mathcal{B}[\mathbf{A}_{\text{bc}}]\\
\mathcal{I}[\mathbf{A}_{\text{ic}}]
\end{bmatrix},
\qquad
\mathbf{T} =
\begin{bmatrix}
f(\mathcal{X}_f)\\
g(\mathcal{X}_{\text{bc}})\\
s(\mathcal{X}_{\text{ic}})
\end{bmatrix}.
\]
The PDE solve therefore becomes the least-squares problem
\[
\mathbf{W}_{\text{out}}^\ast
=
\arg\min_{\mathbf{W}_{\text{out}}}
\|\mathbf{A}_{\text{sys}}\mathbf{W}_{\text{out}} - \mathbf{T}\|_2^2.
\]

This formulation is the core “physics-informed direct solve” idea. Instead of iteratively minimizing a composite loss over all network parameters, PIBLS reduces the physics-constrained approximation problem to direct least-squares optimization in the output layer.

## 3. Broad Learning System architecture

The BLS architecture used in PIBLS consists of feature nodes, enhancement nodes, and a final linear readout. For input \(\boldsymbol{x}\in\mathbb{R}^D\), the feature layer maps the input into \(n\) groups of feature nodes, each with \(k\) nodes:
\[
z_i(\boldsymbol{x}) = \phi(\boldsymbol{x}\mathbf{W}_{e_i} + \boldsymbol{\beta}_{e_i}),
\qquad i=1,\dots,n,
\]
where \(\mathbf{W}_{e_i}\in\mathbb{R}^{D\times k}\), \(\boldsymbol{\beta}_{e_i}\in\mathbb{R}^k\), \(\phi(\cdot)=\tanh\), and the parameters are randomly initialized and fixed. The feature groups are concatenated as
\[
\mathbf{Z} = [z_1(\boldsymbol{x}), z_2(\boldsymbol{x}), \dots, z_n(\boldsymbol{x})].
\]

A second random nonlinear mapping produces the enhancement layer:
\[
h_j(\boldsymbol{x}) = \xi(\mathbf{Z}\mathbf{W}_{h_j} + \boldsymbol{\beta}_{h_j}),
\qquad j=1,\dots,m,
\]
with \(\mathbf{W}_{h_j}\in\mathbb{R}^{nk\times q}\), \(\boldsymbol{\beta}_{h_j}\in\mathbb{R}^q\), and \(\xi(\cdot)=\tanh\). The enhancement groups are concatenated as
\[
\mathbf{H} = [h_1(\boldsymbol{x}), h_2(\boldsymbol{x}), \dots, h_m(\boldsymbol{x})].
\]

The full basis is
\[
\mathbf{A} = [\mathbf{Z}\mid \mathbf{H}],
\]
and the surrogate solution is
\[
\hat{u}(\boldsymbol{x}) = \mathbf{A}\mathbf{W}_{\text{out}}.
\]
Because \(\hat{u}\) is linear in \(\mathbf{W}_{\text{out}}\), once \(\mathbf{A}\) is constructed the solution reduces to solving a linear or nonlinear least-squares system; no gradient descent over hidden weights is required. The formulation also notes that feature weights and biases may optionally be fine-tuned with a sparse autoencoder, but the core PIBLS method still avoids backpropagation through the PDE loss [2606.19754].

This architecture is broad rather than deep: representational capacity is increased by width, grouped random mappings, and the composite basis \([\mathbf{Z}\mid\mathbf{H}]\), rather than by repeated trainable depth.

## 4. Nonlinear PDE handling and the enhanced NLSQ-perturb algorithm

For nonlinear PDEs, the linear-system reduction no longer applies directly because \(\mathcal{N}[u]\) is nonlinear in the solution field. The method therefore formulates a nonlinear least-squares objective,
\[
\mathcal{L}(\mathbf{W}_{\text{out}})
=
\|\boldsymbol{r}_{\mathcal{N}}(\mathcal{X}_f)\|_2^2
+
\|\boldsymbol{r}_{\mathcal{B}}(\mathcal{X}_{\text{bc}})\|_2^2
+
\|\boldsymbol{r}_{\mathcal{I}}(\mathcal{X}_{\text{ic}})\|_2^2,
\]
with the initial term omitted for steady-state problems. The reported solver combines Trust-Region Reflective (TRF) nonlinear least squares, exact Jacobians from analytical derivatives, and an Enhanced NLSQ-perturb algorithm [2606.19754].

Because the surrogate remains linear in the output weights, the residual Jacobian has the structure
\[
J(\mathbf{W}_{\text{out}})
=
\frac{\partial \boldsymbol{r}}{\partial \mathbf{W}_{\text{out}}}
=
\frac{\partial \boldsymbol{r}}{\partial \hat{u}}
\frac{\partial \hat{u}}{\partial \mathbf{W}_{\text{out}}}
=
\frac{\partial \boldsymbol{r}}{\partial \hat{u}}\,\mathbf{A}.
\]
This preserves analytical tractability even when the PDE residual is nonlinear in \(\hat{u}\).

The perturbation modification proceeds in five reported steps. First, a physics-informed initial guess \(\mathbf{W}_0\) is constructed by solving a linearized PDE. Second, the nonlinear least-squares problem is solved with TRF. Third, if the loss stagnates or local minima occur, the current weights are perturbed:
\[
\Delta \mathbf{W} \sim \text{Random}(-\delta,\delta),
\qquad
\mathbf{W}_{\text{guess}} = \mathbf{W}_{\text{out}} + \Delta \mathbf{W}.
\]
Fourth, TRF is re-run from the perturbed guess. Fifth, the best solution among trials is retained.

The stated purpose of this perturbation loop is to reduce sensitivity to local minima and improve robustness on difficult nonlinear PDEs. A plausible implication is that the nonlinear PIBLS variant remains optimization-based, but in a lower-dimensional and more structured form than gradient-based training of all hidden and output parameters.

## 5. Universal approximation in Sobolev spaces

PIBLS is accompanied by a universal approximation theorem in Sobolev spaces. The assumptions are explicit: \(\phi(\cdot)\) and \(\xi(\cdot)\) are non-constant, bounded, and \(C^\infty\); and all feature and enhancement parameters are i.i.d. sampled from continuous distributions with compact or bounded support. The target function satisfies
\[
u^\ast \in H^s(\Omega), \qquad s\in\{1,2\},
\]
where \(\Omega\subset\mathbb{R}^D\) is compact with Lipschitz boundary and
\[
\|u\|_{H^s(\Omega)}
=
\left(
\sum_{|\alpha|\le s}\|\partial^\alpha u\|_{L^2(\Omega)}^2
\right)^{1/2}.
\]

The theorem states that for any compact domain with Lipschitz boundary \(\Omega \subset \mathbb{R}^D\) and any continuous function \(u^\ast \in H^s(\Omega)\), \(s\in\{1,2\}\), there exists a sequence of PIBLS approximants \(\{\hat{u}_{n,m}\}_{n,m\in\mathbb{N}}\) such that
\[
\lim_{n,m\to\infty}\|u^\ast-\hat{u}_{n,m}\|_{H^s(\Omega)} = 0.
\]
Equivalently, for any \(\epsilon>0\),
\[
\|u^\ast - \hat{u}_{n,m}\|_{H^s(\Omega)} < \epsilon
\]
for sufficiently large \(n\) and \(m\) [2606.19754].

The proof proceeds in two stages. In the first, the random feature map \(z(\boldsymbol{x})\) is shown, for sufficiently large \(n\), to be almost surely a smooth embedding, described as a diffeomorphism onto its image. Immersion is established through full-rank Jacobian arguments using
\[
G_n(\boldsymbol{x}) = J_z(\boldsymbol{x})^\top J_z(\boldsymbol{x})
= \sum_{i=1}^{nk} \bigl[\phi'(\boldsymbol{x}\mathbf{w}_{e_i}+\beta_{e_i})\bigr]^2 \mathbf{w}_{e_i}\mathbf{w}_{e_i}^\top,
\]
and injectivity is analyzed via the kernel
\[
K(\boldsymbol{x},\boldsymbol{y}) = \mathbb{E}[\phi(\boldsymbol{x}W+\beta)\phi(\boldsymbol{y}W+\beta)].
\]
In the second stage, the residual
\[
r_n(\boldsymbol{x}) = u^\ast(\boldsymbol{x}) - u^{\mathbf{Z}_n}(\boldsymbol{x})
\]
is approximated by a smooth function, pulled back through the feature-layer diffeomorphism, and then approximated using the enhancement layer. The argument uses equivalence of Sobolev norms under smooth coordinate changes:
\[
C_z^{-1}\|v\circ z\|_{H^s(\Omega)} \le \|v\|_{H^s(z(\Omega))} \le C_z\|v\circ z\|_{H^s(\Omega)}.
\]

The stated interpretation is that PIBLS is not only numerically effective but also theoretically expressive enough to approximate sufficiently smooth PDE solutions arbitrarily well, provided the number of feature and enhancement nodes grows.

## 6. Benchmarks, baselines, and reported performance

The reported evaluation covers 11 benchmark PDEs: 8 linear and 3 nonlinear. The tests include 1D, 2D, and time-dependent problems. The linear benchmarks TC-1 to TC-8 include advection, diffusion, advection-diffusion, 2D advection, two 2D Poisson problems, constant-coefficient wave/advection in space-time, and variable-coefficient wave/advection in space-time. The nonlinear benchmarks TC-9 to TC-11 are nonlinear Helmholtz, nonlinear spring oscillator, and viscous Burgers’ equation. Baselines are PINN #1, a parameter-matched shallow PINN trained with Adam for 5000 iterations; PINN #2, a deeper PINN with 10 layers and 50 nodes trained with Adam + L-BFGS; PIELM for linear cases; locELM for nonlinear cases; and FEM with high-resolution finite elements. Experiments ran in Python on an Intel Core i5-12600KF CPU with 32GB RAM in a WSL environment [2606.19754].

The reported metrics are max error, \(L_2\) error, and training time. For the linear cases, PIBLS attains the following \(L_2\) errors and times: TC-1, \(5.99\times10^{-16}\) in \(0.13\) s; TC-2, \(1.05\times10^{-15}\) in \(0.01\) s; TC-3, \(2.55\times10^{-16}\) in \(0.03\) s; TC-4, \(2.98\times10^{-13}\) in \(0.76\) s; TC-5, \(7.69\times10^{-15}\) in \(0.38\) s; TC-6, \(3.37\times10^{-15}\) in \(0.51\) s; TC-7, \(2.39\times10^{-13}\) in \(0.70\) s; and TC-8, \(4.71\times10^{-12}\) in \(0.24\) s. In the reported table, PIBLS is consistently many orders of magnitude more accurate than PINNs and usually better than PIELM and even FEM.

For the nonlinear cases, PIBLS reports TC-9 with \(L_2 = 4.69\times10^{-12}\) in \(6.76\) s, TC-10 with \(L_2 = 2.40\times10^{-16}\) in \(3.2\) s, and TC-11 with \(L_2 = 9.88\times10^{-11}\) in \(0.56\) s. The comparative description states that PINNs often fail badly on nonlinear problems, especially TC-9 and TC-11; locELM performs well, but PIBLS is often more accurate and sometimes much faster; and for TC-11, PIBLS is dramatically better than PINNs and about \(50\times\) faster than locELM.

The speed comparisons are also explicit: PINN #1 typically takes tens of seconds, PINN #2 takes hundreds to thousands of seconds, PIBLS typically takes fractions of a second, and the claimed speedup is 1 to 3 orders of magnitude faster than PINNs. The reported main empirical conclusion is that PIBLS attains machine-precision or near-machine-precision accuracy on many tests, sub-second to few-second solve times, and substantial advantages over gradient-trained PINNs.

## 7. Practical implications and stated limitations

The practical implications identified for scientific machine learning are fivefold. First, PIBLS offers fast PDE solving by replacing long training loops with direct least-squares computation, making it suitable for near-real-time simulation and design workflows. Second, it provides physics-informed mesh-free modeling, requiring no mesh generation and operating on scattered collocation points like PINNs. Third, it is presented as having better numerical stability than PINNs because it avoids backpropagation through a deep loss landscape and thereby avoids many optimization pathologies. Fourth, it has strong theoretical backing through the universal approximation proof in Sobolev spaces. Fifth, it shows excellent benchmark performance, especially on smooth linear problems and also on selected nonlinear PDEs with the enhanced solver [2606.19754].

The formulation also states that PIBLS is not a universal cure-all. Nonlinear PDEs are more sensitive, with performance depending on the initialization range \(R_m\), and nonlinear cases may require careful tuning and perturbation strategies. Random basis quality matters because the hidden parameters are fixed random draws, so representation quality depends on the random feature space, and too small or too large initialization can hurt nonlinear performance. Wide networks may increase cost: error saturates beyond some width while compute time keeps increasing, creating a trade-off between width and efficiency. PIBLS is also described as not fully adaptive like advanced PDE solvers because it still relies on collocation sampling and fixed random features; for complex geometries, discontinuities, or highly stiff problems, performance may be less predictable. Finally, the proof is asymptotic: universal approximation holds as \(n,m\to\infty\), but practical accuracy depends on finite-width choices.

Taken together, these points place PIBLS within the broader development of scientific machine learning as a physics-informed, broad, random-feature-based solver that reformulates PDE enforcement into a least-squares problem. Its defining characteristics are the replacement of deep backpropagation with a BLS basis plus direct linear or nonlinear least-squares solve, the reported ability to achieve machine-level accuracy on many benchmark PDEs, and a Sobolev-space universal approximation guarantee.

Source: https://www.emergentmind.com/topics/physics-informed-broad-learning-system-pibls