---
title: 'PINNSR-DA: Physics-Informed Sparse Regression'
url: https://www.emergentmind.com/topics/pinnsr-da
type: topic
---

# PINNSR-DA: Physics-Informed Sparse Regression

PINNSR-DA denotes a physics-informed neural-network paradigm in which data-driven reconstruction or equation discovery is constrained by governing physics and coupled to an additional mechanism such as sparse regression, data assimilation, dimensional analysis, adaptive sampling, or symbolic regression. In the most explicit usage, the term names a framework for discovering governing equations of sheared granular materials by combining physics-informed neural networks with sparse regression and machine learning-based dimensional analysis [2509.14518]. In related literature, the same label is used analogically for PINN-based sparse reconstruction via data assimilation in orbital mechanics, turbulence, and power-system dynamics, and for PINN workflows that refine collocation, augment inputs, or extract symbolic structure [2403.19736].

## 1. Terminology and scope

The literature summarized here does not use PINNSR-DA as a single fully standardized acronym. One source defines it explicitly as “physics-informed neural networks with sparse regression” combined with machine learning-based dimensional analysis for granular rheology discovery [2509.14518]. Other sources describe methods “akin to PINNSR-DA,” identify “a natural mapping” to the acronym, or present closely related PINN-based sparse reconstruction and data-assimilation workflows [2403.19736].

| Usage in the literature | Role of the method | Representative paper |
|---|---|---|
| Explicit PINNSR-DA | Physics-informed neural networks with sparse regression plus dimensional analysis for governing-law discovery | [2509.14518] |
| Akin to PINNSR-DA | State reconstruction via data assimilation with a learned anomalous acceleration in satellite SDA | [2403.19736] |
| PINN-based sparse reconstruction via DA | Mean-flow reconstruction from sparse measurements with RANS or RANS-SA constraints | [2306.01065] |
| Natural mapping to PINNSR-DA | Deep adaptive sampling for PINNs using KRnet to refine collocation | [2112.14038] |
| Related PINN extensions | Dimension augmentation and symbolic regression pipelines for accuracy or interpretability | [2210.13212], [2303.07009] |

A common denominator across these usages is the replacement of purely empirical fitting by a composite optimization in which a neural surrogate is trained jointly against measurements and physics. The unknown quantity may be a state trajectory, an anomalous forcing term, a coefficient vector in a sparse library, a turbulence correction, or a closed-form symbolic expression. This suggests that PINNSR-DA is best understood as a family resemblance term rather than a single canonical algorithm.

## 2. Recurrent methodological structure

Across the cited works, the core object is a neural approximation of a latent field or trajectory. In satellite estimation, the state is $\mathbf{x}(t)=[\mathbf{r}(t),\mathbf{v}(t)]$ and the acceleration is decomposed into known physics plus a learned anomalous term, $\mathbf{a}(t)=f(\mathbf{x},t)+g_\theta(t,\mathbf{x})$ [2403.19736]. In power-system identification, the network approximates bus-angle trajectories $\mathbf{u}(t)\approx\{\delta_k(t)\}_k$, with automatic differentiation supplying $\dot{\mathbf{u}}(t)$ and $\ddot{\mathbf{u}}(t)$ to enforce the multi-machine swing equations [2004.04026]. In turbulent-flow reconstruction, the outputs include mean velocity, pressure-related variables, corrective forcing, and, in the SA-augmented case, the working variable $\tilde{\nu}$ [2306.01065]. In granular rheology discovery, the network represents latent responses $\tau(t)$ and $\gamma(t)$ while sparse regression identifies an active ODE structure [2509.14518].

The loss is likewise composite. Satellite SR-DA blends observation misfit, an optional physics residual, and regularization on the learned anomalous acceleration, although the reported implementation minimizes the observation term while enforcing dynamics implicitly through a Neural ODE [2403.19736]. Power-system PINNs minimize $\mathcal{L}_z+\mathcal{L}_c$, where $\mathcal{L}_z$ is the angle/frequency data loss and $\mathcal{L}_c$ is the collocation loss from the swing-equation residual [2004.04026]. Granular PINNSR uses
$$
\mathcal{L}(\boldsymbol{\theta},\boldsymbol{\Lambda};\mathcal{D}_m,\mathcal{D}_c)
=
\mathcal{L}_D(\boldsymbol{\theta};\mathcal{D}_m)
+\lambda\,\mathcal{L}_P(\boldsymbol{\theta},\boldsymbol{\Lambda};\mathcal{D}_c)
+\xi\,\|\boldsymbol{\Lambda}\|_0,
$$
with $\mathcal{L}_D$ a measurement loss, $\mathcal{L}_P$ a physics-residual loss, and $\|\boldsymbol{\Lambda}\|_0$ the sparsity prior on the candidate library coefficients [2509.14518]. In turbulent PINN-DA-SA, the objective combines data, strong-form RANS residuals, the SA transport residual, boundary conditions, and an $L_2$ penalty on the solenoidal corrective forcing [2306.01065].

A second recurring feature is differentiability of the physical solver. The satellite method uses TorchDiffEq so that automatic differentiation propagates through the ODE solver to neural parameters and, when fitted, initial conditions [2403.19736]. The power-system and turbulence formulations compute strong-form residuals directly by automatic differentiation [2004.04026], [2306.01065]. This differentiable-physics coupling is the mechanism that distinguishes these workflows from purely black-box sequence models or standard regression pipelines.

## 3. Explicit PINNSR-DA in granular rheology

In its explicit formulation, PINNSR-DA is a framework for discovering physically interpretable, dimensionally consistent governing equations for sheared granular materials in steady and transient states [2509.14518]. The physical setting is three-dimensional discrete element method simulation of wall-confined oscillatory shear on dry, polydisperse granular assemblies, with periodicity in $x$ and $y$, variable height $H=10$–$30\,d_p$, rough top and bottom plates, disabled gravity, Hertz–Mindlin contacts, and a constant overburden pressure $P$ applied at the top wall. Two loading protocols are used: sinusoidal shear and Heaviside rate reversal. The inertial number is kept in the quasi-static regime,
$$
I=\frac{\dot{\gamma}\,d_p}{\sqrt{P/\rho}}\le 10^{-3},
$$
and the effective friction is defined by $\mu=\tau/P$.

The methodology has two stages. First, PINNSR discovers a parsimonious ODE for stress evolution from noisy DEM signals. The starting hypothesis is
$$
\dot{\tau}(t)=\boldsymbol{\Phi}(t)\,\boldsymbol{\Lambda},
$$
where $\boldsymbol{\Phi}$ is a library of 23 candidate terms built from $\{\tau,\gamma\}$, their time derivatives, and products such as $\tau$, $\gamma$, $\dot{\gamma}$, $\ddot{\gamma}$, $\tau\gamma$, $\tau\dot{\gamma}$, and $\tau^2\dot{\gamma}$ [2509.14518]. The DNN has 6 hidden layers with 20 tanh neurons per layer, takes as input $t$ and the identifier $\dot{\gamma}_0$, and outputs $\tau$ and $\gamma$. Collocation density is set to $N_c=\vartheta N_m$ with $\vartheta=50$. Optimization uses pretraining with L-BFGS on an $\ell_1$-relaxed objective, followed by alternating direction optimization: STRidge thresholding for $\boldsymbol{\Lambda}$ and Adam updates for $\boldsymbol{\theta}$. Residual-based adaptive collocation with KDE concentrates points where $|\mathcal{R}|$ is large, particularly near reversals.

Second, machine learning-based dimensional analysis learns dimensionless coefficient laws. For each active coefficient $C_i$, the method assumes a dominant dimensionless number
$$
\Pi_i=P^{w_{i1}} d_p^{w_{i2}} \rho^{w_{i3}} E_p^{w_{i4}} T^{w_{i5}} H^{w_{i6}},
$$
subject to $\boldsymbol{D}\boldsymbol{w}_i=\mathbf{0}$, where $\boldsymbol{D}$ is the stated $3\times 6$ dimension matrix for the ordered variables $\{P,d_p,\rho,E_p,T,H\}$ [2509.14518]. A two-level learning alternates between grid search over the null-space coefficients $\boldsymbol{\gamma}_i$ and polynomial fitting of $f_i(\Pi_i)$, selecting the best dimensionless group by test-set $R^2$.

Across sinusoidal and Heaviside cases, the framework repeatedly identifies the same three-term evolution law for the effective friction:
$$
\frac{d\mu}{dt}
=
C_1\,\frac{d\gamma}{dt}
+
C_2\,\mu\,\Big|\frac{d\gamma}{dt}\Big|
+
C_3\,\mu^2\,\frac{d\gamma}{dt}.
$$
For the representative configuration $P=10\,\mathrm{kPa}$, $H=15\,d_p$, $T=10\,\mathrm{s}$, $\rho=2500\,\mathrm{kg\,m^{-3}}$, $d_p=5\,\mathrm{mm}$, and $E_p=5\times10^7\,\mathrm{Pa}$, the coefficients are $C_1=-5.98$, $C_2=-28.05$, and $C_3=-32.41$ [2509.14518].

| Term | Interpretation in the source | Mathematical form |
|---|---|---|
| Linear response | Direct, rate-driven change of friction from applied shear | $C_1\,d\gamma/dt$ |
| Energy dissipation | Coupling of friction state to shear-rate intensity | $C_2\,\mu\,|d\gamma/dt|$ |
| Nonlinear response | Self-driven evolution of friction | $C_3\,\mu^2\,d\gamma/dt$ |

Dimensional analysis yields the dominant groups
$$
\Pi_1=\frac{H}{d_p}\,\frac{E_p}{P},
\qquad
\Pi_2=\Pi_3=\sqrt{\frac{H}{d_p}\,\frac{E_p}{P}},
$$
and, with $\chi=(H/d_p)(E_p/P)$, the coefficient laws are simplified to
$$
\frac{d\mu}{dt}
=
f_1(\chi)\,\frac{d\gamma}{dt}
+
f_2(\chi)\,\mu\,\Big|\frac{d\gamma}{dt}\Big|
+
f_3(\chi)\,\mu^2\,\frac{d\gamma}{dt},
$$
with
$$
f_i(\chi)=a_i\log_{10}(\chi)+b_i,
$$
where $(a_1,b_1)=(-1.98,3.87)$, $(a_2,b_2)=(-15.01,45.65)$, and $(a_3,b_3)=(-26.31,96.22)$. The reported test-set coefficients of determination are $R^2\approx 0.977$, $0.984$, and $0.976$ for $C_1$, $C_2$, and $C_3$ [2509.14518]. Steady-state reduction gives a configuration-insensitive static friction, with global fit $\mu_s^{\mathrm{global}}\approx 0.3664$, and the transient relaxation time obeys
$$
\hat{t}=\frac{a_0}{\log_{10}(\chi)-b_0},
\qquad
a_0=0.167,\; b_0=2.065.
$$

The paper further supplies a microstructural interpretation through the fabric tensor $\mathbf{A}$. Since $\mu$ is approximately linear in the dominant component $A_{xz}$, the discovered friction law matches the reduced fabric-evolution structure, linking the three ODE terms to shear-induced anisotropy, dissipative stabilization, and nonlinear modulation via fabric anisotropy [2509.14518].

## 4. Data-assimilation and state-reconstruction instantiations

A closely related use of the PINNSR-DA idea appears in satellite state estimation for Space Domain Awareness. The task is to reconstruct an orbital state and a time-varying, low-thrust acceleration profile from SSN-like angles-only observations, specifically right ascension and declination from a single optical ground telescope [2403.19736]. The state dynamics are written as
$$
\mathbf{a}(t)
=
-\mu\frac{\mathbf{r}(t)}{\|\mathbf{r}(t)\|^3}
+
\mathbf{a}_{\text{pert}}(\mathbf{r},\mathbf{v},t)
+
\mathbf{a}_{\text{anom}}(t,\mathbf{x}),
$$
with the learned anomalous term represented by a compact MLP. The reported implementation uses a simple MLP with two hidden layers of width 100, tanh activations, and output dimension 3. Training uses a 2-day fit window with 30 angles-only measurements, Gaussian measurement noise $\sigma=0.5$ arcsec per component, Adam with initial learning rate $0.003$, step-wise decay every 100 epochs by a factor of $0.98$, and total 20,000 epochs. Initial conditions are updated every $N=100$ training iterations by a batch least-squares fit. For a GEO simulation with unmodeled acceleration on the order of $10^{-8}\,\mathrm{km/s}^2$, the PINN-coupled model reduces observation RMSE from $\approx 123$ arcsec to $\approx 1.00$ arcsec and 5-day position error from $\approx 3860$ km to $\approx 164$ km; the corresponding 5-day velocity error improves from $\approx 285$ m/s to $\approx 12.3$ m/s [2403.19736].

In power-system dynamics, PINNs are used for nonlinear system identification and dynamic assessment from PMU-like data. The formulation embeds the multi-machine swing equations,
$$
m_k\ddot{\delta}_k+d_k\dot{\delta}_k+\sum_j a_{kj}\sin(\delta_k-\delta_j)-P_k=0,
$$
within a collocation loss, while the network approximates bus-angle trajectories and automatic differentiation yields frequency and acceleration [2004.04026]. The architecture uses $N_L=2$ hidden layers with 30 neurons per layer, tanh activation, identity output, measurement sampling every $0.01$ s over $[0,2]$ s, and 20 collocation points per measurement. In the 4-bus test system, PINN achieves relative errors below 1% for System A and some parameters in System B, remains reasonably accurate in low-inertia fast dynamics where UKF struggles, and is robust to Gaussian or uniform noise up to 5%, although System C exhibits slow convergence due to a flat optimization landscape [2004.04026].

For turbulent mean-flow reconstruction, a direct PINN-based sparse reconstruction via data assimilation is presented through PINN-DA-Baseline and PINN-DA-SA. The method combines sparse mean-velocity measurements from DNS of the turbulent periodic hill at $Re=5600$ with steady incompressible RANS constraints, and in the augmented version additionally enforces the Spalart–Allmaras one-equation model [2306.01065]. The baseline treats Reynolds-stress divergence through a Helmholtz decomposition, whereas PINN-DA-SA splits the Reynolds forcing into an eddy-viscosity contribution plus corrective potential and solenoidal components. The network is a 7-layer MLP with 50 nodes per layer, tanh activation, 10,000 interior collocation points, and 1,000 boundary points; training proceeds with ADAM for 150,000 iterations and then L-BFGS-B for up to 300,000 iterations. At measurement spacing $\Delta L=0.5$, PINN-DA-Baseline reduces the $L_2$ mean-velocity error from $8.99\times10^{-2}$ for RANS-SA to $3.60\times10^{-2}$, and PINN-DA-SA further reduces it by 63% to $1.35\times10^{-2}$. The reported maximum improvement over the baseline is up to 73% reduction in mean velocity reconstruction error with coarse measurements. PINN-DA-SA also achieves lower reconstruction error than variational-DA-SA across most data resolutions, except at the coarsest grid $\Delta L=1.0$ [2306.01065].

These instantiations share the same operational goal: assimilation of sparse observations into differentiable physics while inferring hidden forcing, coefficients, or state variables. The specific unknown differs—orbital thrust, generator inertia and damping, or turbulent forcing—but the mathematical pattern is the same.

## 5. Sampling refinement and representation augmentation

One important branch of the PINNSR-DA idea concerns refinement of the training distribution rather than modification of the physical model. DAS-PINNs proposes a Deep Adaptive Sampling framework in which the PDE residual is treated as a probability density and approximated by a normalizing-flow model called KRnet [2112.14038]. The paper provides two variants: DAS-R, which replaces interior collocation points by samples drawn from the residual-induced density and uses importance weighting, and DAS-G, which augments the existing training set with new residual-driven samples. The residual-induced target density is
$$
p^*(x)\propto |R(x;\theta)|^\alpha,
$$
with $\alpha=2$ used explicitly. KRnet is trained by minimizing a cross-entropy approximation to $D_{\mathrm{KL}}(\tilde r_X\|\tilde p_\phi)$, and new points are sampled by inverse mapping from a simple latent prior. On low-regularity 2D elliptic problems and 10D linear and nonlinear PDEs, DAS-R and DAS-G substantially outperform uniform sampling and a heuristic residual-based refinement baseline. The paper states that the methods can significantly improve accuracy, especially for low regularity and high-dimensional problems, and proves monotone decrease of the expected residual loss under ideal density matching [2112.14038].

A second branch modifies the neural representation by augmenting the input dimension. DaPINN replaces the original coordinates by feature-augmented inputs such as power series terms, Fourier features, or replicas, and rewrites the residual through chain-rule-consistent derivatives in the augmented coordinates [2210.13212]. The network architecture remains fully connected, with tanh activation and Adam at learning rate $0.001$, but the input may change from $(x,t)$ to vectors such as $(x,x^2,t)$, $(x,x^2,x^3,t)$, or $(x,\sin x,\cos x,t)$. Across forward and inverse benchmarks, the paper reports that the error of DaPINN is 1–2 orders of magnitude lower than that of PINN in most experiments. Representative numbers include a diffusion-reaction case where, with 65 points, standard PINN has $103\%$ relative error while DaPINNs are near $1\%$, and a Burgers benchmark where third-order power-series augmentation yields errors one order of magnitude lower than PINN in steep regions [2210.13212].

These works are not identical to the granular PINNSR-DA formulation. Rather, they show that the “SR-DA” component can also be interpreted as sampling refinement or dimension augmentation, provided the goal remains physics-constrained reconstruction from limited or difficult data.

## 6. Sparse regression and symbolic interpretability

Interpretability is a central motive in the explicit PINNSR-DA formulation and in adjacent symbolic-regression pipelines. In the granular study, sparse regression acts directly on a hand-built candidate library and yields a three-term governing equation whose coefficients are later organized by dimensional analysis [2509.14518]. This is equation discovery in the strict sense: the neural network is used to denoise and differentiate, but the final output is a compact ODE.

A different route to interpretability is provided by symbolic regression for PDE solutions using pruned differentiable programs. The workflow first trains a PINN to solve the target PDE, then generates a dense supervised dataset from the trained surrogate, then fits a Differentiable Program Architecture constrained by a context-free grammar, and finally prunes the resulting symbolic program in a depth-first manner [2303.07009]. The grammar includes unary operators $\sin$, $\exp$, $\log$, $\mathrm{pow2}$, $\mathrm{pow3}$, binary operators $\mathrm{Add}$ and $\mathrm{Multiply}$, variables such as $x$, $y$, and $t$, and constants. Each output field has its own DPA instance. Across diffusion, Kovasznay flow, Taylor–Green vortex, diffusion–reaction, and an industrial air-preheater case, pruning reduces DPA parameters by an average of 95.3% and improves accuracy by an average of 7.81% relative to the unpruned DPA, while maintaining accuracy at par with PINNs [2303.07009].

This suggests two distinct but compatible meanings of sparsity within the PINNSR-DA landscape. In one meaning, sparsity refers to selection of active terms in a governing equation, as in STRidge-based discovery for granular rheology. In the other, it refers to pruning a symbolic representation of a learned solution or latent operator. Both approaches turn a differentiable neural surrogate into a more explicit mathematical object.

## 7. Limitations, assumptions, and extensions

The cited works identify several recurrent limitations. In satellite SR-DA, omitted perturbations in the known physics model can be absorbed by the learned anomalous acceleration, which blurs physical interpretation unless priors or constraints are imposed; angles-only geometry also induces degeneracies, and sparse or noisy data enlarge the admissible solution manifold [2403.19736]. In power-system identification, slow dynamics and poor excitation create flat objective surfaces that hinder identifiability and slow convergence, and computational cost remains higher than UKF despite good performance in low-inertia fast dynamics [2004.04026]. In turbulence reconstruction, the baseline RANS formulation is underdetermined away from measurements, SA augmentation inherits the limitations of a linear eddy-viscosity closure, and at the coarsest data resolution the variational method can be more robust than the PINN [2306.01065].

Method-specific caveats also matter. DAS-PINNs adds the cost of training a generative model and can suffer if the learned sampling density becomes too concentrated [2112.14038]. DaPINN depends on appropriate feature choice: mismatched augmentations can concentrate error rather than reduce it [2210.13212]. The granular PINNSR-DA framework depends on a sufficiently rich candidate library, requires multiple datasets across parameter ranges for the dimensional-learning stage, and incurs higher computational cost than classical SINDy [2509.14518]. The differentiable-program symbolic-regression pipeline relies on a greedy pruning rule and a fixed grammar that may be suboptimal for some PDEs [2303.07009].

The extension paths reported in the literature are correspondingly diverse. Satellite SR-DA proposes multi-satellite joint estimation, maneuver detection and segmentation, multi-sensor fusion, hybrid filters, and uncertainty quantification [2403.19736]. The turbulence paper highlights multi-equation closures, uncertainty quantification, multi-fidelity assimilation, hybrid PINN-plus-discretization strategies, and domain decomposition for 3D scaling [2306.01065]. The granular framework is proposed as extensible to jamming, segregation, and fluid–particle interactions [2509.14518]. A plausible implication is that PINNSR-DA is not a single endpoint method but a modular design pattern: physics-informed learning supplies differentiable structure, while sparse regression, dimensional analysis, adaptive sampling, feature augmentation, or symbolic post-processing determine whether the final product is a reconstructed state, a learned forcing, or a compact governing law.

Source: https://www.emergentmind.com/topics/pinnsr-da