---
title: Fractional Physics-Informed Neural Networks
url: https://www.emergentmind.com/topics/fractional-physics-informed-neural-networks-fpinns
type: topic
---

# Fractional Physics-Informed Neural Networks

Fractional Physics-Informed Neural Networks (fPINNs) generalize the physics-informed neural network (PINN) framework to incorporate fractional calculus, enabling the data-driven solution and parameter inference for fractional differential equations (FDEs) that encode nonlocality and memory effects in physical, biological, and engineering systems. fPINNs extend classical PINNs by embedding discretized or otherwise efficiently computable fractional operators—typically the Caputo or Riesz/Laplacian types—directly into the loss functional, ensuring that neural network predictions satisfy FDE constraints even in high-dimensional, data-limited, and ill-posed or inverse settings.

## 1. Mathematical Foundations: Fractional Operators and Their Discretization

Fractional derivatives model phenomena with anomalous transport, nonlocality, or temporal memory, necessitating noninteger-order differentiation operators in both time and space. The Caputo time-fractional derivative of order $0 < \alpha < 1$,
\[
{}^C D_t^\alpha u(t) = \frac{1}{\Gamma(1-\alpha)} \int_0^t (t-\tau)^{-\alpha} u'(\tau)\,d\tau,
\]
and the Riesz fractional Laplacian (space-fractional derivative) in $\mathbb{R}^d$,
\[
(-\Delta)^{\alpha/2} u(x) = C_{d,\alpha}\;\mathrm{P.V.}\int_{\mathbb{R}^d} \frac{u(x) - u(y)}{\|x-y\|^{d+\alpha}}\,dy,
\]
define the two principal nonlocal operators in fPINN frameworks [1811.08967][2203.08501]. Accurate neural imposition of these constraints requires discretizations tailored to each operator:
- Caputo time-fractional derivatives are approximated via L1-type finite difference quadratures, e.g., 
  \[
  D_t^\alpha u^n \approx \frac{1}{\Delta t^\alpha \Gamma(2-\alpha)}\sum_{j=0}^{n-1} b_j(u_{n-j} - u_{n-j-1}),
  \]
  with $b_j = (j+1)^{1-\alpha} - j^{1-\alpha}$ [2407.09496][2509.22760].
- Riesz/Laplacian operators employ either shifted Grünwald-Letnikov (GL) differences, Monte Carlo integral estimators, or pseudo-differential (Fourier) representations [1811.08967][2203.08501][2602.14663].

Alternative approaches include conformable derivatives with local structure [2108.07490], or operational-matrix discretizations for efficient matrix-vector evaluation in temporally nonuniform or delay/fractional DAE systems [2401.14081].

## 2. fPINN Architectures, Loss Functionals, and Training Procedures

In fPINNs, the physical field $u(x,t)$ is parameterized via a neural network $u_{NN}(x,t;\theta)$, with architecture choices ranging from standard fully connected MLPs to spectral or Legendre Neural Block (LNB) enhancements [2401.14081]:
- Inputs: physical coordinates and/or time
- Hidden layers: smooth activations (tanh, swish, sine) preferred due to better approximation of nonlocal functional regularity
- Output: scalar (field value) or vector (multistate models) predictions

The composite loss functional is constructed as
\[
\mathcal{L}(\theta) = \mathcal{L}_{\text{PDE}} + \mathcal{L}_{\text{IC/BC}} + \mathcal{L}_{\text{data}},
\]
where
- $\mathcal{L}_{\text{PDE}}$ penalizes residuals of the FDE at collocation points, where fractional derivatives are evaluated by discretization or stochastic/quadrature approximations,
- $\mathcal{L}_{\text{IC/BC}}$ enforces initial/boundary conditions, often via hard constraints or penalty terms,
- $\mathcal{L}_{\text{data}}$ (if present) fits empirical observations for state and/or parameters.

For inverse problems or parameter discovery, the fractional orders ($\alpha$, $\gamma$) and physical coefficients are embedded as trainable scalars, with constraints (e.g., positivity via softplus, fractional order in $(0,1]$ via sigmoid reparameterization) ensuring physical meaning [2509.22760][2409.12998][2407.09496].

Common optimizers are Adam or L-BFGS, with staged or hybrid schedules to mitigate local minima and balance data-fidelity versus PDE residuals.

## 3. Computational Strategies for Nonlocal Fractional Operators

Computation of nonlocal operators in high dimensions presents the principal challenge for fPINNs, addressed by a range of strategies:
- **Finite Difference Quadratures** are suitable for low-dimensional or regular-grid settings, but require multiple (history/auxiliary) points, elevating computational and memory demands [1811.08967][2401.14081].
- **Monte Carlo Estimation (MC-fPINN):** Mesh-free unbiased estimators of the Riesz Laplacian (and Caputo derivatives) are constructed by splitting integrals and drawing i.i.d. samples of direction, radius, and time [2203.08501][2407.03801][2406.11708]. Computational scaling is $O(m)$ per collocation point, independent of spatial dimension $d$, enabling problems in $d\sim 10^5$ dimensions [2406.11708]. However, high variance necessitates large sample sizes or variance-reduction techniques.
- **Quadrature-Enhanced MC-fPINN:** Recent improvements replace the radial/time MC integrals with deterministic (e.g., Gauss–Jacobi, Gauss–Laguerre) quadrature, lowering estimator variance, eliminating delicate radius cutoffs and improving convergence rate and speed [2406.11708][2506.11518].
- **Fourier/Pseudo-Differential Enhancement:** For periodic or regular domains, fPINN losses are augmented with residuals in the Fourier domain, leveraging the diagonalization of the fractional operators and improving learning of high-frequency modes [2602.14663]. Monte Carlo Fourier approximations allow mesh-agnostic implementation.

These advances collectively address the curse of dimensionality, a critical bottleneck in traditional mesh-based FDE solvers [2406.11708][2407.03801][2203.08501][2401.14081].

## 4. Specialized fPINN Extensions and Domain-Specific Adaptations

Recent work has developed domain-specific fPINN variants and workflows:
- **Score-fPINN:** For high-dimensional Fokker-Planck-Lévy equations, the introduction of a fractional score function enables transformation to a second-order PDE system without explicit fractional Laplacian, facilitating mesh-free high-$d$ PINN training. Both fractional score matching (when conditional densities are known) and PINN-based score estimation (when not) are supported [2406.11676].
- **Stochastic Fractional PDEs (BO-fPINN):** Integration of the bi-orthogonal expansion with PINN learning provides a robust mechanism for representing randomness in SPDEs with fractional operators, handling eigenvalue crossings and inverse settings efficiently [2303.10913].
- **Transformed fPINNs for Diffusion-Wave Equations:** Integration-by-parts transformations of the Caputo derivative enable efficient training for time-fractional diffusion-wave PDEs with $\alpha\in(1,2)$, reducing the computational cost of fractional derivative evaluation [2506.11518].
- **Adaptive/Multiprecision/Mesh Strategies:** Alikhanov-XfPINNs combine high-order temporal discretization, nonuniform meshes, and adaptive activations to resolve initial singularities and audit temporal discretization error in nonlinear fPDEs [2605.01305]; multiprecision and multistage training counteract the numerical loss-of-significance and optimization plateaus of deep fractional residuals [2505.22377].
- **Laplace-fPINNs:** Formulation in the Laplace-transformed domain enables the solution of subdiffusion problems in high dimensions, avoiding direct time discretization and employing only integer-derivative AD [2304.00909].

## 5. Inverse Problems, Parameter Estimation, and Uncertainty Quantification

fPINNs seamlessly integrate inverse solvers and parameter estimation, including fractional orders, transport/diffusion rates, source terms, kinetic parameters, and even functional dependencies:
- The fractional order ($\alpha$ or $\gamma$) is treated as a differentiable, trainable parameter, often with bounded support via nonlinear parametrization [2509.22760][2407.09496][2409.12998].
- Compartmental pharmacokinetics, viscoelasticity, and epidemiology are modeled by embedding the respective FDE system, with fPINNs jointly learning the governing rates and memory effects from (possibly noisy, sparse) time-series data [2409.12998][2407.09496][2509.22760].
- Inverse source problems utilize dual networks for state and source, with MC-based fractional derivative evaluation and provable error bounds in high dimension [2407.03801].
- Uncertainty quantification is addressed either via stochastic expansions (BO-fPINN) or parameter-space extensions [2303.10913][2203.08501].

Robustness under noise and misspecification is consistently observed, with parameter errors typically below 1–2% in benchmark cases, and networks outperforming classical two-step or optimization-based procedures for joint recovery [2407.09496][2409.12998].

## 6. Performance Scaling, Numerical Results, and Best Practices

Numerical evidence across multiple studies demonstrates the scalability and versatility of fPINNs:
- MC-fPINN and quadrature-enhanced variants have been validated on Poisson/tempered fractional diffusion problems up to 100,000 dimensions, showing relative $L^2$ errors of $\sim 10^{-2}$–$10^{-1}$ and only sublinear slow-down with increasing dimension [2406.11708].
- For 1D–3D FDEs, standard fPINN schemes deliver relative errors of $10^{-4}$–$10^{-2}$, with multistage, multiprecision, and adaptive activation yielding improvements to $10^{-7}$–$10^{-8}$ [2505.22377][2605.01305].
- Special architectures (pseudo-differential enhancement, LNB) accelerate convergence, mitigate spectral bias, and aid in learning high-frequency solution components [2602.14663][2401.14081].
- Weighted PINN losses and data scaling improve fitting near singularities, and adaptive collocation or residual-based point redistribution enhance convergence for complex dynamics [2108.07490][2506.11518].
- For stochastic or inverse settings, fPINN-based uncertainty quantification and transfer learning deliver efficiency and robustness across varying FDE parameters [2303.10913].

## 7. Limitations, Open Problems, and Future Directions

Despite their generality and mesh-free capacity, fPINNs face several challenges:
- Computational burden for large auxiliary/history points in classical (non-MC) fPINNs in high $d$.
- Variance of MC estimators in high-dimension/low-collocation regimes, necessitating advanced variance-reduction, adaptive quadrature, or hybrid techniques [2203.08501][2406.11708].
- Stability and convergence guarantees are largely empirical; theoretical underpinnings for generalization, error decomposition (approximation vs. statistical), and efficiency remain active research areas [2407.03801].
- Scalability of architectures in $d\gg 100$ and for complex coupled multiphysics FDEs; further integration with operator-learning, graph-based, or domain-specific network designs may enhance representation capacity.
- Ill-posedness in inverse or data-driven FDEs, especially with non-Gaussian noise or sparse observation, may require explicit regularization, advanced uncertainty quantification, and physically informed priors.

A plausible implication is that future developments will combine mesh-free fractional operator evaluation, operator learning frameworks, and scalable uncertainty-quantified inference, positioning fPINNs as a central tool in scientific machine learning for nonlocal dynamical systems.

Source: https://www.emergentmind.com/topics/fractional-physics-informed-neural-networks-fpinns