---
title: Fractal Neural Operator (FNO)
url: https://www.emergentmind.com/topics/fractal-neural-operator-fno
type: topic
---

# Fractal Neural Operator (FNO)

to=arxiv_search 下载彩神争霸 ＿影音先锋  天天中彩票谁_code: true code:
{"query":"\"Fractal Neural Operator\" chaotic attractors prime-harmonic Weierstrass encodings", "max_results": 5, "sort_by":"submittedDate"}
to=arxiv_search  北京赛车投注  天天爱彩票怎么_code: true code:
{"query":"\"spectral bias\" chaotic attractors neural operators Lorenz-63", "max_results": 10, "sort_by":"relevance"}
The **Fractal Neural Operator (FNO)** is a neural architecture proposed for forecasting chaotic dynamical systems by lifting system states into a high-dimensional embedding constructed from **prime-harmonic Weierstrass features**, evolving that representation with a recurrent latent dynamics model, and projecting back to state space. In the formulation introduced in 2026, the acronym **FNO** explicitly denotes **Fractal Neural Operator**, not the more established **Fourier Neural Operator** usage found elsewhere in the neural-operator literature. The method is motivated by the claim that standard neural networks, transformers, and neural operators exhibit **spectral bias**, behaving as low-pass filters that smooth high-frequency structure; the paper argues that this is especially damaging for strange attractors, whose geometry is described as fractal and whose dynamics depend on preserving fine-scale structure over long horizons [2606.23123].

## 1. Terminology and scope

In much of the neural-operator literature, **FNO** refers to the **Fourier Neural Operator**, a spectral operator-learning architecture for mappings between function spaces [2205.10573]. Comparative work on neural operators uses the same acronym in that Fourier sense and reports, for example, that FNO can be highly sensitive to noisy data in some realistic settings [2111.05512]. The **Fractal Neural Operator** adopts the same acronym but assigns it a different meaning, and the distinction is substantive rather than nominal [2606.23123].

The Fractal Neural Operator is not a standard Fourier Neural Operator. The proposed architecture does **not** describe FFT-based spectral convolution, does **not** use Fourier integral operators as its core update, and is aimed at **low-dimensional chaotic attractor forecasting** rather than conventional PDE operator learning on discretized fields. Its principal benchmark is **Lorenz-63**, and its central mechanism is a **Prime-Weierstrass Embedding** rather than a Fourier kernel [2606.23123].

The paper nevertheless frames the model in operator-learning terms. It treats the latent recurrent evolution as an operator $\mathcal{G}$, but the implementation is structurally closer to a recurrent forecaster with a specialized fractal lifting layer than to the original Fourier Neural Operator family [2606.23123].

## 2. Motivating problem: spectral bias and chaotic attractors

The paper’s conceptual starting point is **spectral bias**: standard neural models are said to preferentially fit low-frequency structure and thereby act as low-pass filters. In smooth PDE settings, this may be acceptable; in the paper’s framing, it is catastrophic for **chaotic dynamical systems**, because long-horizon prediction depends on preserving the fine-scale structure of trajectories evolving on **strange attractors** [2606.23123].

This argument is developed through a contrast between smooth or octave-spaced encodings and fractal geometry. Standard geometric frequency systems are described as using
$$
\lambda_k = 2^k,
$$
which the paper criticizes for leaving “spectral holes” between octaves and for introducing resonance through harmonic relations such as
$$
2 \times 2 = 4.
$$
The proposed remedy is an **aperiodic, non-resonant prime basis**
$$
2,3,5,7,\dots
$$
combined with a Weierstrass-inspired construction intended to inject “microscopic fractal roughness” into the latent representation [2606.23123].

The strongest interpretive claim is that “chaos” is not inherently unpredictable to neural models; rather, conventional architectures are said to fail because they impose overly smooth latent manifolds and resonant frequency structures. The Fractal Neural Operator therefore advocates a **non-differentiable, fractal-informed embedding manifold** as the appropriate inductive bias for chaotic attractors [2606.23123].

## 3. Mathematical formulation

The paper considers a continuous-time dynamical system
$$
\frac{d\mathbf{x}}{dt} = \mathcal{F}(\mathbf{x}), \qquad \mathbf{x}\in\mathbb{R}^d,
$$
with trajectories evolving on a compact manifold
$$
\mathcal{M} \subset \mathbb{R}^d
$$
of fractal dimension $D_f$. The Lorenz attractor is given as an example with
$$
D_f \approx 2.06.
$$
The trajectory is viewed as a continuous map
$$
f:\mathbb{R}\to \mathcal{M}.
$$

The mathematical template is the classical Weierstrass function,
$$
W(x) = \sum_{n=0}^{\infty} a^n \cos(b^n \pi x),
$$
used to motivate a continuous but nowhere differentiable construction. The paper’s central encoder is defined element-wise as
$$
\Psi(x)_j = x W_{in} + \sum_{k=1}^{K} \alpha_k \cos\!\big(p_k (x W_{in}) + \phi_{k,j}\big).
$$
Here, $p_k$ is the $k$-th prime number,
$$
p_k \in \{2,3,5,7,\dots\},
$$
$\alpha_k$ is a spectral amplitude initialized as
$$
\alpha_k \propto k^{-1/2},
$$
$\phi_{k,j} \sim \mathcal{U}(-\pi,\pi)$ is a learnable phase shift, and $W_{in}$ is a learnable linear projection. The paper refers to this construction as both the **Prime-Weierstrass Embedding** and the **Harmonic Weierstrass Encoder** [2606.23123].

The prime basis is justified heuristically through pairwise coprimeness,
$$
\gcd(p_i,p_j)=1 \qquad (i\neq j),
$$
and through the associated **primorial**
$$
P_K = \prod_{k=1}^{K} p_k.
$$
For $K=16$, the paper states that
$$
P_K > 3\times 10^{17},
$$
which is used to argue that false periodic repetition will not arise on practical observation windows. The paper further asserts that the prime basis provides “dense spectral coverage,” prevents “spectral leakage,” maintains fidelity up to the Nyquist limit, and yields “infinite spectral resolution.” It does not, however, provide formal proofs of completeness, density, frame conditions, or spectral approximation guarantees, so these statements are best understood as motivated heuristics rather than theorems [2606.23123].

## 4. Architectural pipeline and operator interpretation

The Fractal Neural Operator is organized as a three-stage pipeline: **lifting**, **evolution**, and **projection**. At time $t$, the system state is
$$
\mathbf{x}_t \in \mathbb{R}^d,
$$
with $d=3$ for Lorenz-63. The encoder lifts the state into a higher-dimensional latent representation,
$$
\mathbf{z}_t = \Psi(\mathbf{x}_t),
$$
where $\Psi$ is the prime-harmonic encoder described above. The paper names this component the **$P$-Encoder** or **Prime-Weierstrass block** [2606.23123].

Latent evolution is performed by a **GRU**, interpreted as a discretized evolution operator $\mathcal{G}$:
$$
\mathbf{h}_t = \mathcal{G}(\mathbf{z}_t,\mathbf{h}_{t-1}).
$$
The GRU is said to be chosen over a transformer in order to enforce **strict causality** and **continuous-time consistency**. The decoder then projects back to physical state space using an MLP:
$$
\hat{\mathbf{x}}_{t+1} = \mathrm{MLP}(\mathbf{h}_t).
$$
Inference is autoregressive: starting from an initial true state, the model predicts $\hat{\mathbf{x}}_{t+1}$, feeds that prediction back through the encoder and recurrent kernel, and continues until a divergence threshold is exceeded [2606.23123].

Only a limited set of implementation details is given. The paper implies a prime truncation level
$$
K=16,
$$
uses prime frequencies
$$
P=\{2,3,5,\dots\},
$$
and compares against a geometric baseline
$$
f=\{2^0,2^1,\dots,2^{15}\}.
$$
Amplitude initialization is
$$
\alpha_k \propto k^{-1/2},
$$
and phase initialization is
$$
\phi_{k,j}\sim \mathcal{U}(-\pi,\pi).
$$
By contrast, hidden width, number of GRU layers, MLP depth, optimizer, learning rate, batch size, weight decay, number of epochs, input normalization, exact loss formulation, and training horizon are not specified. The paper reports **MSE loss** in its results tables, but does not give an explicit equation for the training objective [2606.23123].

## 5. Lorenz-63 benchmark and reported results

The experimental benchmark is **Lorenz-63**, governed by
$$
\begin{cases}
\frac{dx}{dt} = \sigma(y-x) \\
\frac{dy}{dt} = x(\rho-z)-y \\
\frac{dz}{dt} = xy-\beta z
\end{cases}
$$
with standard chaotic parameters
$$
\sigma=10,\qquad \rho=28,\qquad \beta=\frac{8}{3}.
$$
Data are generated with **RK4** using
$$
\Delta t = 0.01,
$$
for a total of **25,000 steps**, which the paper states corresponds to “250 Lyapunov times.” The split is **60\% training** and **40\% testing**. Baselines are an **Identity operator** using raw coordinates into a GRU, a **Geometric operator** using standard positional encodings $2^k$, and **Random Fourier Features** using Gaussian random projections [2606.23123].

Two principal evaluation metrics are reported: **MSE loss** and **Lyapunov Horizon**, defined as the valid prediction horizon until prediction error exceeds a divergence threshold. The exact formula for the divergence criterion is not specified. Monte Carlo evaluation uses
$$
N=100
$$
random initial conditions [2606.23123].

| Method | MSE Loss | Lyapunov Horizon |
|---|---:|---:|
| Identity (Raw) | $4.2\times 10^{-4}$ | $112 \pm 45$ |
| Geometric Baseline ($2^k$) | $1.5\times 10^{-5}$ | $286.8 \pm 119.6$ |
| Prime-Weierstrass | $0.7\times 10^{-5}$ | $347 \pm 103$ |

The paper identifies the Prime-Weierstrass model as achieving the best reported horizon, a **7.6\% extension** over the geometric baseline, and interprets the lower spread
$$
102.7 < 119.6
$$
as a **14\%** variance reduction and improved long-horizon stability. It also reports an ablation in which fixed prime frequencies outperform **Random Fourier** ($215$), **Geometric** ($286$), and **Trainable Freqs** ($294$), with the prime configuration at $308$ over $N=20$ trials. The paper’s interpretation is that trainable frequencies tend to collapse into resonant relations such as
$$
f_2 \approx 2f_1,
$$
which can help short-term MSE while hurting long-term stability [2606.23123].

The abstract further states that the prediction horizon extends to **347 Lyapunov times**, exceeding state-of-the-art reservoir computing baselines by a factor of **2.3x**. However, the provided experimental section does not include a reservoir-computing results table. Likewise, the paper claims PSD analysis of residuals shows that the prime-Weierstrass model maintains fidelity up to the Nyquist limit while geometric models exhibit high-frequency drop-off, but it does not provide explicit PSD equations, numerical values, or statistical test details [2606.23123].

## 6. Interpretation, limitations, and current standing

The Fractal Neural Operator advances a specific hypothesis about chaotic forecasting: standard models fail not because chaos is intrinsically beyond machine learning, but because they impose smooth and periodic latent representations on trajectories supported on fractal attractors. Its positive proposal is to replace octave-spaced encodings with **number-theoretic aperiodicity**, realized through prime harmonics, and to make latent geometry deliberately rough in a Weierstrass-like sense [2606.23123].

The empirical support for that hypothesis is narrow but nontrivial. The encoder is explicitly defined; the Lorenz-63 setup is standard; quantitative improvements over raw and geometric baselines are reported; and the ablation comparing fixed primes, random Fourier features, geometric frequencies, and trainable frequencies is directly aligned with the paper’s central claim. The strongest practical implication is that long-horizon chaotic prediction may benefit from encodings designed around **non-resonance** rather than around standard geometric positional features [2606.23123].

At the same time, the paper has clear limitations. It tests only **one benchmark system**, **Lorenz-63**; it does not provide rigorous proofs for its strongest spectral claims; it omits many implementation details needed for straightforward reproducibility; it does not compare against stronger modern sequence models beyond simple encoding baselines; and it provides no evidence yet for **high-dimensional spatiotemporal chaotic PDEs**. Suggested applications to **weather**, **plasma turbulence**, and **financial volatility** are therefore speculative within the present evidence base. A plausible implication is that the work is best read, at this stage, as a hypothesis-driven architectural proposal rather than as a settled operator-learning framework for chaos more broadly [2606.23123].

Source: https://www.emergentmind.com/topics/fractal-neural-operator-fno