---
title: Adaptive RBF-KAN Networks
url: https://www.emergentmind.com/topics/adaptive-rbf-kan
type: topic
---

# Adaptive RBF-KAN Networks

Searching arXiv for the cited papers and closely related work on Adaptive RBF-KAN.
First, I’ll look up the core FastKAN paper that reframes KANs as RBF networks.
Looking up “Kolmogorov-Arnold Networks are Radial Basis Function Networks”.
Adaptive RBF-KAN designates a line of Kolmogorov–Arnold network research in which the spline-parameterized univariate edge functions of KAN are replaced by radial basis function expansions, and some part of the RBF parameterization is made data-driven. In the narrow sense, the term refers to the model introduced in "Adaptive RBF-KAN: A Comparative Evaluation of Dynamic Shape Parameters in Kolmogorov-Arnold Networks" [2605.21534]. In a broader sense, it also covers related RBF-based KAN variants that learn kernel scales, kernel families, centers, or hierarchical decompositions while preserving the Kolmogorov–Arnold style separation into univariate inner and outer maps [2405.06721] [2601.07760] [2606.02936].

## 1. Definition and architectural lineage

Kolmogorov–Arnold Networks approximate multivariate functions through compositions of univariate functions. A central representation used in the literature is
\[
f(x) = \sum_q \Phi_q\left(\sum_p \phi_{q,p}(x_p)\right).
\]
In spline-based KAN implementations, the learnable edge function is typically written as
\[
\psi_{k,m,n}(x)=\sum_{j=0}^{H+J-1} c_{k,m,n,j} B_{j,J}(x)+w_{k,m,n}\cdot \mathrm{SiLU}(x).
\]
This formulation gives strong local approximation power, but it also ties the model to B-spline basis evaluation and grid management [2605.21534].

The RBF-KAN transition begins from the observation that the 3rd-order B-splines used in standard KANs can be closely approximated by Gaussian radial basis functions after a linear transformation of the input. FastKAN adopts this viewpoint and replaces explicit spline evaluation by Gaussian RBF computation, while preserving the additive KAN structure [2405.06721]. Subsequent papers introduce distinct notions of adaptivity: Adaptive RBF-KAN makes the kernel width learnable and enlarges the kernel family beyond Gaussian; Free-RBF-KAN makes both centroids and smoothness trainable; hierarchical RBF-KAN makes centers, scales, and linear parameters trainable inside a multi-block architecture that mirrors the Kolmogorov–Arnold decomposition more explicitly [2605.21534] [2601.07760] [2606.02936].

| Variant | Basis choice | Adaptive component |
|---|---|---|
| FastKAN | Gaussian RBFs | Learnable coefficients; fixed centers |
| Adaptive RBF-KAN | Gaussian, Matérn, Wendland | LOOCV-initialized, trainable shape parameter |
| Free-RBF-KAN | RBF basis with Gaussian in experiments and Matérn discussed | Trainable centroids and smoothness |
| Hierarchical RBF-KAN | Gaussian RBF activations | Trainable centers, scales, weights, biases |

## 2. RBF reformulation of spline KAN

The conceptual pivot of Adaptive RBF-KAN is the FastKAN claim that "under proper linear transformations, Gaussian RBFs well approximate 3-order B-spline bases." The standard RBF form used in this reformulation is
\[
f(x) = \sum_{i=1}^N w_i\, \phi(\|x-c_i\|),
\]
with Gaussian basis
\[
\phi(r) = \exp\left(-\frac{r^2}{2h^2}\right).
\]
Within FastKAN, the learned univariate map on an edge is therefore interpreted as a linear combination of Gaussian bumps located at fixed centers rather than as a spline expansion over a fixed knot grid [2405.06721].

This replacement matters computationally because standard KAN implementations rely on the de Boor–Cox recursion to evaluate 3rd-order B-splines and often require additional grid rescaling to keep activations in range during training. FastKAN removes the de Boor–Cox recursion and the spline-grid rescaling used in standard KAN. The paper also uses layer normalization to reduce the chance that activations drift outside the region where the basis approximation is good, thereby avoiding the need for explicit input-domain rescaling during training [2405.06721].

The reported speed measurements use an NVIDIA V100 GPU and comparable basis capacity: efficient KAN uses 5 grids with 3rd-order splines, totaling 8 parameters per input, and FastKAN uses 8 Gaussian centers. On a layer with 100 inputs and 100 outputs, FastKAN reduces forward-pass time from roughly \(742\,\mu s\) to \(223\,\mu s\), a \(3.33\times\) speedup. For forward + backward, it improves from about \(1160\,\mu s\) to \(925\,\mu s\), about \(1.25\times\) faster. On MNIST with models of shape \([28\times 28, 64, 10]\) trained for 20 epochs, FastKAN performs equivalently to, and sometimes slightly better than, the efficient KAN baseline [2405.06721].

A recurring interpretive point follows directly from FastKAN: this is not presented as a theorem of exact equivalence between arbitrary KANs and arbitrary RBF networks. The claim is narrower. The particular spline basis construction used in standard KANs can be reformulated as an RBF expansion with fixed centers, yielding a much cheaper implementation [2405.06721].

## 3. Shape-adaptive kernel learning

The model introduced as Adaptive RBF-KAN keeps the FastKAN edgewise RBF formulation,
\[
\psi_{k,m,n}(x)=\sum_{j=1}^{K} c_{k,m,n,j}\,\phi\!\left(\frac{|x-c_j|}{h}\right),
\]
where \(c_j\) are fixed centers, \(c_{k,m,n,j}\) are learnable coefficients, and \(h\) is the kernel width or shape parameter. Its central modification is that the kernel family is no longer restricted to Gaussian, and the shape parameter is no longer fixed. FastKAN is described as using Gaussian RBFs with the standard value \(h=0.5714\); Adaptive RBF-KAN instead initializes \(h\) by leave-one-out cross-validation and then refines it by gradient-based training [2605.21534].

The paper’s LOOCV procedure is built from an auxiliary interpolation model,
\[
s(x)=\sum_{j=1}^{N} w_j\,\phi\!\left(\frac{|x-x_j|}{h}\right),
\]
with interpolation matrix
\[
A_{ij}=\phi\!\left(\frac{|x_i-x_j|}{h}\right),
\qquad
A\mathbf{w}=\mathbf{y}.
\]
To avoid ill-conditioning, the paper adds
\[
A \leftarrow A+\lambda I,\qquad \lambda=10^{-9}.
\]
The search for the initial width is coarse-to-fine, and the minimized criterion is
\[
err = \max_i |e_i|.
\]
After initialization, positivity is enforced by the log-space reparameterization
\[
\theta=\ln(h), \qquad h=e^\theta,
\]
with \(\theta\), the RBF coefficients \(c_{k,m,n,j}\), and the residual weights \(w_{k,m,n}\) all updated by Adam via backpropagation [2605.21534].

The paper interprets the shape parameter as the main control knob for locality and smoothness: small \(h\) yields narrow, highly localized kernels that are more flexible but potentially overfitting; large \(h\) yields smoother, broader kernels that can underfit or oversmooth. The stated motivation is therefore two-stage: LOOCV addresses the initialization problem, and gradient descent addresses the final task-adapted scale [2605.21534].

## 4. Kernel families and function-class matching

Adaptive RBF-KAN enlarges the kernel family in a way that makes kernel smoothness and support explicit modeling choices. The Gaussian kernel remains
\[
\phi(r)=\exp\left(-\frac{r^2}{2h^2}\right),
\]
and is described as \(C^\infty\), infinitely smooth, and globally supported. The paper then introduces three Matérn variants into the KAN framework:
\[
\phi(r)=\exp\left(-\frac{r}{h}\right)\left(\frac{r^3}{h^3}+6\frac{r^2}{h^2}+15\frac{r}{h}+15\right)
\]
for Matérn \(C^6\),
\[
\phi(r)=\exp\left(-\frac{r}{h}\right)\left(\frac{r^2}{h^2}+3\frac{r}{h}+3\right)
\]
for Matérn \(C^4\), and
\[
\phi(r)=\exp\left(-\frac{r}{h}\right)\left(\frac{r}{h}+1\right)
\]
for Matérn \(C^2\). It also introduces Wendland kernels, which are compactly supported, including
\[
\phi(r)=\max\left(1-\frac{r}{h},0\right)^4\left(4\frac{r}{h}+1\right)
\]
for Wendland \(C^2\) and
\[
\phi(r)=\max\left(1-\frac{r}{h},0\right)^8\left(32\frac{r^3}{h^3}+25\frac{r^2}{h^2}+8\frac{r}{h}+1\right)
\]
for Wendland \(C^6\) [2605.21534].

The main empirical message is that kernel smoothness and locality should match the target function structure. For the very smooth Franke function \(f_1\), Gaussian performs best. For the circular discontinuity \(f_2\), Matérn \(C^2\) performs better than Gaussian. For the oscillatory benchmark
\[
f_3(x,y)=\sin(25x)\cos(25y),
\]
Wendland \(C^2\) performs best. For the singularity-like benchmark \(f_4\), Wendland \(C^6\) gives the best reported result [2605.21534].

The benchmark setup is uniform across models: 2000 samples total, 80/20 train-test split, input dimension 2, output dimension 1, Adam optimizer, learning rate \(10^{-2}\), 2000 epochs, FP64 precision, and the same hardware across comparisons. The adaptive FastKAN uses \([2,8,1]\) for \(f_1\), \(f_2\), and \(f_4\), and \([2,16,1]\) for \(f_3\); the standard KAN uses deeper spline-based architectures such as \([2,5,5,1]\), which are much slower [2605.21534].

| Benchmark | Best kernel | Relative \(L_2\) |
|---|---|---:|
| Franke function \(f_1\) | Gaussian | \(\approx 4.07\times10^{-3}\) |
| Circular discontinuity \(f_2\) | Matérn \(C^2\) | \(\approx 3.94\times10^{-2}\) |
| Oscillatory \(f_3\) | Wendland \(C^2\) | \(\approx 6.24\times10^{-2}\) |
| Singularity-like \(f_4\) | Wendland \(C^6\) | \(\approx 1.92\times10^{-2}\) |

A particularly explicit comparison is reported for \(f_3\):
\[
\text{FastKAN (GA)} \approx 4.54\times10^{-1}
\quad\rightarrow\quad
\text{Adaptive FastKAN (W2)} \approx 6.24\times10^{-2}.
\]
For \(f_4\), the Wendland kernel improves over Gaussian by about \(52\%\). This suggests that the term “adaptive” in this paper is primarily about shape adaptation and kernel-family selection rather than center relocation [2605.21534].

## 5. Learned grids, trainable centers, and hierarchical structure

Other RBF-KAN variants extend adaptivity beyond a single global shape parameter. Free-RBF-KAN defines a multilayer RBF-KAN recursively by
\[
x^{(l+1)}=\Phi^{(l)}(x^{(l)}),
\]
with each output component represented as a sum of kernel responses
\[
\sum_{j=1}^{n_l}\sum_{m=1}^{G}\omega^{(l)}_{ijm} K\!\left(\frac{x^{(l)}_j-c^{(l)}_{ijm}}{\sigma^{(l)}_{ijm}}\right).
\]
The architectural distinction is explicit: standard RBF-KAN uses fixed centroids and fixed smoothness, whereas Free-RBF-KAN makes both trainable. Each centroid is reparameterized so that it remains in a prescribed interval,
\[
c = x_l + \frac{x_r-x_l}{b-a}\big(\rho(\tilde c)-a\big),
\]
with \(\rho=\tanh\), \(a=-1\), and \(b=1\). Smoothness is learned through
\[
\sigma=\exp(\tilde\sigma),
\]
which ensures positivity. The paper characterizes this as adaptive grid learning plus trainable smoothness, allowing the representation to remesh itself around regions of high variation without spline recursion [2601.07760].

Free-RBF-KAN also states a universality result for RBF-KANs. If \(K:\mathbb R\to\mathbb R\) is continuous and non-polynomial, then for any \(f\in C([0,1]^d)\) and any \(\varepsilon>0\), there exists an NP-KAN of the form
\[
g(x_1,\dots,x_d)=\sum_{q=1}^{2d+1}\widehat{\Phi}^{(q)}\!\left(\sum_{p=1}^{d}\widehat{\phi}^{(pq)}(x_p)\right)
\]
such that
\[
\|f-g\|_{C([0,1]^d)}<\varepsilon.
\]
Gaussian RBF-KAN is then universal as a corollary because the Gaussian kernel is continuous and non-polynomial [2601.07760].

Hierarchical RBF-KAN develops a different extension. Rather than using uniform fully connected layers, it uses hierarchical blocks consisting of two activation layers: the first approximates the inner univariate functions \(\phi_{q,p}\), and the second approximates the outer functions \(\Phi_q\). The number of neurons in the first post-activation layer is chosen to be \((2d+1)\) times the number in the second post-activation layer, reflecting the Kolmogorov–Arnold representation
\[
u(x_1,\dots,x_d) = \sum_{q=0}^{2d} \Phi_q \!\left( \sum_{p=1}^{d} \phi_{q,p}(x_p) \right).
\]
Its trainable parameters include RBF centers \(c_{i,j}^k\), RBF scales \(\beta_i^k\), linear-layer weights \(w_{i,j,k}\), and biases \(b_k^j\); ResNet-style skip connections are optional [2606.02936].

The theoretical results for hierarchical RBF-KAN are correspondingly stronger. Theorem 1 states that for any \(c>0\), if \(u\) admits the Kolmogorov–Arnold representation, then there exists a hierarchical RBF-KAN such that
\[
\|u-\hat{u}\|_{\infty}\leq c.
\]
The quantitative approximation estimate is described as having right-hand side of order at most
\[
\mathcal{O}(\varepsilon)=\mathcal{O}(N^{-1/10}) \quad\text{for } k\geq 2,
\]
and the paper emphasizes that this convergence rate does not explicitly depend on the dimension \(d\), suggesting partial mitigation of the curse of dimensionality. A stochastic extension, hierarchical RBF-SKAN, is formulated for random field learning under the Wasserstein-2 metric [2606.02936].

## 6. Empirical profile, limitations, and terminological boundaries

Across the current literature, adaptive RBF-KAN methods are presented as a compromise between the accuracy of spline KAN and the computational simplicity of RBF evaluation. Free-RBF-KAN is the clearest example of this tradeoff. In nonsmooth 2D function approximation,
\[
f(x,y)=\cos(4\pi x)+\sin(\pi y)+\sin(2\pi y)+|\sin(3\pi y^2)|,
\]
the reported test MSE is \(2.39\times 10^{-4}\) for Free-RBF-KAN, versus \(6.05\times 10^{-4}\) for standard RBF-KAN and \(3.96\times 10^{-3}\) for KAN. On MNIST with shared \([28\times 28,64,10]\) architecture, the reported test loss is \(8.789\times 10^{-2}\) for Free-RBF-KAN, compared with \(2.020\times 10^{-1}\) for standard RBF-KAN and \(1.166\times 10^{-1}\) for KAN. In a 2D heat equation benchmark, the reported \(L^\infty\) error and training time are \(2.41\times 10^{-3}\) and 138 s for Free-RBF-KAN, versus \(2.78\times 10^{-3}\) and 124 s for RBF-KAN and \(6.52\times 10^{-3}\) and 267 s for KAN. For a 2D Helmholtz problem, the reported \(L^2\) loss is \(3.35\times 10^{-2}\) for Free-RBF-KAN, versus \(3.67\times 10^{-1}\) for RBF-KAN and \(1.58\) for KAN. In DeepONet trunk learning for a reaction–diffusion PDE, the reported relative error is \(1.94\times 10^{-2}\) for Free-RBF-KAN, lower than MLP trunk \(2.08\times 10^{-2}\), KAN trunk \(6.15\times 10^{-2}\), and RBF-KAN trunk \(3.7\times 10^{-2}\) [2601.07760].

Hierarchical RBF-KAN reports a more structural conclusion: naive RBF-KAN with uniform widths performs poorly in many cases, whereas the hierarchical design plus ResNet gives the best stability. The model maintains good accuracy as dimension increases from 1 to 6 on an oscillatory benchmark, gives the smallest trajectory and dynamics errors in Lorenz system reconstruction when using the two-block ResNet variant, and in the stochastic setting hierarchical RBF-SKAN outperforms CNF and CVAE baselines, especially in standard deviation prediction [2606.02936].

Several boundaries on the term “adaptive” are explicit in the literature. FastKAN does not introduce fully adaptive center-learning or width-learning; it uses fixed centers and is best understood as an efficient RBF surrogate for spline KAN rather than a new adaptive basis-learning framework [2405.06721]. Adaptive RBF-KAN, in the 2026 sense, adapts the kernel family and the shape parameter \(h\), but still keeps the centers fixed [2605.21534]. Hierarchical RBF-KAN learns centers and scales, but does not introduce input-dependent centers, online basis relocation, adaptive basis growth or pruning, attention-like gating of RBFs, or a specialized adaptation rule beyond standard backpropagation [2606.02936]. Free-RBF-KAN goes furthest toward geometric adaptivity by learning centroids and smoothness jointly, but it still remains within the standard end-to-end optimization regime [2601.07760].

Related adaptive RBF models should be distinguished from canonical RBF-KANs. HyResPINNs introduces adaptive hybrid residual blocks that mix a neural branch and an RBF branch through trainable scalar gates inside a PINN, but it is described as an adaptive hybrid PINN architecture rather than a KAN [2410.03573]. "A Novel Adaptive Kernel for the RBF Neural Networks" learns fusion weights between Euclidean and cosine kernels in a classical RBF network, which is conceptually related to adaptive kernel design but not a KAN implementation [1905.03546]. This suggests that “Adaptive RBF-KAN” is best reserved for architectures that preserve the Kolmogorov–Arnold decomposition while making the RBF parameterization itself trainable.

Source: https://www.emergentmind.com/topics/adaptive-rbf-kan