ShapKAN in Kolmogorov–Arnold Networks
- ShapKAN is a collection of techniques in Kolmogorov–Arnold Networks that leverages learnable univariate edge functions to achieve both pruning and attribution.
- The Shapley-based formulation improves pruning robustness by providing output-level, affine-invariant importance scores that outperform traditional magnitude-based methods.
- Variants of ShapKAN include shape-centric convolutional and adaptive RBF approaches, which adjust filter geometry and kernel shape parameters to enhance model interpretability and performance.
Searching arXiv for papers on “ShapKAN” and closely related KAN work. ShapKAN is a term used in the Kolmogorov–Arnold Network literature for distinct, non-equivalent constructions built on the same architectural premise: learnable univariate functions placed on edges rather than fixed nonlinearities placed on nodes. In its most specific usage, ShapKAN denotes a pruning and attribution framework for Kolmogorov–Arnold Networks that uses Shapley value scoring to quantify true node contributions in a shift-invariant manner, thereby addressing a central failure mode of magnitude-based pruning in spline-parameterized KANs (Fan et al., 2 Oct 2025). The term has also been used for a shape-centric convolutional KAN in which learnable univariate functions parameterize filter shape rather than act on every kernel entry (Mereu et al., 23 Jun 2026), and for a shape-parameter-adaptive RBF-KAN that learns radial kernel scale parameters with LOOCV initialization (Cavoretto et al., 20 May 2026). All of these usages presuppose the KAN formalism introduced as an alternative to MLPs, where the basic computational units are edge-wise univariate functions and node-wise summation (Liu et al., 2024).
1. KAN substrate and the interpretability setting
Kolmogorov–Arnold Networks are motivated by the Kolmogorov–Arnold representation theorem, presented in the KAN literature in the form
with continuous univariate inner functions and outer functions (Liu et al., 2024). KANs implement this idea by placing trainable univariate activation functions on edges and summing at nodes. A standard KAN layer computes
equivalently
and an -layer network composes layer operators as
In the spline-based formulation, each edge activation is parameterized as
where are B-spline basis functions of fixed order, such as cubic splines, on a chosen grid, and are coefficients (Fan et al., 2 Oct 2025). The original KAN formulation also uses a residual base function, with
0
and 1 for stability (Liu et al., 2024). This edge-local parameterization is the fundamental unit in KANs rather than scalar weights.
Interpretability in KANs is closely tied to sparsification and post-training simplification. A typical training objective augments the prediction loss with sparsity-inducing penalties,
2
where 3 aggregates 4 norms over edge activations and 5 is an entropy-like sparsity transform (Fan et al., 2 Oct 2025). In the original KAN work, this regularization underpins pruning and symbolification, and smaller KANs tend to yield simpler symbolic forms and better generalization (Liu et al., 2024). ShapKAN in the Shapley-based sense arises precisely because this standard magnitude-centric simplification pipeline becomes unstable under input reparameterization.
2. ShapKAN as a Shapley-based pruning and attribution framework
In "Shift-Invariant Attribute Scoring for Kolmogorov-Arnold Networks via Shapley Value" (Fan et al., 2 Oct 2025), ShapKAN formalizes each hidden layer as a cooperative game whose players are neurons. For a layer 6 with nodes 7 and coalitions 8, the value function is defined by the prediction game
9
where 0 computes the network output with the layer-1 node set restricted to 2, namely
3
while the rest of the forward graph is unchanged. The game is layer-local, but contributions propagate through the composed network.
For a player 4 in a player set 5, the Shapley value is
6
The same paper gives an equivalent sampling form,
7
ShapKAN computes Shapley values per layer with 8 defined as above and aggregates over a dataset by empirical averaging, using batching in practice (Fan et al., 2 Oct 2025).
The resulting neuron-level importance score is
9
estimated by permutation sampling on batches of data. These scores are then used in a bottom-up layer-wise pruning policy. For each layer, the framework computes exact or approximate Shapley values for all neurons, ranks neurons by absolute Shapley scores, and prunes them by one of three criteria: ratio pruning, number pruning, or threshold pruning. Ratio pruning removes neurons with Shapley below a fraction 0 of the total layer contribution; number pruning removes the 1 lowest-Shapley neurons; threshold pruning removes neurons with 2. After pruning, the model is updated by removing nodes and incident edges before proceeding to the next layer (Fan et al., 2 Oct 2025).
A key implementation restriction is explicit: ShapKAN avoids feature-level Shapley at the input layer because that would require modeling conditional input distributions. The framework is therefore a node-level attribution and pruning method internal to KAN layers rather than a generic feature explainer (Fan et al., 2 Oct 2025).
3. Shift invariance and the failure of magnitude-based pruning
The central technical claim of ShapKAN is that Shapley-based neuron attribution is robust to affine reparameterizations that preserve the represented function, whereas magnitude-based scores are not. In vanilla KAN pruning, node importance is derived from edge norms, for example
3
and nodes are removed if 4 with 5 (Fan et al., 2 Oct 2025). Because KANs use edge-wise splines, the magnitudes of spline coefficients and cached activations change under input-domain shifts such as moving from 6 to 7 or 8, even when the represented function is unchanged. The paper identifies this as a source of inconsistent importance rankings, unstable pruning, and degraded interpretability.
The formal invariance statement is given as an affine reparameterization result. If an incoming activation is reparameterized by 9 and the edge functions are compensatingly reparameterized so that the overall network output 0 is unchanged for all 1, then for any coalition 2 at layer 3, the value 4 is unchanged; therefore all marginal differences 5 are unchanged and the Shapley values remain invariant. By contrast, magnitude-based scores such as 6 depend on the coefficients of the reparameterized spline basis and can change under 7, altering rankings (Fan et al., 2 Oct 2025).
This invariance argument is operational rather than merely axiomatic. ShapKAN’s attributions depend on output-level marginal gains measured through the value function, not on internal coefficient magnitudes. The paper further states that the layer-local Shapley values satisfy dummy, efficiency, and symmetry axioms, which is used to justify them as fair attributions of node importance (Fan et al., 2 Oct 2025).
The comparison to other explainability methods is also structurally specific. Integrated Gradients, LRP, and DeepSHAP are described as feature-level explainers that require conditional modeling or linearization assumptions and do not naturally handle KAN’s node-level, edge-wise functional units. KernelSHAP and amortized explainers can estimate Shapley values, but they rely on additional assumptions such as linear constraints or an auxiliary black box. ShapKAN instead uses unbiased permutation sampling, layer-local games, and direct value-function measurements (Fan et al., 2 Oct 2025). This suggests that the method is designed less as a replacement for feature attribution and more as a structurally matched pruning criterion for spline-based KANs.
4. Estimation, pruning workflow, and empirical behavior
Exact Shapley evaluation scales as 8 per layer and is therefore infeasible for wide layers. ShapKAN uses unbiased permutation sampling,
9
where 0 is the set of predecessors of 1 in a random permutation of 2, with convergence rate 3 (Fan et al., 2 Oct 2025). Variance is reduced by antithetic sampling, which pairs each permutation with its reverse. For small layers, such as 4, exact Shapley is computed.
On synthetic tasks, the reported setup uses functions 5, 6, 7, and 8, with architecture 9, cubic B-spline edge activations, LBFGS optimization, grids of 0 or 1 per task, 2 training points from 3 clipped to 4, tests in 5, 6, and 7, and 8 runs for stability (Fan et al., 2 Oct 2025). The metrics are test RMSE, ranking stability under shifts, symbolic recovery quality, convergence of Shapley estimation, and runtime overhead.
The paper reports that ShapKAN yields consistent neuron rankings across domains with small standard deviations, typically 9–0 after normalization, while vanilla KAN scores fluctuate heavily. For the special-function task 1, the least important neuron’s vanilla score varies from approximately 2 to approximately 3–4 across ranges, whereas ShapKAN keeps the two top neurons stable and the rest below approximately 5 (Fan et al., 2 Oct 2025).
Under equal parameter budgets and pruning counts, ShapKAN consistently reduces test RMSE relative to vanilla KAN:
| Function | Vanilla prune, RMSE | ShapKAN prune, RMSE |
|---|---|---|
| 6 (Multiplication) | [0,3,4], 7 | [2,3,4], 8 |
| 9 (Special) | [2,3,4], 0 | [1,2,3], 1 |
| 2 (Phase) | [1,3,4], 3 | [1,2,3], 4 |
| 5 (Complex) | [0,2,3,4], 6 | [0,1,3,4], 7 |
The symbolic consequences are similarly emphasized. On 8 under covariate shift, ShapKAN recovers the ground truth 9, whereas vanilla KAN produces the spurious expression 0. For 1, ShapKAN selects 2 edges and a 3 top layer consistent with the true form, while vanilla KAN selects a sinusoidal edge spuriously (Fan et al., 2 Oct 2025). Exact Shapley computation takes approximately 4–5s per small layer; approximation with 6–7 samples has comparable or slightly higher time but negligible overhead relative to training and inference, and antithetic sampling further reduces variance with similar runtime.
The same paper extends the comparison to Census-income, MNIST, and Airbnb, with KAN widths such as 8, 9, and 00, parameter counts from 01k to 02k, and LBFGS training (Fan et al., 2 Oct 2025). The baselines are vanilla KAN pruning, DropKAN, and an MLP with similar parameter counts. ShapKAN is reported to consistently outperform vanilla KAN and DropKAN across pruning ratios; MLP remains strong but lacks KAN’s symbolic recovery advantages, and DropKAN often degrades substantially, with Airbnb RMSE greater than 03 for high pruning ratios.
5. Alternative uses of the term “ShapKAN”
The term is not semantically uniform across the KAN literature. At least three distinct meanings appear in the supplied papers:
| Usage | Core idea | Representative paper |
|---|---|---|
| Shapley-based ShapKAN | Node-level attribution and pruning via layer-local Shapley values | (Fan et al., 2 Oct 2025) |
| Shape-centric convolutional ShapKAN | Learnable univariate functions parameterize filter shape rather than per-edge value transforms | (Mereu et al., 23 Jun 2026) |
| Shape-parameter-adaptive ShapKAN | RBF-KAN with LOOCV-initialized and trainable kernel shape parameter | (Cavoretto et al., 20 May 2026) |
In the convolutional usage, the paper "Structural Kolmogorov-Arnold Convolutions" states that a ShapKAN is a KAN whose learnable univariate functions primarily parameterize or generate the filter’s spatial shape rather than act on the pixel values of each kernel entry (Mereu et al., 23 Jun 2026). RF-KAN is identified there as the canonical ShapKAN. The filter is synthesized from oriented ridge profiles expanded in a localized oscillatory Morlet basis with content-adaptive amplitudes, while pixel values enter linearly. Under a matched four-layer protocol at about 04M parameters, RF-KAN and SV-KAN reach 05 and 06 on CIFAR-10 and 07 and 08 on CIFAR-100, both above a plain convolution and every per-edge KAN tested, including the official Gram variant, at roughly a fifth of the parameters (Mereu et al., 23 Jun 2026).
In the RBF-based usage, the paper "Adaptive RBF-KAN" explicitly notes that “ShapKAN” refers to shape-parameter-adaptive KAN and is unrelated to SHAP values (Cavoretto et al., 20 May 2026). Here the emphasis is on replacing spline edge functions with RBF expansions and learning the radial kernel shape parameter jointly with network weights, initialized by leave-one-out cross-validation. The framework supports Gaussian, Matérn, and Wendland kernels. On benchmark functions over 09, the paper reports that Gaussian kernels are best for smooth targets, low-smoothness Matérn kernels for discontinuities, compactly supported Wendland kernels for oscillations, and higher-smoothness Wendland kernels for localized peaks (Cavoretto et al., 20 May 2026).
A common misconception is therefore terminological: “ShapKAN” does not denote a single standardized method across the literature. In one paper it abbreviates Shapley-based attribution for pruning (Fan et al., 2 Oct 2025); in another it denotes shape-centric structural convolution (Mereu et al., 23 Jun 2026); in another it refers to adaptive radial kernel shape parameters and is stated to be unrelated to SHAP (Cavoretto et al., 20 May 2026). The shared element is not a single algorithm but the exploitation of structural degrees of freedom in KANs.
6. Practical implications, limitations, and open directions
For the Shapley-based pruning framework, the practical guidance is explicit. Layer-wise Shapley values are computed on held-out validation or training data via permutation sampling, preferably with antithetic pairs; exact Shapley is used for small layers with 10, while 11–12 permutations are recommended for wider layers depending on desired stability (Fan et al., 2 Oct 2025). Bottom-up pruning is preferred, the input layer is not pruned with this method, and recommended KAN hyperparameters include B-spline order 13, grid size 14–15, and LBFGS training. The paper suggests starting with number pruning by removing the 16–17 lowest-Shapley neurons per layer, or ratio pruning with 18–19, followed by optional short fine-tuning.
The limitations are also structural. Exact Shapley scales poorly with width; permutation sampling is unbiased and converges fast but remains stochastic; antithetic sampling improves small-sample variance (Fan et al., 2 Oct 2025). Correlated neurons may complicate attribution, and the paper notes that higher-order Shapley interactions could help. The choice of value function matters: the prediction game is label-free and general, whereas a validation game may improve fidelity but requires labels. Input-layer feature pruning is explicitly avoided because it requires conditional input modeling. Proposed extensions include edge-level pruning, global versus local importance aggregation across layers, interaction indices such as shapiq, improved estimators based on control variates or stratified permutations, and integration with training via joint regularization guided by Shapley (Fan et al., 2 Oct 2025).
At the broader KAN level, a second misconception concerns what interpretability means in this model class. KANs are intrinsically interpretable because each edge function is a univariate curve that can be visualized, probed, sparsified, pruned, and in some cases snapped to a symbolic form (Liu et al., 2024). ShapKAN in the Shapley sense does not create interpretability ex nihilo; it refines the simplification and attribution pipeline by replacing unstable magnitude heuristics with output-based cooperative-game scores. This suggests that ShapKAN is best understood as a method for preserving the interpretability advantages already latent in KANs while making pruning more robust to reparameterization and covariate shift (Fan et al., 2 Oct 2025).
Taken together, the literature uses “ShapKAN” to name three different attempts to regularize, simplify, or structurally bias KANs. The Shapley-based formulation is the most direct answer to pruning instability in spline KANs (Fan et al., 2 Oct 2025). The convolutional shape-centric formulation shifts learnable functions from values to filter geometry (Mereu et al., 23 Jun 2026). The RBF-based formulation shifts attention from spline coefficients to adaptive kernel width and smoothness (Cavoretto et al., 20 May 2026). The plurality of meanings is itself informative: in KAN research, “shape” and “attribution” are both active loci of innovation because the architecture exposes functional structure at the edge level in a way that conventional MLP parameterizations do not (Liu et al., 2024).