Dice Question Streamline Icon: https://streamlinehq.com

Dimension dependence of the constant in KAN approximation bound

Determine the dependence on input dimension of the constant C appearing in the approximation bound of Theorem [Approximation theory, KAT] (Equation (2.13)), which states that Kolmogorov–Arnold Network spline approximations satisfy ||f − (Φ^G_{L−1} ∘ … ∘ Φ^G_{0}) x||_{C^m} ≤ C G^{−k−1+m}. Provide explicit bounds or characterizations of C as a function of the input dimension and representation parameters.

Information Square Streamline Icon: https://streamlinehq.com

Background

The paper establishes an approximation theorem for KANs using k-th order B-spline activations, proving a dimension-independent convergence rate with respect to grid size G. While the convergence exponent does not depend on dimension, the constant C in the bound may depend on the representation and dimension.

The authors explicitly defer analyzing how C scales with the dimension, indicating a concrete unresolved question about the quantitative dependence of C on dimensionality.

References

We will leave the discussion of the dependence of the constant on the dimension as a future work.

KAN: Kolmogorov-Arnold Networks (2404.19756 - Liu et al., 30 Apr 2024) in Subsection 2.3, KAN's Approximation Abilities and Scaling Laws (Theorem [Approximation theory, KAT])