Papers
Topics
Authors
Recent
Search
2000 character limit reached

LArctan-SKAN: Simple and Efficient Single-Parameterized Kolmogorov-Arnold Networks using Learnable Trigonometric Function

Published 25 Oct 2024 in cs.AI | (2410.19360v1)

Abstract: This paper proposes a novel approach for designing Single-Parameterized Kolmogorov-Arnold Networks (SKAN) by utilizing a Single-Parameterized Function (SFunc) constructed from trigonometric functions. Three new SKAN variants are developed: LSin-SKAN, LCos-SKAN, and LArctan-SKAN. Experimental validation on the MNIST dataset demonstrates that LArctan-SKAN excels in both accuracy and computational efficiency. Specifically, LArctan-SKAN significantly improves test set accuracy over existing models, outperforming all pure KAN variants compared, including FourierKAN, LSS-SKAN, and Spl-KAN. It also surpasses mixed MLP-based models such as MLP+rKAN and MLP+fKAN in accuracy. Furthermore, LArctan-SKAN exhibits remarkable computational efficiency, with a training speed increase of 535.01% and 49.55% compared to MLP+rKAN and MLP+fKAN, respectively. These results confirm the effectiveness and potential of SKANs constructed with trigonometric functions. The experiment code is available at https://github.com/chikkkit/LArctan-SKAN .

Authors (2)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (7)
  1. Z. Liu, Y. Wang, S. Vaidya, F. Ruehle, J. Halverson, M. Soljačić, T. Y. Hou, and M. Tegmark, “KAN: Kolmogorov-Arnold Networks,” Jun. 2024. [Online]. Available: http://arxiv.org/abs/2404.19756
  2. Z. Chen and X. Zhang, “Lss-skan: Efficient kolmogorov-arnold networks based on single-parameterized function,” arXiv preprint arXiv:2410.14951, 2024.
  3. Z. Bozorgasl and H. Chen, “Wav-KAN: Wavelet Kolmogorov-Arnold Networks,” May 2024. [Online]. Available: http://arxiv.org/abs/2405.12832
  4. Z. Li, “Kolmogorov-Arnold Networks are Radial Basis Function Networks,” May 2024. [Online]. Available: http://arxiv.org/abs/2405.06721
  5. G. Noesis, “Fourierkan,” https://github.com/GistNoesis/FourierKAN, 2024.
  6. A. A. Aghaei, “fKAN: Fractional Kolmogorov-Arnold Networks with trainable Jacobi basis functions,” Jun. 2024. [Online]. Available: http://arxiv.org/abs/2406.07456
  7. ——, “rKAN: Rational Kolmogorov-Arnold Networks,” Jun. 2024. [Online]. Available: http://arxiv.org/abs/2406.14495
Citations (1)

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.