Papers
Topics
Authors
Recent
Search
2000 character limit reached

TMN: A Lightweight Neuron Model for Efficient Nonlinear Spike Representation

Published 30 Aug 2024 in cs.NE | (2408.17245v3)

Abstract: Spike trains serve as the primary medium for information transmission in Spiking Neural Networks, playing a crucial role in determining system efficiency. Existing encoding schemes based on spike counts or timing often face severe limitations under low-timestep constraints, while more expressive alternatives typically involve complex neuronal dynamics or system designs, which hinder scalability and practical deployment. To address these challenges, we propose the Ternary Momentum Neuron (TMN), a novel neuron model featuring two key innovations: (1) a lightweight momentum mechanism that realizes exponential input weighting by doubling the membrane potential before integration, and (2) a ternary predictive spiking scheme which employs symmetric sub-thresholds $\pm\frac{1}{2}v_{th}$ to enable early spiking and correct over-firing. Extensive experiments across diverse tasks and network architectures demonstrate that the proposed approach achieves high-precision encoding with significantly fewer timesteps, providing a scalable and hardware-aware solution for next-generation SNN computing.

Summary

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.