2000 character limit reached
Biologically Inspired Dynamic Thresholds for Spiking Neural Networks (2206.04426v4)
Published 9 Jun 2022 in cs.RO
Abstract: The dynamic membrane potential threshold, as one of the essential properties of a biological neuron, is a spontaneous regulation mechanism that maintains neuronal homeostasis, i.e., the constant overall spiking firing rate of a neuron. As such, the neuron firing rate is regulated by a dynamic spiking threshold, which has been extensively studied in biology. Existing work in the machine learning community does not employ bioinspired spiking threshold schemes. This work aims at bridging this gap by introducing a novel bioinspired dynamic energy-temporal threshold (BDETT) scheme for spiking neural networks (SNNs). The proposed BDETT scheme mirrors two bioplausible observations: a dynamic threshold has 1) a positive correlation with the average membrane potential and 2) a negative correlation with the preceding rate of depolarization. We validate the effectiveness of the proposed BDETT on robot obstacle avoidance and continuous control tasks under both normal conditions and various degraded conditions, including noisy observations, weights, and dynamic environments. We find that the BDETT outperforms existing static and heuristic threshold approaches by significant margins in all tested conditions, and we confirm that the proposed bioinspired dynamic threshold scheme offers homeostasis to SNNs in complex real-world tasks.
- Probing subthreshold dynamics of hippocampal neurons by pulsed optogenetics. Science, 375(6580):570–574, 2022.
- Structured spike series specify gene expression patterns for olfactory circuit formation. Science, 365(6448):eaaw5030, 2019.
- Burst spiking of a single cortical neuron modifies global brain state. Science, 324(5927):643–646, 2009.
- A million spiking-neuron integrated circuit with a scalable communication network and interface. Science, 345(6197):668–673, 2014.
- A system hierarchy for brain-inspired computing. Nature, 586(7829):378–384, 2020.
- All-optical spiking neurosynaptic networks with self-learning capabilities. Nature, 569(7755):208–214, 2019.
- Truenorth: Accelerating from zero to 64 million neurons in 10 years. Computer, 52(5):20–29, 2019.
- Loihi: A neuromorphic manycore processor with on-chip learning. IEEE Micro, 38(1):82–99, 2018.
- Reinforcement co-learning of deep and spiking neural networks for energy-efficient mapless navigation with neuromorphic hardware. arXiv preprint arXiv:2003.01157, 2020.
- Travis DeWolf. Spiking neural networks take control. Science Robotics, 6(58):eabk3268, 2021.
- A cerebellar-based solution to the nondeterministic time delay problem in robotic control. Science Robotics, 6(58):eabf2756, 2021.
- Communicating clocks shape circadian homeostasis. Science, 371(6530):eabd0951, 2021.
- Homeostatic plasticity in the developing nervous system. Nature reviews neuroscience, 5(2):97–107, 2004.
- The other side of the engram: experience-driven changes in neuronal intrinsic excitability. Nature Reviews Neuroscience, 4(11):885–900, 2003.
- The bcm theory of synapse modification at 30: interaction of theory with experiment. Nature Reviews Neuroscience, 13(11):798–810, 2012.
- Spike-threshold adaptation predicted by membrane potential dynamics in vivo. PLOS Computational Biology, 10(4), 2014.
- Dynamic spike threshold reveals a mechanism for synaptic coincidence detection in cortical neurons in vivo. Proceedings of the National Academy of Sciences of the United States of America, 97(14):8110–8115, 2000.
- Synaptic homeostasis and input selectivity follow from a calcium-dependent plasticity model. Proceedings of the National Academy of Sciences, 101(41):14943–14948, 2004.
- Qian-Quan Sun. Experience-dependent intrinsic plasticity in interneurons of barrel cortex layer iv. Journal of Neurophysiology, 102(5):2955–2973, 2009.
- Unraveling mechanisms of homeostatic synaptic plasticity. Neuron, 66(3):337–351, 2010.
- From postsynaptic potentials to spikes in the genesis of auditory spatial receptive fields. Journal of Neuroscience, 22(13):5652–5658, 2002.
- Adaptive coincidence detection and dynamic gain control in visual cortical neurons in vivo. Neuron, 37(3):513–523, 2003.
- Synaptic mechanisms for motor variability in a feedforward network. Science Advances, 6(25):eaba4856, 2020.
- A biologically plausible supervised learning method for spiking neural networks using the symmetric stdp rule. Neural Networks, 121:387–395, 2020.
- An adaptive threshold neuron for recurrent spiking neural networks with nanodevice hardware implementation. Nature Communications, 12(1):4234, 2021.
- Spiking neural network (snn) with memristor synapses having non-linear weight update. Frontiers in computational neuroscience, 15:22, 2021.
- Wulfram Gerstner. Time structure of the activity in neural network models. Physical Review E, 51(1):738–758, 1995.
- Spiking Neuron Models: Single Neurons, Populations, Plasticity. 2002.
- Slayer: Spike layer error reassignment in time. In Advances in Neural Information Processing Systems, volume 31, pages 1412–1421, 2018.
- Obstacle avoidance and target acquisition for robot navigation using a mixed signal analog/digital neuromorphic processing system. Frontiers in neurorobotics, 11:28, 2017.
- Navigating mobile robots to target in near shortest time using reinforcement learning with spiking neural networks. In 2017 International Joint Conference on Neural Networks (IJCNN), pages 2243–2250. IEEE, 2017.
- Supervised learning in snn via reward-modulated spike-timing-dependent plasticity for a target reaching vehicle. Frontiers in neurorobotics, 13:18, 2019.
- Gridbot: an autonomous robot controlled by a spiking neural network mimicking the brain’s navigational system. In Proceedings of the International Conference on Neuromorphic Systems, pages 1–8, 2018.
- Improved robustness of reinforcement learning policies upon conversion to spiking neuronal network platforms applied to atari breakout game. Neural Networks, 120:108–115, 2019.
- Deep reinforcement learning with population-coded spiking neural network for continuous control. arXiv preprint arXiv:2010.09635, 2020.
- Spiking neural network on neuromorphic hardware for energy-efficient unidimensional slam. arXiv preprint arXiv:1903.02504, 2019.
- Path planning on the truenorth neurosynaptic system. In 2017 IEEE International Symposium on Circuits and Systems (ISCAS), pages 1–4, 2017.
- A neuromorphic controller for a robotic vehicle equipped with a dynamic vision sensor. Robotics Science and Systems, RSS 2017, 2017.
- Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971, 2015.
- A simple markov model of sodium channels with a dynamic threshold. J. Comput. Neurosci., 37(1):181–191, 2014.
- Openai gym. arXiv preprint arXiv:1606.01540, 2016.
- Addressing function approximation error in actor-critic methods. In International Conference on Machine Learning, pages 1587–1596. PMLR, 2018.
- Deep reinforcement learning of navigation in a complex and crowded environment with a limited field of view. In 2019 International Conference on Robotics and Automation (ICRA), pages 5993–6000. IEEE, 2019.
- 2007 special issue: Fading memory and time series prediction in recurrent networks with different forms of plasticity. Neural Networks, 20(3):312–322, 2007.
- Synaptic plasticity in neural networks needs homeostasis with a fast rate detector. PLOS Computational Biology, 9(11), 2013.
- Explaining and harnessing adversarial examples. arXiv preprint arXiv:1412.6572, 2014.
- Towards deep learning models resistant to adversarial attacks. arXiv preprint arXiv:1706.06083, 2017.
- Spatio-temporal backpropagation for training high-performance spiking neural networks. Frontiers in Neuroscience, 12:331, 2018.
- Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11):2278–2324, 1998.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.
