Mutual Information Analysis of Neuromorphic Coding for Distributed Wireless Spiking Neural Networks
Abstract: Wireless spiking neural networks (WSNNs) allow energy-efficient communications, especially when considering edge intelligence and learning for both terrestrial beyond 5G/6G and space networking systems. Recent research work has revealed that distributed wireless SNNs (DWSNNs) show good performance in terms of inference accuracy and low energy consumption of edge devices, under the constraints of limited bandwidth and spike loss probability. Following this reasoning, this technology can be promising for wireless sensor networks (WSNs) in space applications, where the energy constraint is predominant. In this work, we focus on neuromorphic impulse radio (IR) transmission techniques for DWSNNs, quantitatively evaluating the features of different coding algorithms that can be viewed as IR modulations. Specifically, the main contribution of this work is the evaluation of information-theoretic measures that may help in quantifying performance trade-offs among existing neuromorphic coding techniques.
- Y. Liu, Z. Qin, and G. Y. Li, “Energy-efficient distributed spiking neural network for wireless edge intelligence,” IEEE Transactions on Wireless Communications, pp. 1–1, 2024.
- T. Borsos, M. Condoluci, M. Daoutis, P. Hága, and A. Veres, “Resilience analysis of distributed wireless spiking neural networks,” in 2022 IEEE Wireless Communications and Networking Conference (WCNC), 2022, pp. 2375–2380.
- J. Chen, N. Skatchkovsky, and O. Simeone, “Neuromorphic wireless cognition: Event-driven semantic communications for remote inference,” IEEE Transactions on Cognitive Communications and Networking, vol. 9, no. 2, pp. 252–265, 2023.
- N. Skatchkovsky, H. Jang, and O. Simeone, “End-to-end learning of neuromorphic wireless systems for low-power edge artificial intelligence,” in 2020 54th Asilomar Conference on Signals, Systems, and Computers, 2020, pp. 166–173.
- W. Guo, M. E. Fouda, A. M. Eltawil, and K. N. Salama, “Neural coding in spiking neural networks: A comparative study for robust neuromorphic systems,” Frontiers in Neuroscience, vol. 15, 2021.
- J. Chen, N. Skatchkovsky, and O. Simeone, “Neuromorphic integrated sensing and communications,” IEEE Wireless Communications Letters, vol. 12, no. 3, pp. 476–480, 2023.
- D. Guo, S. Shamai, and S. Verdu, “Mutual information and minimum mean-square error in gaussian channels,” IEEE Transactions on Information Theory, vol. 51, no. 4, pp. 1261–1282, 2005.
- A. N. Burkitt, “A review of the integrate-and-fire neuron model: i. Homogeneous synaptic input,” Biological cybernetics, vol. 95, no. 1, pp. 1–19, 4 2006. [Online]. Available: https://doi.org/10.1007/s00422-006-0068-6
- R. S. Johansson and I. Birznieks, “First spikes in ensembles of human tactile afferents code complex spatial fingertip events,” Nature neuroscience, vol. 7, no. 2, pp. 170–177, 1 2004. [Online]. Available: https://doi.org/10.1038/nn1177
- S. Park, S. Kim, B. Na, and S. Yoon, “T2fsnn: Deep spiking neural networks with time-to-first-spike coding,” 2020 57th ACM/IEEE Design Automation Conference (DAC), pp. 1–6, 2020. [Online]. Available: https://api.semanticscholar.org/CorpusID:214667190
- J. Kim, H. Kim, S. Huh, J. Lee, and K. Choi, “Deep neural networks with weighted spikes,” Neurocomputing, vol. 311, pp. 373–386, 2018. [Online]. Available: https://api.semanticscholar.org/CorpusID:51611802
- E. M. Izhikevich, N. S. Desai, E. C. Walcott, and F. C. Hoppensteadt, “Bursts as a unit of neural information: selective communication via resonance,” Trends in Neurosciences, vol. 26, no. 3, pp. 161–167, 2003. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0166223603000341
- H. G. Eyherabide, A. Rokem, A. V. M. Herz, and I. Samengo, “Bursts generate a non-reducible spike-pattern code,” Frontiers in neuroscience, vol. 3, no. 1, 5 2009. [Online]. Available: https://doi.org/10.3389/neuro.01.002.2009
- C. E. Shannon, “A mathematical theory of communication,” The Bell System Technical Journal, vol. 27, no. 3, pp. 379–423, 1948.
- E. Goldoni, L. Prando, A. Vizziello, P. Savazzi, and P. Gamba, “Experimental data set analysis of RSSI‐based indoor and outdoor localization in LoRa networks,” Internet technology letters, vol. 2, no. 1, 10 2018. [Online]. Available: https://doi.org/10.1002/itl2.75
- K. Dakic, B. A. Homssi, S. Walia, and A. Al-Hourani, “Spiking neural networks for detecting satellite-based internet-of-things signals,” 2023.
- P. Savazzi, E. Goldoni, A. Vizziello, L. Favalli, and P. Gamba, “A wiener-based rssi localization algorithm exploiting modulation diversity in lora networks,” IEEE Sensors Journal, vol. 19, no. 24, pp. 12 381–12 388, 2019.
- R. R. Guerra, A. Vizziello, P. Savazzi, E. Goldoni, and P. Gamba, “Forecasting lorawan rssi using weather parameters: A comparative study of arima, artificial intelligence and hybrid approaches,” Computer Networks, vol. 243, p. 110258, 2024. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S1389128624000902
- D. Marzi, F. Dell’Acqua, and P. Gamba, “Tillage assessment in time series of spaceborne radar data over rice paddy fields in northern italy,” in IGARSS 2023-2023 IEEE International Geoscience and Remote Sensing Symposium. IEEE, 2023, pp. 3486–3489.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.