Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
140 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Tunable Synaptic Working Memory with Volatile Memristive Devices (2306.14691v1)

Published 26 Jun 2023 in cs.ET

Abstract: Different real-world cognitive tasks evolve on different relevant timescales. Processing these tasks requires memory mechanisms able to match their specific time constants. In particular, the working memory utilizes mechanisms that span orders of magnitudes of timescales, from milliseconds to seconds or even minutes. This plentitude of timescales is an essential ingredient of working memory tasks like visual or language processing. This degree of flexibility is challenging in analog computing hardware because it requires the integration of several reconfigurable capacitors of different size. Emerging volatile memristive devices present a compact and appealing solution to reproduce reconfigurable temporal dynamics in a neuromorphic network. We present a demonstration of working memory using a silver-based memristive device whose key parameters, retention time and switching probability, can be electrically tuned and adapted to the task at hand. First, we demonstrate the principles of working memory in a small scale hardware to execute an associative memory task. Then, we use the experimental data in two larger scale simulations, the first featuring working memory in a biological environment, the second demonstrating associative symbolic working memory.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (44)
  1. Working models of working memory. Current opinion in neurobiology 25, 20–24 (2014).
  2. Synaptic correlates of working memory capacity. Neuron 93, 323–330 (2017).
  3. Cowan, N. The magical mystery four: How is working memory capacity limited, and why? Current directions in psychological science 19, 51–57 (2010).
  4. Working memory 2.0. Neuron 100, 463–475 (2018).
  5. Synaptic theory of working memory. Science 319, 1543–1546 (2008).
  6. Memory networks. arXiv preprint arXiv:1410.3916 (2014).
  7. Neural turing machines. arXiv preprint arXiv:1410.5401 (2014).
  8. Pointer networks. Advances in neural information processing systems 28 (2015).
  9. Meta-learning with memory-augmented neural networks. In International conference on machine learning, 1842–1850 (PMLR, 2016).
  10. Comparing feedforward and recurrent neural network architectures with human behavior in artificial grammar learning. Scientific reports 10, 1–15 (2020).
  11. Universal transformers. arXiv preprint arXiv:1807.03819 (2018).
  12. Recurrent neural networks are universal approximators. In International Conference on Artificial Neural Networks, 632–640 (Springer, 2006).
  13. A review of recurrent neural networks: Lstm cells and network architectures. Neural computation 31, 1235–1270 (2019).
  14. Amirsoleimani, A. et al. In-memory vector-matrix multiplication in monolithic complementary metal–oxide–semiconductor-memristor integrated circuits: Design choices, challenges, and perspectives. Advanced Intelligent Systems 2, 2000115 (2020).
  15. Rahimi Azghadi, M. et al. Complementary metal-oxide semiconductor and memristive hardware for neuromorphic computing. Advanced Intelligent Systems 2, 1900189 (2020).
  16. Neuromorphic electronic circuits for building autonomous cognitive systems. Proceedings of the IEEE 102, 1367–1388 (2014).
  17. Covi, E. et al. Adaptive extreme edge computing for wearable devices. Frontiers in Neuroscience 429 (2021).
  18. Christensen, D. V. et al. 2022 roadmap on neuromorphic computing and engineering. Neuromorphic Computing and Engineering 2, 022501 (2022).
  19. Synaptic electronics: materials, devices and applications. Nanotechnology 24, 382001 (2013).
  20. Emerging neuromorphic devices. Nanotechnology 31, 092001 (2019).
  21. Du, C. et al. Reservoir computing using dynamic memristors for temporal information processing. Nature communications 8, 1–10 (2017).
  22. Midya, R. et al. Reservoir computing using diffusive memristors. Advanced Intelligent Systems 1, 1900084 (2019).
  23. Zhong, Y. et al. Dynamic memristor-based reservoir computing for high-efficiency temporal signal processing. Nature communications 12, 1–9 (2021).
  24. Wang, W. et al. Neuromorphic motion detection and orientation selectivity by volatile resistive switching memories. Advanced Intelligent Systems 3, 2000224 (2021).
  25. Covi, E. et al. Switching dynamics of ag-based filamentary volatile resistive switching devices—part i: Experimental characterization. IEEE Transactions on Electron Devices 68, 4335–4341 (2021).
  26. Wang, W. et al. Volatile resistive switching memory based on ag ion drift/diffusion part i: Numerical modeling. IEEE Transactions on Electron Devices 66, 3795–3801 (2019).
  27. Wang, W. et al. Volatile resistive switching memory based on ag ion drift/diffusion—part ii: Compact modeling. IEEE Transactions on Electron Devices 66, 3802–3808 (2019).
  28. Wang, W. et al. Switching dynamics of ag-based filamentary volatile resistive switching devices—part ii: Mechanism and modeling. IEEE Transactions on Electron Devices 68, 4342–4349 (2021).
  29. Wang, Z. et al. Memristors with diffusive dynamics as synaptic emulators for neuromorphic computing. Nature Materials 16, 101–108 (2016).
  30. Li, Y. et al. High-uniformity threshold switching hfo22{}_{2}start_FLOATSUBSCRIPT 2 end_FLOATSUBSCRIPT-based selectors with patterned ag nanodots. Advanced Science 7, 2002251 (2020).
  31. Effect of the threshold kinetics on the filament relaxation behavior of ag-based diffusive memristors. Advanced Functional Materials 32, 2111242 (2021).
  32. Wang, R. et al. Recent advances of volatile memristors: Devices, mechanisms, and applications. Advanced Intelligent Systems 2, 2000055 (2020).
  33. Artificial working memory constructed by planar 2d channel memristors enabling brain-inspired hierarchical memory systems. Advanced Intelligent Systems 4, 2100119 (2022).
  34. Palimpsest memories stored in memristive synapses. Science Advances 8, eabn7920 (2022).
  35. Zucker, R. S. Short-term synaptic plasticity. Annual review of neuroscience 12, 13–31 (1989).
  36. Neural networks with dynamic synapses. Neural computation 10, 821–835 (1998).
  37. Noisy synaptic conductance: Bug or a feature? Trends in Neurosciences 43, 363–372 (2020).
  38. Borst, J. G. G. The low synaptic release probability in vivo. Trends in neurosciences 33, 259–266 (2010).
  39. Jensen, T. P. et al. Multiplex imaging relates quantal glutamate release to presynaptic ca2+ homeostasis at multiple synapses in situ. Nature communications 10, 1–14 (2019).
  40. Synaptic vesicle pools are a major hidden resting metabolic burden of nerve terminals. Science Advances 7, eabi9027 (2021).
  41. Maass, W. Noise as a resource for computation and learning in networks of spiking neurons. Proceedings of the IEEE 102, 860–880 (2014).
  42. Bricalli, A. et al. Resistive Switching Device Technology Based on Silicon Oxide for Improved ON–OFF Ratio—Part I: Memory Devices. IEEE Transactions on Electron Devices 65, 115–121 (2018).
  43. Neuronal dynamics: From single neurons to networks and models of cognition (Cambridge University Press, 2014).
  44. Peyser, A. et al. NEST 2.14.0 (2017). URL https://doi.org/10.5281/zenodo.882971.
Citations (2)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now