Building time-surfaces by exploiting the complex volatility of an ECRAM memristor (2201.12673v2)
Abstract: Memristors have emerged as a promising technology for efficient neuromorphic architectures owing to their ability to act as programmable synapses, combining processing and memory into a single device. Although they are most commonly used for static encoding of synaptic weights, recent work has begun to investigate the use of their dynamical properties, such as Short Term Plasticity (STP), to integrate events over time in event-based architectures. However, we are still far from completely understanding the range of possible behaviors and how they might be exploited in neuromorphic computation. This work focuses on a newly developed Li$\textbf{x}$WO$\textbf{3}$-based three-terminal memristor that exhibits tunable STP and a conductance response modeled by a double exponential decay. We derive a stochastic model of the device from experimental data and investigate how device stochasticity, STP, and the double exponential decay affect accuracy in a hierarchy of time-surfaces (HOTS) architecture. We found that the device's stochasticity does not affect accuracy, that STP can reduce the effect of salt and pepper noise in signals from event-based sensors, and that the double exponential decay improves accuracy by integrating temporal information over multiple time scales. Our approach can be generalized to study other memristive devices to build a better understanding of how control over temporal dynamics can enable neuromorphic engineers to fine-tune devices and architectures to fit their problems at hand.
- H. A. Pierson and M. S. Gashler, “Deep learning in robotics: a review of recent research,” Advanced Robotics, vol. 31, no. 16, pp. 821–835, 2017. [Online]. Available: https://doi.org/10.1080/01691864.2017.1365009
- J. Hoffmann, S. Borgeaud, A. Mensch, E. Buchatskaya, T. Cai, E. Rutherford, D. d. L. Casas, L. A. Hendricks, J. Welbl, A. Clark et al., “Training compute-optimal large language models,” arXiv preprint arXiv:2203.15556, 2022.
- C. D. Schuman, T. E. Potok, R. M. Patton, J. D. Birdwell, M. E. Dean, G. S. Rose, and J. S. Plank, “A survey of neuromorphic computing and neural networks in hardware,” arXiv preprint arXiv:1705.06963, 2017.
- P. Lichtsteiner, C. Posch, and T. Delbruck, “A 128 x 128 120db 30mw asynchronous vision sensor that responds to relative intensity change,” in 2006 IEEE International Solid State Circuits Conference-Digest of Technical Papers. IEEE, 2006, pp. 2060–2069.
- D. Kuzum, R. G. D. Jeyasingh, and H. . P. Wong, “Energy efficient programming of nanoelectronic synaptic devices for large-scale implementation of associative and temporal sequence learning,” in 2011 International Electron Devices Meeting, 2011, pp. 30.3.1–30.3.4.
- M. Suri, O. Bichler, D. Querlioz, O. Cueto, L. Perniola, V. Sousa, D. Vuillaume, C. Gamrat, and B. DeSalvo, “Phase change memory as synapse for ultra-dense neuromorphic systems: Application to complex visual pattern extraction,” in 2011 International Electron Devices Meeting. IEEE, 2011, pp. 4–4.
- S. Ambrogio, S. Balatti, F. Nardi, S. Facchinetti, and D. Ielmini, “Spike-timing dependent plasticity in a transistor-selected resistive switching memory,” Nanotechnology, vol. 24, no. 38, p. 384012, 9 2013. [Online]. Available: https://doi.org/10.1088%2F0957-4484%2F24%2F38%2F384012
- S. B. Eryilmaz, D. Kuzum, R. Jeyasingh, S. Kim, M. BrightSky, C. Lam, and H.-S. P. Wong, “Brain-like associative learning using a nanoscale non-volatile phase change synaptic device array,” Frontiers in Neuroscience, vol. 8, p. 205, 2014. [Online]. Available: https://www.frontiersin.org/article/10.3389/fnins.2014.00205
- A. F. Vincent, J. Larroque, N. Locatelli, N. Ben Romdhane, O. Bichler, C. Gamrat, W. S. Zhao, J. Klein, S. Galdin-Retailleau, and D. Querlioz, “Spin-transfer torque magnetic memory as a stochastic memristive synapse for neuromorphic systems,” IEEE Transactions on Biomedical Circuits and Systems, vol. 9, no. 2, pp. 166–174, 2015.
- Y. Jeong, J. Lee, J. Moon, J. H. Shin, and W. D. Lu, “K-means data clustering with memristor networks,” Nano Letters, vol. 18, no. 7, pp. 4447–4453, 2018, pMID: 29879355. [Online]. Available: https://doi.org/10.1021/acs.nanolett.8b01526
- Z. Wang, S. Joshi, S. Savel’ev, W. Song, R. Midya, Y. Li, M. Rao, P. Yan, S. Asapu, Y. Zhuo et al., “Fully memristive neural networks for pattern classification with unsupervised learning,” Nature Electronics, vol. 1, no. 2, pp. 137–145, 2018.
- Q. Xia and J. J. Yang, “Memristive crossbar arrays for brain-inspired computing,” Nature Materials, vol. 18, pp. 309–323, 4 2019.
- Q. Wan, M. T. Sharbati, J. R. Erickson, Y. Du, and F. Xiong, “Emerging artificial synaptic devices for neuromorphic computing,” Advanced Materials Technologies, vol. 4, p. 1900037, 4 2019.
- R. Yang, K. Terabe, Y. Yao, T. Tsuruoka, T. Hasegawa, J. K. Gimzewski, and M. Aono, “Synaptic plasticity and memory functions achieved in a wo3- x-based nanoionics device by using the principle of atomic switch operation,” Nanotechnology, vol. 24, p. 384003, 2013.
- T. Ohno, T. Hasegawa, T. Tsuruoka, K. Terabe, J. K. Gimzewski, and M. Aono, “Short-term plasticity and long-term potentiation mimicked in single inorganic synapses,” Nature materials, vol. 10, pp. 591–595, 2011.
- R. Berdan, E. Vasilaki, A. Khiat, G. Indiveri, A. Serb, and T. Prodromakis, “Emulating short-term synaptic dynamics with memristive devices,” Scientific reports, vol. 6, pp. 1–9, 2016.
- M. T. Sharbati, Y. Du, J. Torres, N. D. Ardolino, M. Yun, and F. Xiong, “Low-power, electrochemically tunable graphene synapses for neuromorphic computing,” Advanced Materials, vol. 30, no. 36, p. 1802353, 2018.
- J. Zhu, Y. Yang, R. Jia, Z. Liang, W. Zhu, Z. U. Rehman, L. Bao, X. Zhang, Y. Cai, L. Song et al., “Ion gated synaptic transistors based on 2d van der waals crystals with tunable diffusive dynamics,” Advanced Materials, vol. 30, no. 21, p. 1800195, 2018.
- Q. Hua, H. Wu, B. Gao, Q. Zhang, W. Wu, Y. Li, X. Wang, W. Hu, and H. Qian, “Low‐voltage oscillatory neurons for memristor‐based neuromorphic systems,” Global Challenges, vol. 3, p. 1900015, 11 2019.
- H. Lim, H.-W. Ahn, V. Kornijcuk, G. Kim, J. Y. Seok, I. Kim, C. S. Hwang, and D. S. Jeong, “Relaxation oscillator-realized artificial electronic neurons, their responses, and noise,” Nanoscale, vol. 8, pp. 9629–9640, 2016.
- M. D. Pickett, G. Medeiros-Ribeiro, and R. S. Williams, “A scalable neuristor built with mott memristors,” Nature Materials, vol. 12, pp. 114–117, 2 2013.
- S. H. Sung, T. J. Kim, H. Shin, T. H. Im, and K. J. Lee, “Simultaneous emulation of synaptic and intrinsic plasticity using a memristive synapse,” Nature Communications, vol. 13, p. 2811, 12 2022.
- S. G. Sarwat, B. Kersting, T. Moraitis, V. P. Jonnalagadda, and A. Sebastian, “Phase-change memtransistive synapses for mixed-plasticity neural computations,” Nature Nanotechnology, vol. 17, pp. 507–513, 5 2022.
- Q. Wan, M. Rasetto, M. T. Sharbati, J. R. Erickson, S. R. Velagala, M. T. Reilly, Y. Li, R. Benosman, and F. Xiong, “Low-voltage electrochemical lixwo3 synapses with temporal dynamics for spiking neural networks,” Advanced Intelligent Systems, vol. n/a, p. 2100021, 2021. [Online]. Available: https://onlinelibrary.wiley.com/doi/abs/10.1002/aisy.202100021
- L. Sun, Y. Zhang, G. Hwang, J. Jiang, D. Kim, Y. A. Eshete, R. Zhao, and H. Yang, “Synaptic computation enabled by joule heating of single-layered semiconductors for sound localization,” Nano Letters, vol. 18, pp. 3229–3234, 2018.