Embedding Hardware Approximations in Discrete Genetic-based Training for Printed MLPs (2402.02930v2)
Abstract: Printed Electronics (PE) stands out as a promisingtechnology for widespread computing due to its distinct attributes, such as low costs and flexible manufacturing. Unlike traditional silicon-based technologies, PE enables stretchable, conformal,and non-toxic hardware. However, PE are constrained by larger feature sizes, making it challenging to implement complex circuits such as ML classifiers. Approximate computing has been proven to reduce the hardware cost of ML circuits such as Multilayer Perceptrons (MLPs). In this paper, we maximize the benefits of approximate computing by integrating hardware approximation into the MLP training process. Due to the discrete nature of hardware approximation, we propose and implement a genetic-based, approximate, hardware-aware training approach specifically designed for printed MLPs. For a 5% accuracy loss, our MLPs achieve over 5x area and power reduction compared to the baseline while outperforming state of-the-art approximate and stochastic printed MLPs.
- N. Bleier, M. Mubarik, F. Rasheed, J. Aghassi-Hagmann, M. B. Tahoori, and R. Kumar, “Printed microprocessors,” in Annu. Int. Symp. Computer Architecture (ISCA), jun 2020, pp. 213–226.
- M. H. Mubarik et al., “Printed machine learning classifiers,” in Annu. Int. Symp. Microarchitecture (MICRO), 2020, pp. 73–87.
- G. Cadilha Marques et al., “Digital power and performance analysis of inkjet printed ring oscillators based on electrolyte-gated oxide electronics,” Applied Physics Letters, vol. 111, no. 10, p. 102103, 2017.
- T. Lei et al., “Low-voltage high-performance flexible digital and analog circuits based on ultrahigh-purity semiconducting carbon nanotubes,” Nature communications, vol. 10, no. 1, p. 2161, 2019.
- G. Armeniakos, G. Zervakis, D. Soudris, M. B. Tahoori, and J. Henkel, “Co-design of approximate multilayer perceptron for ultra-resource constrained printed circuits,” IEEE Trans. Comput., pp. 1–8, 2023.
- G. Armeniakos, G. Zervakis, D. Soudris, M. B. Tahoori, and J. Henkel, “Cross-layer approximation for printed machine learning circuits,” in Design Automation and Test in Europe (DATE), 2022, pp. 190–195.
- G. Armeniakos, G. Zervakis, D. Soudris, M. B. Tahoori, and J. Henkel, “Model-to-circuit cross-approximation for printed machine learning classifiers,” IEEE Trans. Comput.-Aided Design Integr. Circuits Syst., pp. 1–1, 2023.
- A. Kokkinis et al., “Hardware-aware automated neural minimization for printed multilayer perceptrons,” in Design Automation and Test in Europe (DATE), 2023.
- J. Henkel et al., “Approximate computing and the efficient machine learning expedition,” in Int. Conf. on Computer-Aided Design (ICCAD), 2022, pp. 1–9.
- D. D. Weller et al., “Printed stochastic computing neural networks,” in Design Automation and Test in Europe (DATE), 2021, pp. 914–919.
- G. Armeniakos, G. Zervakis, D. Soudris, and J. Henkel, “Hardware approximate techniques for deep neural network accelerators: A survey,” ACM Comput. Surv., vol. 55, no. 4, nov 2022.
- Z. Vasicek and L. Sekanina, “Evolutionary approach to approximate digital circuits design,” IEEE Trans. Evol. Comput., vol. 19, no. 3, pp. 432–444, 2015.
- J. S. Chang, A. F. Facchetti, and R. Reuss, “A circuits and systems perspective of organic/printed electronics: review, challenges, and contemporary and emerging design approaches,” IEEE J. Emerg. Sel. Top. Circuits Syst., vol. 7, no. 1, pp. 7–26, 2017.
- D. Kalyanmoy, P. Amrit, A. Sameer, and T. Meyarivan, “A fast and elitist multiobjective genetic algorithm: Nsga-ii,” IEEE Trans. Evol. Comput., vol. 6, no. 2, pp. 182–197, 2002.
- D. Dua and C. Graff, “UCI machine learning repository,” 2017.
- M. M. H. Shuvo, T. Titirsha, N. Amin, and S. K. Islam, “Energy harvesting in implantable and wearable medical devices for enduring precision healthcare,” Energies, vol. 15, no. 20, p. 7495, 2022.
- C. Marques et al., “Progress Report on “From Printed Electrolyte-Gated Metal-Oxide Devices to Circuits”,” Advanced Materials, vol. 31, 2019.
Sponsor
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.