2000 character limit reached
Realtime Facial Expression Recognition: Neuromorphic Hardware vs. Edge AI Accelerators (2403.08792v1)
Published 30 Jan 2024 in cs.CV, cs.LG, cs.NE, and cs.PF
Abstract: The paper focuses on real-time facial expression recognition (FER) systems as an important component in various real-world applications such as social robotics. We investigate two hardware options for the deployment of FER ML models at the edge: neuromorphic hardware versus edge AI accelerators. Our study includes exhaustive experiments providing comparative analyses between the Intel Loihi neuromorphic processor and four distinct edge platforms: Raspberry Pi-4, Intel Neural Compute Stick (NSC), Jetson Nano, and Coral TPU. The results obtained show that Loihi can achieve approximately two orders of magnitude reduction in power dissipation and one order of magnitude energy savings compared to Coral TPU which happens to be the least power-intensive and energy-consuming edge AI accelerator. These reductions in power and energy are achieved while the neuromorphic solution maintains a comparable level of accuracy with the edge accelerators, all within the real-time latency requirements.
- D. Canedo and A. J. R. Neves, “Facial expression recognition using computer vision: A systematic review,” Applied Sciences, vol. 9, no. 21, 2019. [Online]. Available: https://www.mdpi.com/2076-3417/9/21/4678
- S. Ramis, J. M. Buades, and F. J. Perales, “Using a social robot to evaluate facial expressions in the wild,” Sensors, vol. 20, no. 23, 2020.
- S. McCullough, K. Emmorey, and M. Sereno, “Neural organization for recognition of grammatical and emotional facial expressions in deaf asl signers and hearing nonsigners,” Cognitive Brain Research, vol. 22, no. 2, pp. 193–203, 2005.
- M. P. Véstias, “A survey of convolutional neural networks on edge with reconfigurable computing,” Algorithms, vol. 12, no. 8, 2019.
- D. Baymurzina, E. Golikov, and M. Burtsev, “A review of neural architecture search,” Neurocomputing, vol. 474, pp. 82–93, 2022.
- M. Mohammadi, H. Smith, L. Khan, and R. Zand, “Facial expression recognition at the edge: Cpu vs gpu vs vpu vs tpu,” in Proceedings of the Great Lakes Symposium on VLSI 2023, New York, NY, USA, 2023, p. 243–248.
- S. Gupta and B. Akin, “Accelerator-aware neural network design using automl,” arXiv preprint arXiv:2003.02838, 2020.
- B. C. Reidy, M. Mohammadi, M. E. Elbtity, and R. Zand, “Efficient deployment of transformer models on edge tpu accelerators: A real system evaluation,” in Architecture and System Support for Transformer Models (ASSYST@ ISCA 2023), 2023.
- J. L. Lobo, J. Del Ser, A. Bifet, and N. Kasabov, “Spiking neural networks and online learning: An overview and perspectives,” Neural Networks, vol. 121, pp. 88–100, 2020.
- C. D. Schuman, S. R. Kulkarni, M. Parsa, J. P. Mitchell, B. Kay et al., “Opportunities for neuromorphic computing algorithms and applications,” Nature Computational Science, vol. 2, no. 1, pp. 10–19, 2022.
- M. Mohammadi, P. Chandarana, J. Seekings, S. Hendrix, and R. Zand, “Static hand gesture recognition for american sign language using neuromorphic hardware,” Neuromorphic Computing and Engineering, vol. 2, no. 4, p. 044005, 2022.
- M. Davies, A. Wild, G. Orchard, Y. Sandamirskaya, G. A. F. Guerra, P. Joshi, P. Plank, and S. R. Risbud, “Advancing neuromorphic computing with loihi: A survey of results and outlook,” Proceedings of the IEEE, vol. 109, no. 5, pp. 911–934, 2021.
- M. Davies, “Lessons from loihi: Progress in neuromorphic computing,” in 2021 Symposium on VLSI Circuits, 2021, pp. 1–2.
- M. Davies, N. Srinivasa, T. Lin, G. Chinya, Y. Cao, S. H. Choday, G. Dimou, P. Joshi, N. Imam, S. Jain, Y. Liao, C. Lin, A. Lines, R. Liu, D. Mathaikutty, S. McCoy, A. Paul, J. Tse, G. Venkataramanan, Y. Weng, A. Wild, Y. Yang, and H. Wang, “Loihi: A neuromorphic manycore processor with on-chip learning,” IEEE Micro, vol. 38, no. 1, pp. 82–99, 1 2018.
- J. Bergstra, B. Komer, C. Eliasmith, D. Yamins, and D. D. Cox, “Hyperopt: a python library for model selection and hyperparameter optimization,” Computational Science & Discovery, vol. 8, no. 1, p. 014008, 2015.
- K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” arXiv preprint arXiv:1409.1556, 2014.
- P. Chandarana, J. Ou, and R. Zand, “An adaptive sampling and edge detection approach for encoding static images for spiking neural networks,” in 2021 12th International Green and Sustainable Computing Conference (IGSC), 2021, pp. 1–8.
- B. Rueckauer, I.-A. Lungu, Y. Hu, M. Pfeiffer, and S.-C. Liu, “Conversion of continuous-valued deep networks to efficient event-driven networks for image classification,” Frontiers in Neuroscience, vol. 11, 2017.
- R. Ayachi, M. Afif, Y. Said, and M. Atri, “Strided convolution instead of max pooling for memory efficiency of convolutional neural networks,” in Proceedings of the 8th International Conference on Sciences of Electronics, Technologies of Information and Telecommunications (SETIT’18), Vol. 1. Springer, 2020, pp. 234–243.
- P. Lucey, J. F. Cohn, T. Kanade, J. Saragih, Z. Ambadar, and I. Matthews, “The extended cohn-kanade dataset (ck+): A complete dataset for action unit and emotion-specified expression,” in 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops, 2010, pp. 94–101.
- P. Chandarana, M. Mohammadi, J. Seekings, and R. Zand, “Energy-efficient deployment of machine learning workloads on neuromorphic hardware,” in 2022 IEEE 13th International Green and Sustainable Computing Conference (IGSC), 2022, pp. 1–7.
- T. Bekolay, J. Bergstra, E. Hunsberger, T. DeWolf, T. C. Stewart, D. Rasmussen, X. Choo, A. R. Voelker, and C. Eliasmith, “Nengo: a python tool for building large-scale functional brain models,” Frontiers in neuroinformatics, vol. 7, p. 48, 2014.
- Heath Smith (2 papers)
- James Seekings (4 papers)
- Mohammadreza Mohammadi (15 papers)
- Ramtin Zand (38 papers)