Papers
Topics
Authors
Recent
Search
2000 character limit reached

HyperSense: Hyperdimensional Intelligent Sensing for Energy-Efficient Sparse Data Processing

Published 4 Jan 2024 in cs.AR and cs.AI | (2401.10267v4)

Abstract: Introducing HyperSense, our co-designed hardware and software system efficiently controls Analog-to-Digital Converter (ADC) modules' data generation rate based on object presence predictions in sensor data. Addressing challenges posed by escalating sensor quantities and data rates, HyperSense reduces redundant digital data using energy-efficient low-precision ADC, diminishing machine learning system costs. Leveraging neurally-inspired HyperDimensional Computing (HDC), HyperSense analyzes real-time raw low-precision sensor data, offering advantages in handling noise, memory-centricity, and real-time learning. Our proposed HyperSense model combines high-performance software for object detection with real-time hardware prediction, introducing the novel concept of Intelligent Sensor Control. Comprehensive software and hardware evaluations demonstrate our solution's superior performance, evidenced by the highest Area Under the Curve (AUC) and sharpest Receiver Operating Characteristic (ROC) curve among lightweight models. Hardware-wise, our FPGA-based domain-specific accelerator tailored for HyperSense achieves a 5.6x speedup compared to YOLOv4 on NVIDIA Jetson Orin while showing up to 92.1% energy saving compared to the conventional system. These results underscore HyperSense's effectiveness and efficiency, positioning it as a promising solution for intelligent sensing and real-time data processing across diverse applications.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (39)
  1. S. Angizi, S. Tabrizchi, and A. Roohi, “Pisa: A binary-weight processing-in-sensor accelerator for edge image processing,” arXiv preprint arXiv:2202.09035, 2022.
  2. Z. Ballard, C. Brown, A. M. Madni, and A. Ozcan, “Machine learning and computation-enabled intelligent sensor design,” Nature Machine Intelligence, vol. 3, no. 7, pp. 556–565, 2021.
  3. J. Becker, M. Huebner, and M. Ullmann, “Power estimation and power measurement of xilinx virtex fpgas: trade-offs and limitations,” in 16th Symposium on Integrated Circuits and Systems Design, 2003. SBCCI 2003. Proceedings.   IEEE, 2003, pp. 283–288.
  4. A. Bochkovskiy, C.-Y. Wang, and H.-Y. M. Liao, “Yolov4: Optimal speed and accuracy of object detection,” arXiv preprint arXiv:2004.10934, 2020.
  5. A. Cano, N. Matsumoto, E. Ping, and M. Imani, “Onlinehd: Robust, efficient, and single-pass online learning using hyperdimensional system,” in Design, Automation & Test in Europe Conference & Exhibition (DATE).   IEEE, 2021.
  6. H. Chen, A. Zakeri, F. Wen, H. E. Barkam, and M. Imani, “Hypergraf: Hyperdimensional graph-based reasoning acceleration on fpga,” in 2023 33rd International Conference on Field-Programmable Logic and Applications (FPL).   IEEE, 2023, pp. 34–41.
  7. A. Dutta, S. Gupta, B. Khaleghi, R. Chandrasekaran, W. Xu, and T. Rosing, “Hdnn-pim: Efficient in memory design of hyperdimensional computing with feature extraction,” in Proceedings of the Great Lakes Symposium on VLSI 2022, 2022, pp. 281–286.
  8. M. Hersche, G. Karunaratne, G. Cherubini, L. Benini, A. Sebastian, and A. Rahimi, “Constrained few-shot class-incremental learning,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 9057–9067.
  9. X. Hou, J. Liu, X. Tang, C. Li, J. Chen, L. Liang, K.-T. Cheng, and M. Guo, “Architecting efficient multi-modal aiot systems,” in Proceedings of the 50th Annual International Symposium on Computer Architecture, 2023, pp. 1–13.
  10. T.-H. Hsu, G.-C. Chen, Y.-R. Chen, R.-S. Liu, C.-C. Lo, K.-T. Tang, M.-F. Chang, and C.-C. Hsieh, “A 0.8 v intelligent vision sensor with tiny convolutional neural network and programmable weights using mixed-mode processing-in-sensor technique for image classification,” IEEE Journal of Solid-State Circuits, 2023.
  11. S.-H. Hwang, K.-M. Kim, S. Kim, and J. W. Kwak, “Lossless data compression for time-series sensor data based on dynamic bit packing,” Sensors, vol. 23, no. 20, p. 8575, 2023.
  12. M. Imani, D. Kong, A. Rahimi, and T. Rosing, “Voicehd: Hyperdimensional computing for efficient speech recognition,” in 2017 IEEE international conference on rebooting computing (ICRC).   IEEE, 2017, pp. 1–8.
  13. M. Imani, Z. Zou, S. Bosch, S. A. Rao, S. Salamat, V. Kumar, Y. Kim, and T. Rosing, “Revisiting hyperdimensional learning for fpga and low-power architectures,” in 2021 IEEE International Symposium on High-Performance Computer Architecture (HPCA).   IEEE, 2021, pp. 221–234.
  14. P. Kanerva, “Hyperdimensional computing: An introduction to computing in distributed representation with high-dimensional random vectors,” Cognitive Computation, 2009.
  15. P. Kanerva, “Hyperdimensional computing: An introduction to computing in distributed representation with high-dimensional vectors,” Cognitive Computation, 2009.
  16. J. Kang, M. Zhou, A. Bhansali, W. Xu, A. Thomas, and T. Rosing, “Relhd: A graph-based learning on fefet with hyperdimensional computing,” in 2022 IEEE 40th International Conference on Computer Design (ICCD).   IEEE, 2022, pp. 553–560.
  17. V. Kathail, “Xilinx vitis unified software platform,” in Proceedings of the 2020 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays, 2020, pp. 173–174.
  18. Y. Kim, M. Imani, N. Moshiri, and T. Rosing, “Geniehd: Efficient dna pattern matching accelerator using hyperdimensional computing,” in 2020 Design, Automation & Test in Europe Conference & Exhibition (DATE).   IEEE, 2020, pp. 115–120.
  19. H. Lee, J. Kim, H. Chen, A. Zeira, N. Srinivasa, M. Imani, and Y. Kim, “Comprehensive integration of hyperdimensional computing with deep learning towards neuro-symbolic ai,” in 2023 60th ACM/IEEE Design Automation Conference (DAC).   IEEE, 2023, pp. 1–6.
  20. D. Li, K. Yao, Z. Gao, Y. Liu, and X. Yu, “Recent progress of skin-integrated electronics for intelligent sensing,” Light: Advanced Manufacturing, vol. 2, no. 1, pp. 39–58, 2021.
  21. W. Li, D. Zhang, Y. Li, Z. Wu, J. Chen, D. Zhang, Y. Hu, Q. Sun, and Y. Chen, “Real-time fall detection using mmwave radar,” in ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).   IEEE, 2022, pp. 16–20.
  22. T. Ma, A. J. Boloor, X. Yang, W. Cao, P. Williams, N. Sun, A. Chakrabarti, and X. Zhang, “Leca: In-sensor learned compressive acquisition for efficient machine vision on the edge,” in Proceedings of the 50th Annual International Symposium on Computer Architecture, 2023, pp. 1–14.
  23. T. Ma, W. Cao, F. Qiao, A. Chakrabarti, and X. Zhang, “Hogeye: neural approximation of hog feature extraction in rram-based 3d-stacked image sensors,” in Proceedings of the ACM/IEEE International Symposium on Low Power Electronics and Design, 2022, pp. 1–6.
  24. T. Ma, Y. Feng, X. Zhang, and Y. Zhu, “Camj: Enabling system-level energy modeling and architectural exploration for in-sensor visual computing,” in Proceedings of the 50th Annual International Symposium on Computer Architecture, 2023, pp. 1–14.
  25. A. Mehonic and A. J. Kenyon, “Brain-inspired computing needs a master plan,” Nature, vol. 604, no. 7905, pp. 255–260, 2022.
  26. R. C. Moioli, P. H. Nardelli, M. T. Barros, W. Saad, A. Hekmatmanesh, P. Gória, A. S. de Sena, M. Dzaferagic, H. Siljak, W. Van Leekwijck et al., “Neurosciences and 6g: Lessons from and needs of communicative brains,” arXiv preprint arXiv:2004.01834, 2020.
  27. Y. Ni, H. Chen, P. Poduval, Z. Zou, P. Mercati, and M. Imani, “Brain-inspired trustworthy hyperdimensional computing with efficient uncertainty quantification,” in 2023 IEEE/ACM International Conference on Computer Aided Design (ICCAD).   IEEE, 2023, pp. 01–09.
  28. I. Nunes, M. Heddes, T. Givargis, A. Nicolau, and A. Veidenbaum, “Graphhd: Efficient graph classification using hyperdimensional computing,” in 2022 Design, Automation & Test in Europe Conference & Exhibition (DATE).   IEEE, 2022, pp. 1485–1490.
  29. M. Sarajlić, L. Liu, and O. Edfors, “When are low resolution adcs energy efficient in massive mimo?” IEEE access, vol. 5, pp. 14 837–14 853, 2017.
  30. S. P. Sarekokku and K. Rajasekhar, “Design and implementation of apb bridge based on amba axi 4.0,” 2012.
  31. R. Selvan, J. Schön, and E. B. Dam, “Operating critical machine learning models in resource constrained regimes,” arXiv preprint arXiv:2303.10181, 2023.
  32. H. E. Sumbul, T. F. Wu, Y. Li, S. S. Sarwar, W. Koven, E. Murphy-Trotzky, X. Cai, E. Ansari, D. H. Morris, H. Liu et al., “System-level design and integration of a prototype ar/vr hardware featuring a custom low-power dnn accelerator chip in 7nm technology for codec avatars,” in 2022 IEEE Custom Integrated Circuits Conference (CICC).   IEEE, 2022, pp. 01–08.
  33. A. Vahdat and J. Kautz, “Nvae: A deep hierarchical variational autoencoder,” Advances in neural information processing systems, vol. 33, pp. 19 667–19 679, 2020.
  34. Y. Wang, G. Wang, H.-M. Hsu, H. Liu, and J.-N. Hwang, “Rethinking of radar’s role: A camera-radar dataset and systematic annotator via coordinate alignment,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 2815–2824.
  35. S. Yun, R. Masukawa, S. Jeong, and M. Imani, “Spatial-aware image retrieval: A hyperdimensional computing approach for efficient similarity hashing,” arXiv preprint arXiv:2404.11025, 2024.
  36. C. Zhao, X. Fu, J. Dong, C. Feng, and H. Chang, “Lpdnet: A lightweight network for sar ship detection based on multi-level laplacian denoising,” Sensors, vol. 23, no. 13, p. 6084, 2023.
  37. F. Zhou and Y. Chai, “Near-sensor and in-sensor computing,” Nature Electronics, vol. 3, no. 11, pp. 664–671, 2020.
  38. Z. Zhou, X. Chen, E. Li, L. Zeng, K. Luo, and J. Zhang, “Edge intelligence: Paving the last mile of artificial intelligence with edge computing,” Proceedings of the IEEE, vol. 107, no. 8, pp. 1738–1762, 2019.
  39. Z. Zou, Y. Kim, F. Imani, H. Alimohamadi, R. Cammarota, and M. Imani, “Scalable edge-based hyperdimensional learning system with brain-like neural adaptation,” in Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, 2021, pp. 1–15.
Citations (5)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up