Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
125 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Memory Efficient Corner Detection for Event-driven Dynamic Vision Sensors (2401.09797v1)

Published 18 Jan 2024 in eess.IV

Abstract: Event cameras offer low-latency and data compression for visual applications, through event-driven operation, that can be exploited for edge processing in tiny autonomous agents. Robust, accurate and low latency extraction of highly informative features such as corners is key for most visual processing. While several corner detection algorithms have been proposed, state-of-the-art performance is achieved by luvHarris. However, this algorithm requires a high number of memory accesses per event, making it less-than ideal for low-latency, low-energy implementation in tiny edge processors. In this paper, we propose a new event-driven corner detection implementation tailored for edge computing devices, which requires much lower memory access than luvHarris while also improving accuracy. Our method trades computation for memory access, which is more expensive for large memories. For a DAVIS346 camera, our method requires ~3.8X less memory, ~36.6X less memory accesses with only ~2.3X more computes.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (20)
  1. P. Lichtsteiner and et. al. A 128× 128 120 dB 15 μ𝜇\muitalic_μs latency asynchronous temporal contrast vision sensor. IEEE Journal On Solid-State Circuits. 43 (2008).
  2. C. Posch, and et. al. Retinomorphic event-based vision sensors: bioinspired cameras with spiking output. Proceedings Of The IEEE. 102 (2014).
  3. X. Zhang and A. Basu. A 91-1220 TOPS/W, 976-1301 GOPS Hybrid In-Memory Computing Based Always-On Image Processing for Neuromorphic Vision Sensors. IEEE Journal Of Solid-State Circuits. 58 (2022).
  4. S.K. Bose and A. Basu. A 389 TOPS/W, always ON region proposal integrated circuit using in-memory computing in 65 nm CMOS. IEEE Journal Of Solid-State Circuits. 58 (2022).
  5. Guillermo Gallego and et. al. Event-based vision: A survey. IEEE Transactions On Pattern Analysis And Machine Intelligence. 44, 154-180 (2020).
  6. Valentina Vasco and et. al. Fast event-based Harris corner detection exploiting the advantages of event-driven cameras. 2016 IEEE/RSJ International Conference On Intelligent Robots And Systems (IROS). pp. 4144-4149 (2016).
  7. Elias Mueggler and et. al. Fast event-based corner detection. 2017 British Machine Vision Conference (BMVC). (2017).
  8. Ignacio Alzugaray and Margarita Chli. Asynchronous corner detection and tracking for event cameras in real time. IEEE Robotics And Automation Letters. 3, 3177-3184 (2018).
  9. Arren Glover and et. al. luvharris: A practical corner detector for event-cameras. IEEE Transactions On Pattern Analysis And Machine Intelligence. 44, 10087-10098 (2021).
  10. A. Gaofalo and et. al. DARKSIDE : A Heterogeneous RISC-V Compute Cluster for Extreme-Edge On-Chip DNN Inference and Training. IEEE Open Journal Of Solid-State Circuits. 2 pp. 231-243 (2022).
  11. C. Harris and et. al. A combined corner and edge detector. Alvey Vision Conference. 15, 10-5244 (1988).
  12. Ryan Benosman and et. al. Event-based visual flow. IEEE Transactions On Neural Networks And Learning Systems. 25, 407-417 (2013).
  13. M. Horowitz. Computing’s energy problem (and what we can do about it). 2014 IEEE International Solid-State Circuits Conference (ISSCC). pp. 10-14 (2014).
  14. X. Si et. al. A Twin-8T SRAM Computation-in-Memory Unit-Macro for Multibit CNN-Based AI Edge Processors. IEEE Journal Of Solid-State Circuits. 55, 189-202 (2020).
  15. Shasha Guo and Tobi Delbruck. Low cost and latency event camera background activity denoising. IEEE Transactions On Pattern Analysis And Machine Intelligence. 45, 785-795 (2022).
  16. S. Thorpe and et. al. Spike-based strategies for rapid processing. Neural Networks. 14 (2001).
  17. Henri Rebecq and et. al. High speed and high dynamic range video with an event camera. IEEE Transactions On Pattern Analysis And Machine Intelligence. 43, 1964-1980 (2019).
  18. Henri Rebecq and et. al. Events-to-video: Bringing modern computer vision to event cameras. Proceedings Of The IEEE/CVF Conference On Computer Vision And Pattern Recognition. pp. 3857-3866 (2019).
  19. Gary Bradski. The openCV library. Dr. Dobb’s Journal: Software Tools For The Professional Programmer. 25, 120-123 (2000).
  20. Jinjian Li and et. al. Asynchronous Event-Based Corner Detection Using Adaptive Time Threshold. IEEE Sensors Journal. (2023).

Summary

We haven't generated a summary for this paper yet.