Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
124 tokens/sec
GPT-4o
8 tokens/sec
Gemini 2.5 Pro Pro
47 tokens/sec
o3 Pro
5 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

HOOD: Real-Time Human Presence and Out-of-Distribution Detection Using FMCW Radar (2308.02396v2)

Published 24 Jul 2023 in eess.SP, cs.CV, and cs.LG

Abstract: Detecting human presence indoors with millimeter-wave frequency-modulated continuous-wave (FMCW) radar faces challenges from both moving and stationary clutter. This work proposes a robust and real-time capable human presence and out-of-distribution (OOD) detection method using 60 GHz short-range FMCW radar. HOOD solves the human presence and OOD detection problems simultaneously in a single pipeline. Our solution relies on a reconstruction-based architecture and works with radar macro and micro range-Doppler images (RDIs). HOOD aims to accurately detect the presence of humans in the presence or absence of moving and stationary disturbers. Since HOOD is also an OOD detector, it aims to detect moving or stationary clutters as OOD in humans' absence and predicts the current scene's output as "no presence." HOOD performs well in diverse scenarios, demonstrating its effectiveness across different human activities and situations. On our dataset collected with a 60 GHz short-range FMCW radar, we achieve an average AUROC of 94.36%. Additionally, our extensive evaluations and experiments demonstrate that HOOD outperforms state-of-the-art (SOTA) OOD detection methods in terms of common OOD detection metrics. Importantly, HOOD also perfectly fits on Raspberry Pi 3B+ with an ARM Cortex-A53 CPU, which showcases its versatility across different hardware environments. Videos of our human presence detection experiments are available at: https://muskahya.github.io/HOOD

Definition Search Book Streamline Icon: https://streamlinehq.com
References (61)
  1. S. Hazra and A. Santra, “Robust gesture recognition using millimetric-wave radar system,” IEEE Sensors Letters, vol. 2, no. 4, pp. 1–4, 2018.
  2. S. Skaria, A. Al-Hourani, M. Lech, and R. J. Evans, “Hand-gesture recognition using two-antenna doppler radar with deep convolutional neural networks,” IEEE Sensors Journal, vol. 19, no. 8, pp. 3041–3048, 2019.
  3. J.-W. Choi, S.-J. Ryu, and J.-H. Kim, “Short-range radar based real-time hand gesture recognition using lstm encoder,” IEEE Access, vol. 7, pp. 33610–33618, 2019.
  4. T. Stadelmayer, Y. Hassab, L. Servadei, A. Santra, R. Weigel, and F. Lurz, “Light-weight and person-independent radar-based hand gesture recognition for classification and regression of continuous gestures,” IEEE Internet of Things Journal, pp. 1–1, 2023.
  5. M. Alizadeh, G. Shaker, J. C. M. D. Almeida, P. P. Morita, and S. Safavi-Naeini, “Remote monitoring of human vital signs using mm-wave fmcw radar,” IEEE Access, vol. 7, pp. 54958–54968, 2019.
  6. E. Turppa, J. M. Kortelainen, O. Antropov, and T. Kiuru, “Vital sign monitoring using fmcw radar in various sleeping scenarios,” Sensors, vol. 20, p. 6505, Nov 2020.
  7. M. Arsalan, A. Santra, and C. Will, “Improved contactless heartbeat estimation in fmcw radar via kalman filter tracking,” IEEE Sensors Letters, vol. 4, no. 5, pp. 1–4, 2020.
  8. P. Vaishnav and A. Santra, “Continuous human activity classification with unscented kalman filter tracking using fmcw radar,” IEEE Sensors Letters, vol. 4, no. 5, pp. 1–4, 2020.
  9. A. Shrestha, H. Li, J. Le Kernec, and F. Fioranelli, “Continuous human activity classification from fmcw radar with bi-lstm networks,” IEEE Sensors Journal, vol. 20, no. 22, pp. 13607–13619, 2020.
  10. T. Stadelmayer, M. Stadelmayer, A. Santra, R. Weigel, and F. Lurz, “Human activity classification using mm-wave fmcw radar by improved representation learning,” in Proceedings of the 4th ACM Workshop on Millimeter-Wave Networks and Sensing Systems, mmNets’20, (New York, NY, USA), Association for Computing Machinery, 2020.
  11. C. Y. Aydogdu, S. Hazra, A. Santra, and R. Weigel, “Multi-modal cross learning for improved people counting using short-range fmcw radar,” in 2020 IEEE International Radar Conference (RADAR), pp. 250–255, 2020.
  12. J. Weiß, R. Pérez, and E. Biebl, “Improved people counting algorithm for indoor environments using 60 ghz fmcw radar,” in 2020 IEEE Radar Conference (RadarConf20), pp. 1–6, 2020.
  13. L. Servadei, H. Sun, J. Ott, M. Stephan, S. Hazra, T. Stadelmayer, D. S. Lopera, R. Wille, and A. Santra, “Label-aware ranked loss for robust people counting using automotive in-cabin radar,” in ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 3883–3887, 2022.
  14. S. M. Kahya, M. Sami Yavuz, and E. Steinbach, “Mcrood: Multi-class radar out-of-distribution detection,” in ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1–5, 2023.
  15. H. Wang, Z. Li, L. Feng, and W. Zhang, “Vim: Out-of-distribution with virtual-logit matching,” arXiv, 2022.
  16. X. Du, Z. Wang, M. Cai, and Y. Li, “Vos: Learning what you don’t know by virtual outlier synthesis,” in International Conference on Learning Representations (ICLR), 2022.
  17. J. Yang, H. Wang, L. Feng, X. Yan, H. Zheng, W. Zhang, and Z. Liu, “Semantically coherent out-of-distribution detection,” in IEEE International Conference on Computer Vision (ICCV), 2021.
  18. R. Huang and Y. Li, “Mos: Towards scaling out-of-distribution detection for large semantic space,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
  19. J. Yang, K. Zhou, and Z. Liu, “Full-spectrum out-of-distribution detection,” arXiv, 2022.
  20. C. Will, P. Vaishnav, A. Chakraborty, and A. Santra, “Human target detection, tracking, and classification using 24-ghz fmcw radar,” IEEE Sensors Journal, vol. 19, no. 17, pp. 7283–7299, 2019.
  21. M. Pavan, A. Caltabiano, and M. Roveri, “Tinyml for uwb-radar based presence detection,” in 2022 International Joint Conference on Neural Networks (IJCNN), pp. 1–8, 2022.
  22. D. Deiana, E. Suijker, R. Bolt, A. Maas, W. J. Vlothuizen, and A. Kossen, “Real time indoor presence detection with a novel radar on a chip,” in 2014 International Radar Conference, pp. 1–4, 2014.
  23. A. Santra, R. V. Ulaganathan, and T. Finke, “Short-range millimetric-wave radar system for occupancy sensing application,” IEEE Sensors Letters, vol. 2, no. 3, pp. 1–4, 2018.
  24. N. Regev and D. Wulich, “Radar-based, simultaneous human presence detection and breathing rate estimation,” Sensors, vol. 21, p. 3529, May 2021.
  25. S. Chang, N. Mitsumoto, and J. W. Burdick, “An algorithm for uwb radar-based human detection,” in 2009 IEEE Radar Conference, pp. 1–6, 2009.
  26. S. Chang, M. Wolf, and J. W. Burdick, “Human detection and tracking via ultra-wideband (uwb) radar,” in 2010 IEEE International Conference on Robotics and Automation, pp. 452–457, 2010.
  27. J.-E. Kim, J.-H. Choi, and K.-T. Kim, “Robust detection of presence of individuals in an indoor environment using ir-uwb radar,” IEEE Access, vol. 8, pp. 108133–108147, 2020.
  28. P. Nallabolu, L. Zhang, H. Hong, and C. Li, “Human presence sensing and gesture recognition for smart home applications with moving and stationary clutter suppression using a 60-ghz digital beamforming fmcw radar,” IEEE Access, vol. 9, pp. 72857–72866, 2021.
  29. D. Hendrycks and K. Gimpel, “A baseline for detecting misclassified and out-of-distribution examples in neural networks,” Proceedings of International Conference on Learning Representations, 2017.
  30. S. Liang, Y. Li, and R. Srikant, “Enhancing the reliability of out-of-distribution image detection in neural networks,” in International Conference on Learning Representations, 2018.
  31. B. Lakshminarayanan, A. Pritzel, and C. Blundell, “Simple and scalable predictive uncertainty estimation using deep ensembles,” in Advances in Neural Information Processing Systems, vol. 30, Curran Associates, Inc., 2017.
  32. W. Liu, X. Wang, J. Owens, and Y. Li, “Energy-based out-of-distribution detection,” in Advances in Neural Information Processing Systems, vol. 33, pp. 21464–21475, Curran Associates, Inc., 2020.
  33. K. Lee, K. Lee, H. Lee, and J. Shin, “A simple unified framework for detecting out-of-distribution samples and adversarial attacks,” in Proceedings of the 32nd International Conference on Neural Information Processing Systems, NIPS’18, (Red Hook, NY, USA), p. 7167–7177, Curran Associates Inc., 2018.
  34. C. S. Sastry and S. Oore, “Detecting out-of-distribution examples with Gram matrices,” in Proceedings of the 37th International Conference on Machine Learning, vol. 119 of Proceedings of Machine Learning Research, pp. 8491–8501, PMLR, 13–18 Jul 2020.
  35. J. Ren, S. Fort, J. Liu, A. G. Roy, S. Padhy, and B. Lakshminarayanan, “A simple fix to mahalanobis distance for improving near-ood detection,” ICML workshop on Uncertainty and Robustness in Deep Learning, 2021.
  36. D. Hendrycks, S. Basart, M. Mazeika, A. Zou, J. Kwon, M. Mostajabi, J. Steinhardt, and D. Song, “Scaling out-of-distribution detection for real-world settings,” International Conference on Machine Learning (ICML), 2022.
  37. Y. Sun, C. Guo, and Y. Li, “React: Out-of-distribution detection with rectified activations,” in Advances in Neural Information Processing Systems (NeurIPS), 2021.
  38. Y. Sun and Y. Li, “Dice: Leveraging sparsification for out-of-distribution detection,” in European Conference on Computer Vision (ECCV), 2022.
  39. H. Huang, Z. Li, L. Wang, S. Chen, B. Dong, and X. Zhou, “Feature space singularity for out-of-distribution detection,” in Proceedings of the Workshop on Artificial Intelligence Safety 2021 (SafeAI 2021), 2021.
  40. Y. Sun, Y. Ming, X. Zhu, and Y. Li, “Out-of-distribution detection with deep nearest neighbors,” in International Conference on Machine Learning (ICML), 2022.
  41. Y. C. Hsu, Y. Shen, H. Jin, and Z. Kira, “Generalized odin: Detecting out-of-distribution image without learning from out-of-distribution data,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
  42. D. Hendrycks, M. Mazeika, and T. Dietterich, “Deep anomaly detection with outlier exposure,” in International Conference on Learning Representations (ICLR), 2019.
  43. A.-A. Papadopoulos, M. R. Rajati, N. Shaikh, and J. Wang, “Outlier exposure with confidence control for out-of-distribution detection,” Neurocomputing, vol. 441, pp. 138–150, 2021.
  44. K. Lee, H. Lee, K. Lee, and J. Shin, “Training confidence-calibrated classifiers for detecting out-of-distribution samples,” arXiv, 2017.
  45. Q. Yu and K. Aizawa, “Unsupervised out-of-distribution detection by maximum classifier discrepancy,” in IEEE/CVF International Conference on Computer Vision (ICCV), 2019.
  46. Y. Ming, Y. Fan, and Y. Li, “Poem: Out-of-distribution detection with posterior sampling,” International Conference on Machine Learning (ICML), 2022.
  47. R. Huang, A. Geng, and Y. Li, “On the importance of gradients for detecting distributional shifts in the wild,” in Advances in Neural Information Processing Systems, 2021.
  48. T. Denouden, R. Salay, K. Czarnecki, V. Abdelzad, B. Phan, and S. Vernekar, “Improving reconstruction autoencoder out-of-distribution detection with mahalanobis distance,” arXiv, 2018.
  49. Z. Xiao, Q. Yan, and Y. Amit, “Likelihood regret: An out-of-distribution detection score for variational auto-encoder,” in Advances in Neural Information Processing Systems, vol. 33, pp. 20685–20696, Curran Associates, Inc., 2020.
  50. A. R. Venkatakrishnan, S. T. Kim, R. Eisawy, F. Pfister, and N. Navab, “Self-supervised out-of-distribution detection in brain ct scans,” arXiv, 2020.
  51. D. Hendrycks, X. Liu, E. Wallace, A. Dziedzic, R. Krishnan, and D. Song, “Pretrained transformers improve out-of-distribution robustness,” arXiv, 2020.
  52. S. Fort, J. Ren, and B. Lakshminarayanan, “Exploring the limits of out-of-distribution detection,” arXiv, 2021.
  53. R. Koner, P. Sinhamahapatra, K. Roscher, S. Günnemann, and V. Tresp, “Oodformer: Out-of-distribution detection transformer,” arXiv, 2021.
  54. A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gelly, J. Uszkoreit, and N. Houlsby, “An image is worth 16x16 words: Transformers for image recognition at scale,” arXiv, 2020.
  55. J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “Bert: Pre-training of deep bidirectional transformers for language understanding,” arXiv, 2018.
  56. S. M. Kahya, M. S. Yavuz, and E. Steinbach, “Reconstruction-based out-of-distribution detection for short-range fmcw radar,” arXiv, 2023.
  57. J.-W. Choi, C.-W. Park, and J.-H. Kim, “Fmcw radar-based real-time hand gesture recognition system capable of out-of-distribution detection,” IEEE Access, vol. 10, pp. 87425–87434, 2022.
  58. M. Bauw, S. Velasco-Forero, J. Angulo, C. Adnet, and O. Airiau, “Near out-of-distribution detection for low-resolution radar micro-doppler signatures,” arXiv, 2022.
  59. J. Ott, L. Servadei, G. Mauro, T. Stadelmayer, A. Santra, and R. Wille, “Uncertainty-based meta-reinforcement learning for robust radar tracking,” ICMLA, 2022.
  60. D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980, 2014.
  61. K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now