Papers
Topics
Authors
Recent
Search
2000 character limit reached

Device-Free Human State Estimation using UWB Multi-Static Radios

Published 26 Dec 2023 in eess.SP, cs.CY, cs.LG, and cs.NI | (2401.05410v1)

Abstract: We present a human state estimation framework that allows us to estimate the location, and even the activities, of people in an indoor environment without the requirement that they carry a specific devices with them. To achieve this "device free" localization we use a small number of low-cost Ultra-Wide Band (UWB) sensors distributed across the environment of interest. To achieve high quality estimation from the UWB signals merely reflected of people in the environment, we exploit a deep network that can learn to make inferences. The hardware setup consists of commercial off-the-shelf (COTS) single antenna UWB modules for sensing, paired with Raspberry PI units for computational processing and data transfer. We make use of the channel impulse response (CIR) measurements from the UWB sensors to estimate the human state - comprised of location and activity - in a given area. Additionally, we can also estimate the number of humans that occupy this region of interest. In our approach, first, we pre-process the CIR data which involves meticulous aggregation of measurements and extraction of key statistics. Afterwards, we leverage a convolutional deep neural network to map the CIRs into precise location estimates with sub-30 cm accuracy. Similarly, we achieve accurate human activity recognition and occupancy counting results. We show that we can quickly fine-tune our model for new out-of-distribution users, a process that requires only a few minutes of data and a few epochs of training. Our results show that UWB is a promising solution for adaptable smart-home localization and activity recognition problems.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (41)
  1. P.-Y. Lajoie, B. H. Baghi, S. Herath, F. Hogan, X. Liu, and G. Dudek, “PEOPLEx: PEdestrian Opportunistic Positioning LEveraging IMU, UWB, BLE and WiFi,” Nov. 2023.
  2. C. Wang and J. Yan, “A comprehensive survey of rgb-based and skeleton-based human action recognition,” IEEE Access, vol. 11, pp. 53 880–53 898, 2023.
  3. F. Zafari, A. Gkelias, and K. K. Leung, “A Survey of Indoor Localization Systems and Technologies,” IEEE Communications Surveys & Tutorials, vol. 21, no. 3, pp. 2568–2599, 2019.
  4. J. Li, D. Meger, and G. Dudek, “Semantic mapping for view-invariant relocalization,” in 2019 International Conference on Robotics and Automation (ICRA).   IEEE, 2019, pp. 7108–7115.
  5. C. Stachniss, J. J. Leonard, and S. Thrun, “Simultaneous localization and mapping,” Springer handbook of robotics, pp. 1153–1176, 2016.
  6. D. Marinakis and G. Dudek, “Probabilistic self-localization for sensor networks,” in PROCEEDINGS OF THE NATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE, vol. 21, no. 1.   Menlo Park, CA; Cambridge, MA; London; AAAI Press; MIT Press; 1999, 2006, p. 976.
  7. M. Rao, G. Dudek, and S. Whitesides, “Randomized algorithms for minimum distance localization,” The International Journal of Robotics Research, vol. 26, no. 9, pp. 917–933, 2007.
  8. A. M. Ladd, K. E. Bekris, A. Rudys, G. Marceau, L. E. Kavraki, and D. S. Wallach, “Robotics-based location sensing using wireless ethernet,” in Proceedings of the 8th annual international conference on Mobile computing and networking, 2002, pp. 227–238.
  9. S. Siddiqi, G. S. Sukhatme, and A. Howard, “Experiments in monte-carlo localization using wifi signal strength,” in Proceedings of the International Conference on Advanced Robotics, no. January 2003, 2003, pp. 210–223.
  10. Y. T. Xu, X. Chen, X. Liu, D. Meger, and G. Dudek, “Pressense: Passive respiration sensing via ambient wifi signals in noisy environments,” in 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).   IEEE, 2020, pp. 4032–4039.
  11. X. Chen, H. Li, C. Zhou, X. Liu, D. Wu, and G. Dudek, “Fidora: Robust wifi-based indoor localization via unsupervised domain adaptation,” IEEE Internet of Things Journal, vol. 9, no. 12, pp. 9872–9888, 2022.
  12. ——, “Fido: Ubiquitous fine-grained wifi-based localization for unlabelled users via domain adaptation,” in Proceedings of The Web Conference 2020, 2020, pp. 23–33.
  13. D. Coppens, A. Shahid, S. Lemey, B. Van Herbruggen, C. Marshall, and E. De Poorter, “An overview of uwb standards and organizations (ieee 802.15.4, fira, apple): Interoperability aspects and future research directions,” IEEE Access, vol. 10, pp. 70 219–70 241, 2022.
  14. A. Muqaibel, A. Safaai-Jazi, B. Woerner, and S. Riad, “Uwb channel impulse response characterization using deconvolution techniques,” in The 2002 45th Midwest Symposium on Circuits and Systems, 2002. MWSCAS-2002., vol. 3.   IEEE, 2002, pp. III–605.
  15. R. C. Shit, S. Sharma, D. Puthal, P. James, B. Pradhan, A. v. Moorsel, A. Y. Zomaya, and R. Ranjan, “Ubiquitous localization (ubiloc): A survey and taxonomy on device free localization for smart world,” IEEE Communications Surveys & Tutorials, vol. 21, no. 4, pp. 3532–3564, 2019.
  16. F. Alam, N. Faulkner, and B. Parr, “Device-free localization: A review of non-rf techniques for unobtrusive indoor positioning,” IEEE Internet of Things Journal, vol. 8, no. 6, pp. 4228–4249, 2021.
  17. W. Ruan, Q. Z. Sheng, L. Yao, T. Gu, M. Ruta, and L. Shangguan, “Device-free indoor localization and tracking through human-object interactions,” in 2016 IEEE 17th International Symposium on A World of Wireless, Mobile and Multimedia Networks (WoWMoM), 2016, pp. 1–9.
  18. S. Li, M. Hedley, K. Bengston, D. Humphrey, M. Johnson, and W. Ni, “Passive localization of standard wifi devices,” IEEE Systems Journal, vol. 13, no. 4, pp. 3929–3932, 2019.
  19. Z. Wang, H. Liu, S. Xu, F. Gao, X. Bu, and J. An, “Towards robust and efficient device-free localization using uwb sensor network,” Pervasive and Mobile Computing, vol. 41, pp. 451–469, 2017. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S1574119217301608
  20. S. Jovanoska, R. Zetik, R. Thoma, F. Govaers, K. Wilds, and W. Koch, “Device-free indoor localization using a distributed network of autonomous uwb sensor nodes,” in 2013 Workshop on Sensor Data Fusion: Trends, Solutions, Applications (SDF), 2013, pp. 1–6.
  21. T. Lei, S. Pan, Q. Guang, K. Wang, and Y. Yu, “Enhanced geometric filtering method based device-free localization with uwb wireless network,” IEEE Transactions on Vehicular Technology, vol. 70, no. 8, pp. 7734–7748, 2021.
  22. M. Cimdins, S. O. Schmidt, and H. Hellbrück, “Mampi-uwb—multipath-assisted device-free localization with magnitude and phase information with uwb transceivers,” Sensors, vol. 20, no. 24, 2020. [Online]. Available: https://www.mdpi.com/1424-8220/20/24/7090
  23. C. Li, E. Tanghe, J. Fontaine, L. Martens, J. Romme, G. Singh, E. De Poorter, and W. Joseph, “Multistatic uwb radar-based passive human tracking using cots devices,” IEEE Antennas and Wireless Propagation Letters, vol. 21, no. 4, pp. 695–699, 2022.
  24. S. Sharma, H. Mohammadmoradi, M. Heydariaan, and O. Gnawali, “Device-Free Activity Recognition Using Ultra-Wideband Radios,” in 2019 International Conference on Computing, Networking and Communications (ICNC).   Honolulu, HI, USA: IEEE, Feb. 2019, pp. 1029–1033.
  25. Z. Zhengliang, Y. Degui, Z. Junchao, and T. Feng, “Dataset of human motion status using IR-UWB through-wall radar,” Journal of Systems Engineering and Electronics, vol. 32, no. 5, pp. 1083–1096, Oct. 2021.
  26. K. Bouchard, J. Maitre, C. Bertuglia, and S. Gaboury, “Activity Recognition in Smart Homes using UWB Radars,” Procedia Computer Science, vol. 170, pp. 10–17, Jan. 2020.
  27. V. Lafontaine, K. Bouchard, J. Maítre, and S. Gaboury, “Denoising UWB Radar Data for Human Activity Recognition Using Convolutional Autoencoders,” IEEE Access, vol. 11, pp. 81 298–81 309, 2023.
  28. J. Yang, Y. Xu, H. Cao, H. Zou, and L. Xie, “Deep learning and transfer learning for device-free human activity recognition: A survey,” Journal of Automation and Intelligence, vol. 1, no. 1, p. 100007, Dec. 2022.
  29. L. Cheng, A. Zhao, K. Wang, H. Li, Y. Wang, and R. Chang, “Activity Recognition and Localization based on UWB Indoor Positioning System and Machine Learning,” in 2020 11th IEEE Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON).   Vancouver, BC, Canada: IEEE, Nov. 2020, pp. 0528–0533.
  30. Y. Freund and R. E. Schapire, “A decision-theoretic generalization of on-line learning and an application to boosting,” Journal of Computer and System Sciences, vol. 55, no. 1, pp. 119–139, 1997. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S002200009791504X
  31. F. M. Noori, M. Z. Uddin, and J. Torresen, “Ultra-Wideband Radar-Based Activity Recognition Using Deep Learning,” IEEE Access, vol. 9, pp. 138 132–138 143, 2021.
  32. S. Hochreiter and J. Schmidhuber, “Long short-term memory,” Neural computation, vol. 9, no. 8, pp. 1735–1780, 1997.
  33. Decawave, “DW1000,” [Online]. Available: https://www.decawave.com.
  34. “Raspberry Pi Official Documentation,” [Online]. Available: https://www.raspberrypi.com/documentation/.
  35. N. Abramson, “The system: Another alternative for computer communications,” in Proceedings of the November 17-19, 1970, Fall Joint Computer Conference, ser. AFIPS ’70 (Fall).   New York, NY, USA: Association for Computing Machinery, 1970, p. 281–285. [Online]. Available: https://doi.org/10.1145/1478462.1478502
  36. A. Ledergerber and R. D’Andrea, “A multi-static radar network with ultra-wideband radio-equipped devices,” Sensors, vol. 20, no. 6, 2020. [Online]. Available: https://www.mdpi.com/1424-8220/20/6/1599
  37. S. Macenski, T. Foote, B. Gerkey, C. Lalancette, and W. Woodall, “Robot operating system 2: Design, architecture, and uses in the wild,” Science Robotics, vol. 7, no. 66, p. eabm6074, 2022. [Online]. Available: https://www.science.org/doi/abs/10.1126/scirobotics.abm6074
  38. C. Bedard, P.-Y. Lajoie, G. Beltrame, and M. Dagenais, “Message flow analysis with complex causal links for distributed ros 2 systems,” Robotics and Autonomous Systems, vol. 161, p. 104361, 2023.
  39. P.-Y. Lajoie, C. Bedard, and G. Beltrame, “Analyze, debug, optimize: Real-time tracing for perception and mapping systems in ros 2,” Robotics Perception And Mapping Workshop, ICRA 2022, May 2022.
  40. H. Duan, J. Wang, K. Chen, and D. Lin, “Pyskl: Towards good practices for skeleton action recognition,” in Proceedings of the 30th ACM International Conference on Multimedia, 2022, pp. 7351–7354.
  41. A. Moschevikin, E. Tsvetkov, A. Alekseev, and A. Sikora, “Investigations on passive channel impulse response of ultra wide band signals for monitoring and safety applications,” in 2016 3rd International Symposium on Wireless Systems within the Conferences on Intelligent Data Acquisition and Advanced Computing Systems (IDAACS-SWS), 2016, pp. 97–104.

Summary

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.