Papers
Topics
Authors
Recent
Search
2000 character limit reached

GDTM: An Indoor Geospatial Tracking Dataset with Distributed Multimodal Sensors

Published 21 Feb 2024 in cs.RO, cs.LG, and eess.SP | (2402.14136v1)

Abstract: Constantly locating moving objects, i.e., geospatial tracking, is essential for autonomous building infrastructure. Accurate and robust geospatial tracking often leverages multimodal sensor fusion algorithms, which require large datasets with time-aligned, synchronized data from various sensor types. However, such datasets are not readily available. Hence, we propose GDTM, a nine-hour dataset for multimodal object tracking with distributed multimodal sensors and reconfigurable sensor node placements. Our dataset enables the exploration of several research problems, such as optimizing architectures for processing multimodal data, and investigating models' robustness to adverse sensing conditions and sensor placement variances. A GitHub repository containing the code, sample data, and checkpoints of this work is available at https://github.com/nesl/GDTM.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (25)
  1. Seeing through fog without seeing fog: Deep multimodal sensor fusion in unseen adverse weather. In Proceedings of the IEEE/CVF CVPR. 11682–11692.
  2. OPERAnet, a multimodal activity recognition dataset acquired from radio frequency and vision-based sensors. Scientific data 9, 1 (2022), 474.
  3. nuscenes: A multimodal dataset for autonomous driving. In Proceedings of the IEEE/CVF CVPR. 11621–11631.
  4. End-to-end object detection with transformers. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part I 16. Springer, 213–229.
  5. MMTracking Contributors. 2020. MMTracking: OpenMMLab video perception toolbox and benchmark. https://github.com/open-mmlab/mmtracking.
  6. MEVA: A Large-Scale Multiview, Multimodal Video Dataset for Activity Detection. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV). 1060–1068.
  7. Gabriela Csurka. 2017. Domain adaptation for visual applications: A comprehensive survey. arXiv preprint arXiv:1702.05374 (2017).
  8. Radar Enlighten the Dark: Enhancing Low-Visibility Perception for Automated Vehicles with Camera-Radar Fusion. arXiv preprint arXiv:2305.17318 (2023).
  9. Multimodal Sensors and ML-Based Data Fusion for Advanced Robots. Advanced Intelligent Systems (2022), 2200213.
  10. Vision meets robotics: The kitti dataset. The International Journal of Robotics Research 32, 11 (2013), 1231–1237.
  11. Mmptrack: Large-scale densely annotated multi-camera multiple people tracking benchmark. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. 4860–4869.
  12. Multi-modal sensor fusion for auto driving perception: A survey. arXiv preprint arXiv:2202.02703 (2022).
  13. Vijay John and Yasutomo Kawanishi. 2022. A Multimodal Sensor Fusion Framework Robust to Missing Modalities for Person Recognition. In Proceedings of the 4th ACM International Conference on Multimedia in Asia. 1–5.
  14. A ConvNet for the 2020s. Proceedings of the IEEE/CVF CVPR (CVPR) (2022).
  15. One million scenes for autonomous driving: Once dataset. arXiv:2106.11037 (2021).
  16. Conditional detr for fast training convergence. In Proceedings of the IEEE/CVF ICCV. 3651–3660.
  17. A large-scale benchmark dataset for event recognition in surveillance video. In CVPR 2011. IEEE, 3153–3160.
  18. StreetAware: A High-Resolution Synchronized Multimodal Urban Scene Dataset. Sensors 23, 7 (2023), 3710.
  19. Multimodal sensor fusion in the latent representation space. Scientific Reports 13, 1 (2023), 2005.
  20. Heteroskedastic Geospatial Tracking with Distributed Camera Networks. In Uncertainty in Artificial Intelligence. PMLR.
  21. Indoor Location Competition 2.0 Dataset. https://www.microsoft.com/en-us/research/publication/indoor-location-competition-2-0-dataset/
  22. A Benchmark for the Evaluation of RGB-D SLAM Systems. In Proc. of the International Conference on Intelligent Robot Systems (IROS).
  23. Scalability in perception for autonomous driving: Waymo open dataset. In Proceedings of the IEEE/CVF CVPR. 2446–2454.
  24. Person recognition based on micro-Doppler and thermal infrared camera fusion for firefighting. In 2018 21st International Conference on Information Fusion (FUSION). IEEE, 919–926.
  25. A survey of indoor localization systems and technologies. IEEE Communications Surveys & Tutorials 21, 3 (2019), 2568–2599.
Citations (1)

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.