OORD: The Oxford Offroad Radar Dataset (2403.02845v2)
Abstract: There is a growing academic interest as well as commercial exploitation of millimetre-wave scanning radar for autonomous vehicle localisation and scene understanding. Although several datasets to support this research area have been released, they are primarily focused on urban or semi-urban environments. Nevertheless, rugged offroad deployments are important application areas which also present unique challenges and opportunities for this sensor technology. Therefore, the Oxford Offroad Radar Dataset (OORD) presents data collected in the rugged Scottish highlands in extreme weather. The radar data we offer to the community are accompanied by GPS/INS reference - to further stimulate research in radar place recognition. In total we release over 90GiB of radar scans as well as GPS and IMU readings by driving a diverse set of four routes over 11 forays, totalling approximately 154km of rugged driving. This is an area increasingly explored in literature, and we therefore present and release examples of recent open-sourced radar place recognition systems and their performance on our dataset. This includes a learned neural network, the weights of which we also release. The data and tools are made freely available to the community at https://oxford-robotics-institute.github.io/oord-dataset.
- K. Harlow, H. Jang, T. D. Barfoot, A. Kim, and C. Heckman, “A new wave in robotics: Survey on recent mmwave radar applications in robotics,” arXiv preprint arXiv:2305.01135, 2023.
- A. Venon, Y. Dupuis, P. Vasseur, and P. Merriaux, “Millimeter wave fmcw radars for perception, recognition and localization in automotive applications: A survey,” IEEE Transactions on Intelligent Vehicles, vol. 7, no. 3, pp. 533–555, 2022.
- S. H. Cen and P. Newman, “Precise ego-motion estimation with millimeter-wave radar under diverse and challenging conditions,” in IEEE International Conference on Robotics and Automation (ICRA), 2018, pp. 6045–6052.
- D. Barnes, R. Weston, and I. Posner, “Masking by moving: Learning distraction-free radar odometry from pose information,” arXiv preprint arXiv:1909.03752, 2019.
- Y. S. Park, Y.-S. Shin, and A. Kim, “Pharao: Direct radar odometry using phase correlation,” in 2020 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2020, pp. 2617–2623.
- P.-C. Kung, C.-C. Wang, and W.-C. Lin, “A normal distribution transform-based radar odometry designed for scanning and automotive radars,” in 2021 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2021, pp. 14 417–14 423.
- K. Burnett, A. P. Schoellig, and T. D. Barfoot, “Do we need to compensate for motion distortion and doppler effects in spinning radar navigation?” IEEE Robotics and Automation Letters, vol. 6, no. 2, pp. 771–778, 2021.
- D. Adolfsson, M. Magnusson, A. Alhashimi, A. J. Lilienthal, and H. Andreasson, “Cfear radarodometry-conservative filtering for efficient and accurate radar odometry,” in 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2021, pp. 5462–5469.
- K. Burnett, D. J. Yoon, A. P. Schoellig, and T. D. Barfoot, “Radar odometry combining probabilistic estimation and unsupervised feature learning,” arXiv preprint arXiv:2105.14152, 2021.
- R. Aldera, M. Gadd, D. De Martini, and P. Newman, “What goes around: Leveraging a constant-curvature motion constraint in radar odometry,” IEEE Robotics and Automation Letters, vol. 7, no. 3, pp. 7865–7872, 2022.
- D. Barnes and I. Posner, “Under the radar: Learning to predict robust keypoints for odometry estimation and metric localisation in radar,” in International Conference on Robotics and Automation (ICRA), 2020.
- H. Yin, Y. Wang, L. Tang, and R. Xiong, “Radar-on-lidar: metric radar localization on prior lidar maps,” in 2020 IEEE International Conference on Real-time Computing and Robotics (RCAR). IEEE, 2020, pp. 1–7.
- H. Yin, R. Chen, Y. Wang, and R. Xiong, “Rall: end-to-end radar localization on lidar map using differentiable measurement model,” IEEE Transactions on Intelligent Transportation Systems, 2021.
- G. Kim, Y. S. Park, Y. Cho, J. Jeong, and A. Kim, “Mulran: Multimodal range dataset for urban place recognition,” in International Conference on Robotics and Automation (ICRA), 2020.
- Ş. Săftescu, M. Gadd, D. De Martini, D. Barnes, and P. Newman, “Kidnapped radar: Topological radar localisation using rotationally-invariant metric learning,” in 2020 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2020, pp. 4358–4364.
- W. Wang, P. P. de Gusmo, B. Yang, A. Markham, and N. Trigoni, “RadarLoc: Learning to Relocalize in FMCW Radar,” in IEEE International Conference on Robotics and Automation (ICRA), 2021.
- H. Yin, X. Xu, Y. Wang, and R. Xiong, “Radar-to-lidar: Heterogeneous place recognition via joint learning,” Frontiers in Robotics and AI, 2021.
- J. Komorowski, M. Wysoczanska, and T. Trzcinski, “Large-scale topological radar localization using learned descriptors,” in Neural Information Processing: 28th International Conference, ICONIP 2021, Sanur, Bali, Indonesia, December 8–12, 2021, Proceedings, Part II 28. Springer, 2021, pp. 451–462.
- M. Gadd, D. De Martini, and P. Newman, “Contrastive learning for unsupervised radar place recognition,” in 2021 20th International Conference on Advanced Robotics (ICAR). IEEE, 2021, pp. 344–349.
- S. Lu, X. Xu, H. Yin, Z. Chen, R. Xiong, and Y. Wang, “One ring to rule them all: Radon sinogram for place recognition, orientation and translation estimation,” in 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2022, pp. 2778–2785.
- K. Cait, B. Wang, and C. X. Lu, “Autoplace: Robust place recognition with single-chip automotive radar,” in 2022 International Conference on Robotics and Automation (ICRA). IEEE, 2022, pp. 2222–2228.
- H. Jang, M. Jung, and A. Kim, “Raplace: Place recognition for imaging radar using radon transform and mutable threshold,” arXiv preprint arXiv:2307.04321, 2023.
- J. Yuan, P. Newman, and M. Gadd, “Off the Radar: Variational Uncertainty-Aware Unsupervised Radar Place Recognition for Introspective Querying and Map Maintenance,” in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2023.
- Z. Hong, Y. Petillot, and S. Wang, “Radarslam: Radar based large-scale slam in all weathers,” in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2020.
- D. Wang, Y. Duan, X. Fan, C. Meng, J. Ji, and Y. Zhang, “Maroam: Map-based radar slam through two-step feature selection,” arXiv preprint arXiv:2210.13797, 2022.
- T. Peynot, S. Scheding, and S. Terho, “The marulan data sets: Multi-sensor perception in a natural environment with challenging conditions,” The International Journal of Robotics Research, vol. 29, no. 13, pp. 1602–1607, 2010.
- D. Barnes, M. Gadd, P. Murcutt, P. Newman, and I. Posner, “The oxford radar robotcar dataset: A radar extension to the oxford robotcar dataset,” in International Conference on Robotics and Automation (ICRA), 2020.
- M. Sheeny, E. De Pellegrin, S. Mukherjee, A. Ahrabian, S. Wang, and A. Wallace, “Radiate: A radar dataset for automotive perception in bad weather,” in 2021 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2021, pp. 1–7.
- K. Burnett, D. J. Yoon, Y. Wu, A. Z. Li, H. Zhang, S. Lu, J. Qian, W.-K. Tseng, A. Lambert, K. Y. Leung et al., “Boreas: A multi-season autonomous driving dataset,” The International Journal of Robotics Research, vol. 42, no. 1-2, pp. 33–42, 2023.
- R. Tagiew, M. Köppel, K. Schwalbe, P. Denzler, P. Neumaier, T. Klockau, M. Boekhoff, P. Klasek, and R. Tilly, “Osdar23: Open sensor data for rail 2023,” arXiv preprint arXiv:2305.03001, 2023.
- M. Gadd, D. De Martini, and P. Newman, “Look around you: Sequence-based radar place recognition with learned rotational invariance,” in 2020 IEEE/ION Position, Location and Navigation Symposium (PLANS). IEEE, 2020, pp. 270–276.
- Z. Hong, Y. Petillot, A. Wallace, and S. Wang, “Radarslam: A robust simultaneous localization and mapping system for all weather conditions,” The International Journal of Robotics Research, 2022.
- D. Adolfsson, M. Karlsson, V. Kubelka, M. Magnusson, and H. Andreasson, “Tbv radar slam: trust but verify loop candidates,” arXiv preprint arXiv:2301.04397, 2023.
- H. Jang, M. Jung, and A. Kim, “RaPlace: Place Recognition for Imaging Radar using Radon Transform and Mutable Threshold,” in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2023.
- M. Gadd and P. Newman, “Open-RadVLAD: Fast and Robust Radar Place Recognition,” arXiv preprint arXiv:2401.15380, 2024.
- R. Arandjelovic, P. Gronat, A. Torii, T. Pajdla, and J. Sivic, “Netvlad: Cnn architecture for weakly supervised place recognition,” in IEEE Conference on Computer Vision and Pattern Recognition, 2016.
- G. Berton, C. Masone, and B. Caputo, “Rethinking visual geo-localization for large-scale applications,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 4878–4888.
- G. Kim and A. Kim, “Scan context: Egocentric spatial descriptor for place recognition within 3d point cloud map,” in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2018.
- K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 770–778.
- J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, “Imagenet: A large-scale hierarchical image database,” in 2009 IEEE conference on computer vision and pattern recognition. Ieee, 2009, pp. 248–255.
- D. Arthur and S. Vassilvitskii, “K-means++ the advantages of careful seeding,” in eighteenth annual ACM-SIAM symposium on Discrete algorithms, 2007, pp. 1027–1035.
- M. Sandler, A. Howard, M. Zhu, A. Zhmoginov, and L.-C. Chen, “Mobilenetv2: Inverted residuals and linear bottlenecks,” in IEEE conference on computer vision and pattern recognition, 2018.
- C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, “Going deeper with convolutions,” in IEEE conference on computer vision and pattern recognition, 2015.
- A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Imagenet classification with deep convolutional neural networks,” Advances in neural information processing systems, vol. 25, 2012.
- K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” arXiv preprint arXiv:1409.1556, 2014.