V2AIX: A Multi-Modal Real-World Dataset of ETSI ITS V2X Messages in Public Road Traffic (2403.10221v2)
Abstract: Connectivity is a main driver for the ongoing megatrend of automated mobility: future Cooperative Intelligent Transport Systems (C-ITS) will connect road vehicles, traffic signals, roadside infrastructure, and even vulnerable road users, sharing data and compute for safer, more efficient, and more comfortable mobility. In terms of communication technology for realizing such vehicle-to-everything (V2X) communication, the WLAN-based peer-to-peer approach (IEEE 802.11p, ITS-G5 in Europe) competes with C-V2X based on cellular technologies (4G and beyond). Irrespective of the underlying communication standard, common message interfaces are crucial for a common understanding between vehicles, especially from different manufacturers. Targeting this issue, the European Telecommunications Standards Institute (ETSI) has been standardizing V2X message formats such as the Cooperative Awareness Message (CAM). In this work, we present V2AIX, a multi-modal real-world dataset of ETSI ITS messages gathered in public road traffic, the first of its kind. Collected in measurement drives and with stationary infrastructure, we have recorded more than 285 000 V2X messages from more than 2380 vehicles and roadside units in public road traffic. Alongside a first analysis of the dataset, we present a way of integrating ETSI ITS V2X messages into the Robot Operating System (ROS). This enables researchers to not only thoroughly analyze real-world V2X data, but to also study and implement standardized V2X messages in ROS-based automated driving applications. The full dataset is publicly available for non-commercial use at v2aix.ika.rwth-aachen.de.
- IoT Automotive News. C-V2X global market moment continues to accelerate. [Online]. Available: iot-automotive.news/c-v2x-global-market-momentum-continues-to-accelerate/
- Capacity Media. Eu ambassadors reject ‘wifi-only’ move for autonomous cars. [Online]. Available: www.capacitymedia.com/article/29otbigvj3wq5cbq4l9mo/news/eu-ambassadors-reject-wifi-only-move-for-autonomous-cars
- ADAC. Car2X: Wie kommunikationstechnik unfälle komplett verhindern könnte. [Online]. Available: www.adac.de/rund-ums-fahrzeug/ausstattung-technik-zubehoer/assistenzsysteme/car2x/
- M. Liu, E. Yurtsever, X. Zhou, J. Fossaert, Y. Cui, B. L. Zagar, and A. C. Knoll, “A Survey on Autonomous Driving Datasets: Data Statistic, Annotation, and Outlook,” Jan. 2024.
- A. Geiger, P. Lenz, C. Stiller, and R. Urtasun, “Vision meets robotics: The KITTI dataset,” The International Journal of Robotics Research, vol. 32, no. 11, Sept. 2013.
- M. Cordts, M. Omran, S. Ramos, T. Rehfeld, M. Enzweiler, R. Benenson, U. Franke, S. Roth, and B. Schiele, “The Cityscapes Dataset for Semantic Urban Scene Understanding,” in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas, NV, USA: IEEE, June 2016.
- H. Caesar, V. Bankiti, A. H. Lang, S. Vora, V. E. Liong, Q. Xu, A. Krishnan, Y. Pan, G. Baldan, and O. Beijbom, “nuScenes: A Multimodal Dataset for Autonomous Driving,” in 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Seattle, WA, USA: IEEE, June 2020.
- P. Sun, et al., “Scalability in Perception for Autonomous Driving: Waymo Open Dataset,” in 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Seattle, WA, USA: IEEE, June 2020.
- B. Wilson, et al., “Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecasting,” Jan. 2023.
- L. Kloeker, A. Kloeker, F. Thomsen, A. E. Erraji, and L. Eckstein, “How to Build a Highly Accurate Digital Twin – Intelligent Infrastructure in the Corridor for New Mobility - ACCorD,” in 30th Aachen Colloquium Sustainable Mobilit, 2021.
- A. Krämmer, C. Schöller, D. Gulati, V. Lakshminarasimhan, F. Kurz, D. Rosenbaum, C. Lenz, and A. Knoll, “Providentia – A Large-Scale Sensor System for the Assistance of Autonomous Vehicles and Its Evaluation,” Field Robotics, vol. 2, no. 1, Mar. 2022.
- H. Yu, et al., “DAIR-V2X: A Large-Scale Dataset for Vehicle-Infrastructure Cooperative 3D Object Detection,” in 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). New Orleans, LA, USA: IEEE, June 2022.
- US Department of Transportation: Federal Highway Administration, “US Highway 101 Dataset.” [Online]. Available: www.fhwa.dot.gov/publications/research/operations/07030/
- W. Zhan, et al., “INTERACTION Dataset: An INTERnational, Adversarial and Cooperative moTION Dataset in Interactive Driving Scenarios with Semantic Maps,” Sept. 2019.
- R. Krajewski, J. Bock, L. Kloeker, and L. Eckstein, “The highD Dataset: A Drone Dataset of Naturalistic Vehicle Trajectories on German Highways for Validation of Highly Automated Driving Systems,” in 2018 21st International Conference on Intelligent Transportation Systems (ITSC). Maui, HI: IEEE, Nov. 2018.
- J. Bock, R. Krajewski, T. Moers, S. Runde, L. Vater, and L. Eckstein, “The inD Dataset: A Drone Dataset of Naturalistic Road User Trajectories at German Intersections,” in 2020 IEEE Intelligent Vehicles Symposium (IV). Las Vegas, NV, USA: IEEE, Oct. 2020.
- R. Krajewski, T. Moers, J. Bock, L. Vater, and L. Eckstein, “The rounD Dataset: A Drone Dataset of Road User Trajectories at Roundabouts in Germany,” in 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC). Rhodes, Greece: IEEE, Sept. 2020.
- T. Moers, L. Vater, R. Krajewski, J. Bock, A. Zlocki, and L. Eckstein, “The exiD Dataset: A Real-World Trajectory Dataset of Highly Interactive Highway Scenarios in Germany,” in 2022 IEEE Intelligent Vehicles Symposium (IV). Aachen, Germany: IEEE, June 2022.
- L. Walkin, “asn1c.” [Online]. Available: http://lionet.info/asn1c/
- T. Huang, J. Liu, X. Zhou, D. C. Nguyen, M. R. Azghadi, Y. Xia, Q.-L. Han, and S. Sun, “V2X Cooperative Perception for Autonomous Driving: Recent Advances and Challenges,” 2023.
- R. Xu, H. Xiang, X. Xia, X. Han, J. Li, and J. Ma, “OPV2V: An Open Benchmark Dataset and Fusion Pipeline for Perception with Vehicle-to-Vehicle Communication,” in 2022 International Conference on Robotics and Automation (ICRA). Philadelphia, PA, USA: IEEE, May 2022.
- Y. Li, D. Ma, Z. An, Z. Wang, Y. Zhong, S. Chen, and C. Feng, “V2X-Sim: Multi-Agent Collaborative Perception Dataset and Benchmark for Autonomous Driving,” IEEE Robotics and Automation Letters, vol. 7, no. 4, Oct. 2022.
- R. Xu, H. Xiang, Z. Tu, X. Xia, M.-H. Yang, and J. Ma, “V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformer,” in Computer Vision – ECCV 2022, S. Avidan, G. Brostow, M. Cissé, G. M. Farinella, and T. Hassner, Eds. Cham: Springer Nature Switzerland, 2022, vol. 13699.
- R. Xu, et al., “V2V4Real: A Real-World Large-Scale Dataset for Vehicle-to-Vehicle Cooperative Perception,” in 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Vancouver, BC, Canada: IEEE, June 2023.
- J. Axmann, R. Moftizadeh, J. Su, B. Tennstedt, Q. Zou, Y. Yuan, D. Ernst, H. Alkhatib, C. Brenner, and S. Schön, “LUCOOP: Leibniz University Cooperative Perception and Urban Navigation Dataset,” in 2023 IEEE Intelligent Vehicles Symposium (IV). Anchorage, AK, USA: IEEE, June 2023.
- I. Mavromatis, A. Tassi, and R. J. Piechocki, “Operating ITS-G5 DSRC over Unlicensed Bands: A City-Scale Performance Evaluation,” in 2019 IEEE 30th Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC). Istanbul, Turkey: IEEE, Sept. 2019.
- “V2X measurement on M0 motorway with 4 vehicles.” [Online]. Available: github.com/BMEAutomatedDrive/v2xdatasets
- US Department of Transportation, “ITS DataHub.” [Online]. Available: www.its.dot.gov/data/
- M. Quigley, B. Gerkey, K. Conley, J. Faust, T. Foote, J. Leibs, E. Berger, R. Wheeler, and A. Ng, “Ros: an open-source robot operating system,” in Proc. of the IEEE Intl. Conf. on Robotics and Automation (ICRA) Workshop on Open Source Robotics, Kobe, Japan, May 2009.
- S. Macenski, T. Foote, B. Gerkey, C. Lalancette, and W. Woodall, “Robot operating system 2: Design, architecture, and uses in the wild,” Science Robotics, vol. 7, no. 66, 2022. [Online]. Available: www.science.org/doi/abs/10.1126/scirobotics.abm6074
- S. Kato, S. Tokunaga, Y. Maruyama, S. Maeda, M. Hirabayashi, Y. Kitsukawa, A. Monrroy, T. Ando, Y. Fujii, and T. Azumi, “Autoware on board: Enabling autonomous vehicles with embedded systems,” in 2018 ACM/IEEE 9th International Conference on Cyber-Physical Systems (ICCPS). IEEE, 2018.
- R. Riebl, “Ros_etsi_its_msgs.” [Online]. Available: github.com/riebl/ros_etsi_its_msgs
- DLR Transportation Systems, “V2x_if_ros_msg.” [Online]. Available: github.com/DLR-TS/v2x_if_ros_msg
- M. Shan, K. Narula, Y. F. Wong, S. Worrall, M. Khan, P. Alexander, and E. Nebot, “Demonstrations of Cooperative Perception: Safety and Robustness in Connected and Automated Vehicle Operations,” Sensors, vol. 21, no. 1, Dec. 2020.
- S. Yedida, A. Paudyal, S. Matta, and T. Tasky, “V2X Connectivity with ROS for AD Applications,” in SAE WCX Digital Summit, Apr. 2021.
- C. M. Elias, O. M. Shehata, E. I. Morgan, and C. Stiller, “Emerging of V2X paradigm in the Development of a ROS-based Cooperative Architecture for Transportation System Agents,” in 2022 IEEE Intelligent Vehicles Symposium (IV). Aachen, Germany: IEEE, June 2022.
- Christoph Pilz, “Vehicle_captain_toolbox,” Virtual Vehicle. [Online]. Available: github.com/virtual-vehicle/vehicle_captain_toolbox
- ETSI. Abstract syntax notation definitions for tc its. [Online]. Available: forge.etsi.org/rep/ITS/asn1
- R. Riebl, H.-J. Günther, C. Facchi, and L. Wolf, “Artery: Extending veins for vanet applications,” in 2015 International Conference on Models and Technologies for Intelligent Transportation Systems (MT-ITS). IEEE, 2015.
- R. Riebl, C. Obermaier, S. Neumeier, and C. Facchi, “Vanetza: Boosting research on inter-vehicle communication,” 2017.
- S. Laux, G. S. Pannu, S. Schneider, J. Tiemann, F. Klingler, C. Sommer, and F. Dressler, “Openc2x—an open source experimental and prototyping platform supporting etsi its-g5,” in 2016 IEEE Vehicular Networking Conference (VNC). IEEE, 2016.
- DG Mobility and Transport of the European Commission. Tentec interactive map viewer. [Online]. Available: https://ec.europa.eu/transport/infrastructure/tentec/tentec-portal/map/maps.html