Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
175 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Towards Validation of Autonomous Vehicles Across Scales using an Integrated Digital Twin Framework (2402.12670v2)

Published 20 Feb 2024 in cs.RO

Abstract: Autonomous vehicle platforms of varying spatial scales are employed within the research and development spectrum based on space, safety and monetary constraints. However, deploying and validating autonomy algorithms across varying operational scales presents challenges due to scale-specific dynamics, sensor integration complexities, computational constraints, regulatory considerations, environmental variability, interaction with other traffic participants and scalability concerns. In such a milieu, this work focuses on developing a unified framework for modeling and simulating digital twins of autonomous vehicle platforms across different scales and operational design domains (ODDs) to help support the streamlined development and validation of autonomy software stacks. Particularly, this work discusses the development of digital twin representations of 4 autonomous ground vehicles, which span across 3 different scales and target 3 distinct ODDs. We study the adoption of these autonomy-oriented digital twins to deploy a common autonomy software stack with an aim of end-to-end map-based navigation to achieve the ODD-specific objective(s) for each vehicle. Finally, we also discuss the flexibility of the proposed framework to support virtual, hybrid as well as physical testing with seamless sim2real transfer.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (36)
  1. T. Samak, C. Samak, S. Kandhasamy, V. Krovi, and M. Xie, “AutoDRIVE: A Comprehensive, Flexible and Integrated Digital Twin Ecosystem for Autonomous Driving Research & Education,” Robotics, vol. 12, no. 3, p. 77, May 2023. [Online]. Available: http://dx.doi.org/10.3390/robotics12030077
  2. T. V. Samak, C. V. Samak, and M. Xie, “AutoDRIVE Simulator: A Simulator for Scaled Autonomous Vehicle Research and Education,” in 2021 2nd International Conference on Control, Robotics and Intelligent System, ser. CCRIS’21.   New York, NY, USA: Association for Computing Machinery, 2021, p. 1–5. [Online]. Available: https://doi.org/10.1145/3483845.3483846
  3. T. V. Samak and C. V. Samak, “AutoDRIVE - Technical Report,” 2022. [Online]. Available: https://doi.org/10.48550/arXiv.2211.08475
  4. ——, “AutoDRIVE Simulator - Technical Report,” 2022. [Online]. Available: https://doi.org/10.48550/arXiv.2211.07022
  5. S. Kato, S. Tokunaga, Y. Maruyama, S. Maeda, M. Hirabayashi, Y. Kitsukawa, A. Monrroy, T. Ando, Y. Fujii, and T. Azumi, “Autoware on Board: Enabling Autonomous Vehicles with Embedded Systems,” in 2018 ACM/IEEE 9th International Conference on Cyber-Physical Systems (ICCPS), 2018, pp. 287–296.
  6. C. Samak, T. Samak, and V. Krovi, “Towards Mechatronics Approach of System Design, Verification and Validation for Autonomous Vehicles,” in 2023 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), 2023, pp. 1208–1213. [Online]. Available: https://doi.org/10.1109/AIM46323.2023.10196233
  7. ——, “Towards Sim2Real Transfer of Autonomy Algorithms using AutoDRIVE Ecosystem,” IFAC-PapersOnLine, vol. 56, no. 3, pp. 277–282, 2023, 3rd Modeling, Estimation and Control Conference MECC 2023. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S2405896323023704
  8. Ansys Inc., “Ansys Automotive,” 2021. [Online]. Available: https://www.ansys.com/solutions/solutions-by-industry/automotive
  9. MSC Software Corporation, “Adams Car,” 2021. [Online]. Available: https://www.mscsoftware.com/product/adams-car
  10. Ansys Inc., “Ansys Autonomy,” 2021. [Online]. Available: https://www.ansys.com/solutions/technology-trends/autonomous-engineering
  11. Mechanical Simulation Corporation, “CarSim,” 2021. [Online]. Available: https://www.carsim.com
  12. IPG Automotive GmbH, “CarMaker,” 2021. [Online]. Available: https://ipg-automotive.com/products-services/simulation-software/carmaker
  13. Nvidia Corporation, “NVIDIA DRIVE Sim and DRIVE Constellation,” 2021. [Online]. Available: https://www.nvidia.com/en-us/self-driving-cars/drive-constellation
  14. Cognata Ltd., “Cognata,” 2021. [Online]. Available: https://www.cognata.com
  15. rFpro, “Driving Simulation,” 2021. [Online]. Available: https://www.rfpro.com/driving-simulation
  16. dSPACE, “dSPACE,” 2021. [Online]. Available: https://www.dspace.com/en/pub/home.cfm
  17. Siemens AG, “PreScan,” 2021. [Online]. Available: https://tass.plm.automation.siemens.com/prescan
  18. S. R. Richter, V. Vineet, S. Roth, and V. Koltun, “Playing for Data: Ground Truth from Computer Games,” in Proceedings of the European Conference on Computer Vision (ECCV), ser. LNCS, J. Matas, B. Leibe, M. Welling, and N. Sebe, Eds., vol. 9906.   Springer International Publishing, 13-15 Nov 2016, pp. 102–118.
  19. S. R. Richter, Z. Hayder, and V. Koltun, “Playing for Benchmarks,” in IEEE International Conference on Computer Vision, ICCV 2017, Venice, Italy, October 22-29, 2017, 2017, pp. 2232–2241.
  20. M. Johnson-Roberson, C. Barto, R. Mehta, S. N. Sridhar, K. Rosaen, and R. Vasudevan, “Driving in the Matrix: Can Virtual Worlds Replace Human-Generated Annotations for Real World Tasks?” in 2017 IEEE International Conference on Robotics and Automation (ICRA), 2017, pp. 746–753.
  21. N. P. Koenig and A. Howard, “Design and use paradigms for Gazebo, an open-source multi-robot simulator,” in 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566), vol. 3, 2004, pp. 2149–2154.
  22. M. Quigley, K. Conley, B. Gerkey, J. Faust, T. Foote, J. Leibs, R. Wheeler, and A. Ng, “ROS: An Open-Source Robot Operating System,” in ICRA 2009 Workshop on Open Source Software, vol. 3, Jan 2009. [Online]. Available: http://robotics.stanford.edu/~ang/papers/icraoss09-ROS.pdf
  23. B. Wymann, E. Espié, C. Guionneau, C. Dimitrakakis, R. Coulom, and A. Sumner, “TORCS, The Open Racing Car Simulator,” 2021. [Online]. Available: http://torcs.sourceforge.net
  24. A. Dosovitskiy, G. Ros, F. Codevilla, A. Lopez, and V. Koltun, “CARLA: An Open Urban Driving Simulator,” in Proceedings of the 1st Annual Conference on Robot Learning, ser. Proceedings of Machine Learning Research, S. Levine, V. Vanhoucke, and K. Goldberg, Eds., vol. 78.   PMLR, 13-15 Nov 2017, pp. 1–16.
  25. S. Shah, D. Dey, C. Lovett, and A. Kapoor, “AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles,” in Field and Service Robotics, M. Hutter and R. Siegwart, Eds.   Cham: Springer International Publishing, 2018, pp. 621–635.
  26. Voyage, “Deepdrive,” 2021. [Online]. Available: https://deepdrive.voyage.auto
  27. Epic Games Inc., “Unreal Engine,” 2021. [Online]. Available: https://www.unrealengine.com
  28. Baidu Inc., “Apollo Game Engine Based Simulator,” 2021. [Online]. Available: https://developer.apollo.auto/gamesim.html
  29. G. Rong, B. H. Shin, H. Tabatabaee, Q. Lu, S. Lemke, M. Možeiko, E. Boise, G. Uhm, M. Gerow, S. Mehta, E. Agafonov, T. H. Kim, E. Sterner, K. Ushiroda, M. Reyes, D. Zelenkovsky, and S. Kim, “LGSVL Simulator: A High Fidelity Simulator for Autonomous Driving,” in 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC), 2020, pp. 1–6.
  30. TIER IV Inc., “AWSIM,” 2023. [Online]. Available: https://tier4.github.io/AWSIM
  31. Unity Technologies, “Unity,” 2021. [Online]. Available: https://unity.com
  32. C. V. Samak, T. V. Samak, J. M. Velni, and V. N. Krovi, “Nigel – Mechatronic Design and Robust Sim2Real Control of an Over-Actuated Autonomous Vehicle,” 2024. [Online]. Available: https://doi.org/10.48550/arXiv.2401.11542
  33. M. O’Kelly, V. Sukhil, H. Abbas, J. Harkins, C. Kao, Y. V. Pant, R. Mangharam, D. Agarwal, M. Behl, P. Burgio, and M. Bertogna, “F1/10: An Open-Source Autonomous Cyber-Physical Platform,” 2019. [Online]. Available: https://arxiv.org/abs/1901.08567
  34. AgileX Robotics, “Hunter SE,” 2023. [Online]. Available: https://global.agilex.ai/chassis/9
  35. ARMLab CU-ICAR, “OpenCAV: Open Connected and Automated Vehicle,” 2023. [Online]. Available: https://sites.google.com/view/opencav
  36. S. Macenski, T. Foote, B. Gerkey, C. Lalancette, and W. Woodall, “Robot Operating System 2: Design, Architecture, and Uses in the Wild,” Science Robotics, vol. 7, no. 66, p. eabm6074, 2022. [Online]. Available: https://www.science.org/doi/abs/10.1126/scirobotics.abm6074
Citations (4)

Summary

  • The paper presents a unified digital twin framework that models the dynamics of multiple autonomous platforms to reduce extensive real-world testing requirements.
  • The framework integrates multi-threaded, GPU-accelerated simulations with versatile APIs, validated through eight case studies across varied operational design domains.
  • The results demonstrate successful tasks including off-road deployment of the Autoware stack, paving the way for future multi-agent and dynamic re-planning applications.

Validation of Autonomous Vehicles Using an Integrated Digital Twin Framework

The paper, entitled "Towards Validation of Autonomous Vehicles Across Scales using an Integrated Digital Twin Framework," aims to address the pervasive challenges associated with deploying and validating autonomy algorithms across various operational scales. The authors introduce a unified framework that integrates digital twins for modeling autonomous vehicle platforms spanning multiple scales and operational design domains (ODDs). The research is particularly focused on facilitating the efficient development and validation of autonomy software stacks. By leveraging digital twins, this framework seeks to reduce the need for extensive real-world testing and accelerate the development process.

Core Concept and Methodological Contributions

This paper introduces AutoDRIVE Ecosystem, a digital twin framework designed to support the validation and deployment of autonomous vehicles at different scales. The framework encompasses the development of digital twin models for four unique autonomous ground vehicles, each targeting distinct ODDs and varying in scale. These include small-scale platforms like Nigel and F1TENTH, the mid-scale Hunter SE, and the full-scale OpenCAV. Each vehicle's digital twin is meticulously modeled to replicate its real-world dynamics, sensor interactions, and environmental context.

The framework combines rigorous computational methods, integrating multi-threading and GPU capabilities for efficient simulation, while maintaining a reliable balance between graphic realism and physical fidelity. Furthermore, the inclusion of versatile APIs within the AutoDRIVE Ecosystem allows for seamless interaction with both virtual and real vehicle platforms, enhancing the framework's flexibility and user accessibility.

Validation and Strong Results

The framework is validated through a series of eight case studies demonstrating end-to-end map-based navigation. These case studies underscore the framework's capacity to support autonomy software deployment across different scales and ODDs. The paper reports successful navigation tasks, such as autonomous parking and off-road navigation, tailored to each vehicle's specifications. Notably, a significant contribution is highlighted with the framework's ability to facilitate the first-ever off-road deployment of the Autoware stack, effectively extending its operational domain beyond conventional on-road environments.

Implications and Future Research

The implications of this research are twofold. Practically, the framework offers substantial potential to advance the development and validation workflows for autonomous vehicle systems, reducing both time and resource expenditures typically associated with real-world testing. Theoretically, this research establishes a robust foundation for further exploration into multi-agent deployments and dynamic re-planning capabilities in autonomous vehicle ecosystems.

Future research could explore extending this framework to support simultaneous multi-agent validation scenarios, which could be critical for the development of vehicle-to-vehicle and vehicle-to-infrastructure communication. Additionally, improving real-time dynamic re-planning capabilities and enhancing the robustness of sim2real transitions will be important next steps in ensuring that digital twin frameworks can seamlessly integrate into larger autonomous systems.

In conclusion, the authors have presented a significant contribution to the field of autonomous vehicle validation, with their integrated digital twin framework opening new avenues for research and application across multiple scales and environments.

Youtube Logo Streamline Icon: https://streamlinehq.com