2000 character limit reached
CARLOS: An Open, Modular, and Scalable Simulation Framework for the Development and Testing of Software for C-ITS (2404.01836v3)
Published 2 Apr 2024 in cs.RO and cs.SE
Abstract: Future mobility systems and their components are increasingly defined by their software. The complexity of these cooperative intelligent transport systems (C-ITS) and the everchanging requirements posed at the software require continual software updates. The dynamic nature of the system and the practically innumerable scenarios in which different software components work together necessitate efficient and automated development and testing procedures that use simulations as one core methodology. The availability of such simulation architectures is a common interest among many stakeholders, especially in the field of automated driving. That is why we propose CARLOS - an open, modular, and scalable simulation framework for the development and testing of software in C-ITS that leverages the rich CARLA and ROS ecosystems. We provide core building blocks for this framework and explain how it can be used and extended by the community. Its architecture builds upon modern microservice and DevOps principles such as containerization and continuous integration. In our paper, we motivate the architecture by describing important design principles and showcasing three major use cases - software prototyping, data-driven development, and automated testing. We make CARLOS and example implementations of the three use cases publicly available at github.com/ika-rwth-aachen/carlos
- K. Groh, S. Wagner, T. Kuehbeck, and A. Knoll, “Simulation and its contribution to evaluate highly automated driving functions,” SAE International Journal of Advances and Current Practices in Mobility, 2019.
- A. Kloeker, Y. Liu, M. Maier, and L. Eckstein, “Sim-to-real domain adaptation of infrastructure sensor lidar point clouds using generative adversarial networks,” International Conference on Electrical, Computer and Energy Technologies, 2023.
- S. Huch, L. Scalerandi, E. Rivera, and M. Lienkamp, “Quantifying the lidar sim-to-real domain shift: A detailed investigation using object detectors and analyzing point clouds at target-level,” IEEE Transactions on Intelligent Vehicles, 2023.
- Z. Zhong, et al., “A survey on scenario-based testing for automated driving systems in high-fidelity simulation,” Preprint, 2021.
- V. G. Stepanyants and A. Y. Romanov, “A survey of integrated simulation environments for connected automated vehicles: Requirements, tools, and architecture,” IEEE Intelligent Transportation Systems Magazine, 12 2023.
- A. Dosovitskiy, G. Ros, F. Codevilla, A. Lopez, and V. Koltun, “Carla: An open urban driving simulator,” 1st Annual Conference on Robot Learning, 2017.
- Amazon.com Inc. What’s the difference between soa and microservices? [Online]. Available: https://aws.amazon.com/compare/the-difference-between-soa-microservices/
- P. Jamshidi, C. Pahl, N. C. Mendonca, J. Lewis, and S. Tilkov, “Microservices: The journey so far and challenges ahead,” IEEE Software, 2018.
- T. Tasci, J. Melcher, and A. Verl, “A container-based architecture for real-time control applications,” International Conference on Engineering, Technology and Innovation, 2018.
- S. Baškarada, V. Nguyen, and A. Koronios, “Architecting microservices: Practical opportunities and challenges,” Journal of Computer Information Systems, 2020.
- S. Hardikar, P. Ahirwar, and S. Rajan, “Containerization: Cloud computing based inspiration technology for adoption through docker and kubernetes,” Second International Conference on Electronics and Sustainable Communication Systems, 2021.
- B. Lampe, et al., “Robotkube: Orchestrating large-scale cooperative multi-robot systems with kubernetes and ros,” International Conference on Intelligent Transportation Systems, 2023.
- C. Xia, Y. Zhang, L. Wang, S. Coleman, and Y. Liu, “Microservice-based cloud robotics system for intelligent space,” Robotics and Autonomous Systems, 2018.
- R. White and H. Christensen, “Ros and docker,” Part of the Studies in Computational Intelligence Book Series, 2017.
- J.-P. Busch, L. Reiher, and L. Eckstein, “Enabling the deployment of any-scale robotic applications in microservice architectures through automated containerization,” Preprint, 2023.
- Red Hat. The volkswagen group builds automated testing environment. [Online]. Available: https://www.redhat.com/en/success-stories/the-volkswagen-group
- K. Forsberg and H. Mooz, “The relationship of systems engineering to the project cycle,” Engineering Management Journal, 1992.
- J. E. T. Akinsola, et al., “Comparative analysis of software development life cycle models (sdlc),” Advances in Intelligent Systems and Computing, 2020.
- M. Waseem, P. Liang, G. Marquez, and A. D. Salle, “Testing microservices architecture-based applications: A systematic mapping study,” Asia-Pacific Software Engineering Conference, 2020.
- W. Wachenfeld and H. Winner, “The release of autonomous vehicles,” Autonomous Driving: Technical, Legal and Social Aspects, 2016.
- G. Lou, Y. Deng, X. Zheng, M. Zhang, and T. Zhang, “Testing of autonomous driving systems: Where are we and where should we go?” ACM Joint Meeting European Software Engineering Conference and Symposium on the Foundations of Software Engineering, 2021.
- D. J. Fremont, et al., “Formal scenario-based testing of autonomous vehicles: From simulation to the real world,” International Conference on Intelligent Transportation Systems, 2020.
- H. Weber, C. Glasmacher, M. Schuldes, N. Wagener, and L. Eckstein, “Holistic driving scenario concept for urban traffic,” IEEE Intelligent Vehicles Symposium, 2023.
- Q. Li, et al., “Scenarionet: Open-source platform for large-scale traffic scenario simulation and modeling,” Advances in Neural Information Processing Systems, 2023.
- Institute for Automotive Engineering (ika). scenario.center. [Online]. Available: https://scenario.center/
- ASAM. Asam open x standards. [Online]. Available: https://www.asam.net/standards/
- D. J. Fremont, et al., “Scenic: A language for scenario specification and scene generation,” SIGPLAN Conference on Programming Language Design and Implementation, 2018.
- M. Steimle, N. Weber, and M. Maurer, “Toward generating sufficiently valid test case results: A method for systematically assigning test cases to test bench configurations in a scenario-based test approach for automated vehicles,” IEEE Access, 2022.
- R. Dona and B. Ciuffo, “Virtual testing of automated driving systems. a survey on validation methods,” IEEE Access, 2022.
- S. Macenski, T. Foote, B. Gerkey, C. Lalancette, and W. Woodall, “Robot operating system 2: Design, architecture, and uses in the wild,” Science Robotics, 2022.
- J. Dobberstein, et al., “The eclipse working group openpass – an open source approach to safety impact assessment via simulation,” International Technical Conference on the Enhanced Safety of Vehicles, 2017.
- M. Althoff, M. Koschi, and S. Manzinger, “Commonroad: Composable benchmarks for motion planning on roads,” IEEE Intelligent Vehicles Symposium (IV), 2017.
- S. Ramakrishna, B. Luo, C. B. Kuhn, G. Karsai, and A. Dubey, “Anti-carla: An adversarial testing framework for autonomous vehicles in carla,” International Conference on Intelligent Transportation Systems, 2022, focus on adversarial tets.
- C. E. Tuncali, G. Fainekos, H. Ito, and J. Kapinski, “Simulation-based adversarial test generation for autonomous vehicles with machine learning components,” IEEE Intelligent Vehicles Symposium, 2018.
- Z. Saigol and A. Peters, “Verifying automated driving systems in simulation: framework and challenges,” ITS World Congress, 2018.
- A. Bewley, et al., “Learning to drive from simulation without real world labels,” IEEE International Conference on Robotics and Automation, 2019.
- Pegasus project. [Online]. Available: https://www.pegasusprojekt.de
- J. C. Kirchhof, E. Kusmenko, B. Rumpe, and H. Zhang, “Simulation as a service for cooperative vehicles,” International Conference on Model Driven Engineering Languages and Systems Companion, 2019.