CAVIAR: Co-simulation of 6G Communications, 3D Scenarios and AI for Digital Twins
Abstract: Digital twins are an important technology for advancing mobile communications, specially in use cases that require simultaneously simulating the wireless channel, 3D scenes and machine learning. Aiming at providing a solution to this demand, this work describes a modular co-simulation methodology called CAVIAR. Here, CAVIAR is upgraded to support a message passing library and enable the virtual counterpart of a digital twin system using different 6G-related simulators. The main contributions of this work are the detailed description of different CAVIAR architectures, the implementation of this methodology to assess a 6G use case of UAV-based search and rescue mission (SAR), and the generation of benchmarking data about the computational resource usage. For executing the SAR co-simulation we adopt five open-source solutions: the physical and link level network simulator Sionna, the simulator for autonomous vehicles AirSim, scikit-learn for training a decision tree for MIMO beam selection, Yolov8 for the detection of rescue targets and NATS for message passing. Results for the implemented SAR use case suggest that the methodology can run in a single machine, with the main demanded resources being the CPU processing and the GPU memory.
- L. U. Khan, W. Saad, D. Niyato, Z. Han, and C. S. Hong, “Digital-twin-enabled 6G: Vision, architectural trends, and future directions,” IEEE Communications Magazine, vol. 60, no. 1, pp. 74–80, 2022.
- Y. Wu, K. Zhang, and Y. Zhang, “Digital twin networks: A survey,” IEEE Internet of Things Journal, vol. 8, no. 18, pp. 13 789–13 804, 2021.
- “Definition Of A Digital Twin,” digitaltwinconsortium.org/initiatives/the-definition-of-a-digital-twin/, accessed: 2023-03-21.
- D. Villa, D. Uvaydov, L. Bonati, P. Johari, J. M. Jornet, and T. Melodia, “Twinning Commercial Radio Waveforms in the Colosseum Wireless Network Emulator,” in Proceedings of the 17th ACM Workshop on Wireless Network Testbeds, Experimental Evaluation & Characterization, ser. WiNTECH ’23. New York, NY, USA: Association for Computing Machinery, 2023, p. 33–40. [Online]. Available: https://doi.org/10.1145/3615453.3616519
- X. Lin, L. Kundu, C. Dick, E. Obiodu, T. Mostak, and M. Flaxman, “6G Digital Twin Networks: From Theory to Practice,” IEEE Communications Magazine, vol. 61, no. 11, pp. 72–78, 2023.
- “5G simulation models with NVIDIA omniverse platform - Ericsson,” https://www.ericsson.com/en/blog/2021/4/5g-simulation-omniverse-platform, accessed: 2023-12-20.
- “Network digital twins - outlook and opportunities - Ericsson,” https://www.ericsson.com/en/reports-and-papers/ericsson-technology-review/articles/network-digital-twins-outlook-and-opportunities, accessed: 2023-12-05.
- H. Ahmadi, A. Nag, Z. Khar, K. Sayrafian, and S. Rahardja, “Networked Twins and Twins of Networks: An Overview on the Relationship Between Digital Twins and 6G,” IEEE Communications Standards Magazine, vol. 5, no. 4, pp. 154–160, 2021.
- “MECSYCO: Multi-agent Environment for Complex SYstem COsimulation,” http://www.mecsyco.com, accessed: 2023-12-19.
- G. Liboni, “Complex systems co-simulation with the CoSim20 framework : for efficient and accurate distributed co-simulations,” Theses, Université Côte d’Azur, Apr. 2021. [Online]. Available: https://theses.hal.science/tel-03382774
- A. Klautau, A. de Oliveira, I. Pamplona Trindade, and W. Alves, “Generating MIMO Channels for 6G Virtual Worlds Using Ray-tracing Simulations,” in 2021 IEEE Statistical Signal Processing Workshop (SSP), Rio de Janeiro, Brazil, Jul. 2021, pp. 595–599.
- T. Wild, V. Braun, and H. Viswanathan, “Joint design of communication and sensing for beyond 5G and 6G systems,” IEEE Access, vol. 9, pp. 30 845–30 857, 2021.
- H. Zhang, T. Yang, X. Wu, Z. Guo, and B. Hu, “Robust beamforming design for UAV communications based on integrated sensing and communication,” EURASIP Journal on Wireless Communications and Networking, vol. 2023, no. 1, pp. 1–24, 2023.
- M. Bayraktar, N. González-Prelcic, and H. Chen, “Hybrid Precoding and Combining for mmWave Full-Duplex Joint Radar and Communication Systems under Self-Interference,” arXiv preprint arXiv:2311.14942, 2023.
- R. I. Abd, K. S. Kim, and D. J. Findley, “Hydra-RAN Perceptual Networks Architecture: Dual-Functional Communications and Sensing Networks for 6G and Beyond,” IEEE Access, pp. 1–1, 2023.
- U. Demir, S. Pradhan, R. Kumahia, D. Roy, S. loannidis, and K. Chowdhury, “Digital Twins for Maintaining QoS in Programmable Vehicular Networks,” IEEE Network, vol. 37, no. 4, pp. 208–214, 2023.
- Y. Wang, A. Klautau, M. Ribero, M. Narasimha, and R. W. Heath, “MmWave Vehicular Beam Training with Situational Awareness by Machine Learning,” in 2018 IEEE Globecom Workshops (GC Wkshps), 2018, pp. 1–6.
- “The most powerful real-time 3D creation tool,” https://www.unrealengine.com, accessed: 2023-10-18.
- “Unity Engine,” https://unity3d.com, accessed: 2023-10-18.
- L. Pang, J. Zhang, Y. Zhang, X. Huang, Y. Chen, and J. Li, “Investigation and comparison of 5G channel models: From QuaDRiGa, NYUSIM, and MG5G perspectives,” Chinese Journal of Electronics, vol. 31, no. 1, pp. 1–17, 2022.
- H. Huang, K. Wang, P. Wu, J. Zhang, and M. Xia, “Flexible 3GPP MIMO Channel Modeling and Calibration With Spatial Consistency,” IEEE Access, vol. 11, pp. 85 137–85 154, 2023.
- N. Suga, Y. Maeda, and K. Sato, “Indoor Radio Map Construction via Ray Tracing With RGB-D Sensor-Based 3D Reconstruction: Concept and Experiments in WLAN Systems,” IEEE Access, vol. 11, pp. 24 863–24 874, 2023.
- A. Klautau, P. Batista, N. González-Prelcic, Y. Wang, and R. W. Heath, “5G MIMO Data for Machine Learning: Application to Beam-Selection using Deep Learning,” in 2018 Information Theory and Applications Workshop (ITA). IEEE, 2018, pp. 1–9.
- S. Boehm and H. Koenig, “Real-time-shift: Pseudo-real-time event scheduling for the split-protocol-stack radio-in-the-loop emulation,” in Proceedings of the 25th International ACM Conference on Modeling Analysis and Simulation of Wireless and Mobile Systems, 2022, pp. 47–54.
- M. Manalastas, M. U. bin Farooq, S. M. Asad Zaidi, and A. Imran, “Toward the Development of 6G System Level Simulators: Addressing the Computational Complexity Challenge,” IEEE Wireless Communications, vol. 30, no. 6, pp. 160–168, 2023.
- “OMNeT++ Discrete Event Simulator,” https://omnetpp.org/, accessed: 2023-12-09.
- “ns-3 — a discrete-event network simulator for internet systems,” https://www.nsnam.org/, accessed: 2023-12-12.
- F. Bastos, A. Oliveira, J. Borges, and A. Klautau, “Effects of Environment Model Complexity in UAV Channel Estimation Using Ray-Tracing,” in X Conferência Nacional em Comunicações, Redes e Segurança da Informação (ENCOM), 2020.
- E. Egea-Lopez, F. Losilla, J. Pascual-Garcia, and J. M. Molina-Garcia-Pardo, “Vehicular Networks Simulation with Realistic Physics,” IEEE Access, vol. 7, pp. 44 021–44 036, 2019.
- A. Ruz-Nieto, E. Egea-Lopez, J.-M. Molina-García-Pardo, and J. Santa, “A 3D simulation framework with ray-tracing propagation for LoRaWAN communication,” Internet of Things, p. 100964, 2023.
- S.-M. Tang, C.-H. Hsu, Z. Tian, and X. Su, “An Aerodynamic, Computer Vision, and Network Simulator for Networked Drone Applications,” in Proceedings of the 27th Annual International Conference on Mobile Computing and Networking, 2021, pp. 831–833.
- F. Wen, W. Xu, F. Gao, C. Pan, and G. Liu, “Vision Aided Environment Semantics Extraction and Its Application in mmWave Beam Selection,” IEEE Communications Letters, 2023.
- L. Cazzella, F. Linsalata, M. Magarini, M. Matteucci, and U. Spagnolini, “A Multi-Modal Simulation Framework to Enable Digital Twin-based V2X Communications in Dynamic Environments,” arXiv preprint arXiv:2303.06947, 2023.
- G. Nardini and G. Stea, “Enabling simulation services for digital twins of 5G/B5G mobile networks,” Computer Communications, vol. 213, pp. 33–48, 2024.
- G. Nardini, D. Sabella, G. Stea, P. Thakkar, and A. Virdis, “Simu5G–An OMNeT++ Library for End-to-End Performance Evaluation of 5G Networks,” IEEE Access, vol. 8, pp. 181 176–181 191, 2020.
- M. Aloqaily, O. Bouachir, F. Karray, I. Al Ridhawi, and A. El Saddik, “Integrating digital twin and advanced intelligent technologies to realize the metaverse,” IEEE Consumer Electronics Magazine, 2022.
- M. Palmieri, C. Quadri, A. Fagiolini, G. P. Rossi, and C. Bernardeschi, “Co-simulated Digital Twin on the Network Edge: the case of platooning,” in 2022 IEEE 23rd International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM). IEEE, 2022, pp. 613–618.
- C. Quadri, V. Mancuso, M. A. Marsan, and G. P. Rossi, “Edge-based platoon control,” Computer Communications, vol. 181, pp. 17–31, 2022.
- “Simulink - Simulation and Model-Based Design,” https://www.mathworks.com/products/simulink.html, accessed: 2023-12-09.
- S. Shah, D. Dey, C. Lovett, and A. Kapoor, “AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles,” in Field and Service Robotics, 2017. [Online]. Available: {https://arxiv.org/abs/1705.05065}
- A. Dosovitskiy, G. Ros, F. Codevilla, A. Lopez, and V. Koltun, “CARLA: An open urban driving simulator,” in Proceedings of the 1st Annual Conference on Robot Learning, 2017, pp. 1–16.
- “Wireless EM Propagation Software - Wireless InSite - Remcom,” https://www.remcom.com/wireless-insite-em-propagation-software, accessed: 2023-11-02.
- “blender.org - Home of the Blender project - Free and Open 3D Creation Software,” https://www.blender.org/, accessed: 2023-10-24.
- A. Alkhateeb, “DeepMIMO: A generic deep learning dataset for millimeter wave and massive MIMO applications,” in Proc. of Information Theory and Applications Workshop (ITA), San Diego, CA, Feb 2019, pp. 1–8.
- M. Girmay and A. Shahid, “Dataset: IQ samples of LTE, 5G NR, Wi-Fi, ITS-G5, and C-V2X PC5,” 2023. [Online]. Available: https://dx.doi.org/10.21227/72qq-z464
- M. Palmieri, C. Quadri, A. Fagiolini, and C. Bernardeschi, “Co-simulated digital twin on the network edge: A vehicle platoon,” Computer Communications, vol. 212, pp. 35–47, 2023.
- B. Sliwa, M. Patchou, K. Heimann, and C. Wietfeld, “Simulating Hybrid Aerial- and Ground-based Vehicular Networks with ns-3 and LIMoSim,” in Proceedings of the 2020 Workshop on Ns-3, 2020, pp. 1–8.
- “Raymobtime wireless channel datasets,” https://www.lasse.ufpa.br/raymobtime, accessed: 2023-12-20.
- C. Sommer, R. German, and F. Dressler, “Bidirectionally Coupled Network and Road Traffic Simulation for Improved IVC Analysis,” IEEE Transactions on Mobile Computing, vol. 10, no. 1, pp. 3–15, January 2011.
- “NATS.io - Cloud Native, Open Source, High-performance Messaging,” https://nats.io/, accessed: 2023-10-18.
- A. Hore and D. Ziou, “Image quality metrics: PSNR vs. SSIM,” in 2010 20th international conference on pattern recognition. IEEE, 2010, pp. 2366–2369.
- “OpenStreetMap,” https://www.openstreetmap.org/, accessed: 2023-10-24.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.