2000 character limit reached
Vision-Radio Experimental Infrastructure Architecture Towards 6G
Published 29 Feb 2024 in cs.NI and eess.SP | (2402.19416v2)
Abstract: Telecommunications and computer vision have evolved separately so far. Yet, with the shift to sub-terahertz (sub-THz) and terahertz (THz) radio communications, there is an opportunity to explore computer vision technologies together with radio communications, considering the dependency of both technologies on Line of Sight. The combination of radio sensing and computer vision can address challenges such as obstructions and poor lighting. Also, machine learning algorithms, capable of processing multimodal data, play a crucial role in deriving insights from raw and low-level sensing data, offering a new level of abstraction that can enhance various applications and use cases such as beamforming and terminal handovers. This paper introduces CONVERGE, a pioneering vision-radio paradigm that bridges this gap by leveraging Integrated Sensing and Communication (ISAC) to facilitate a dual "View-to-Communicate, Communicate-to-View" approach. CONVERGE offers tools that merge wireless communications and computer vision, establishing a novel Research Infrastructure (RI) that will be open to the scientific community and capable of providing open datasets. This new infrastructure will support future research in 6G and beyond concerning multiple verticals, such as telecommunications, automotive, manufacturing, media, and health.
- W. Saad, M. Bennis, and M. Chen, “A vision of 6g wireless systems: Applications, trends, technologies, and open research problems,” IEEE network, vol. 34, no. 3, pp. 134–142, 2019.
- F. Liu, Y. Cui, C. Masouros, J. Xu, T. X. Han, Y. C. Eldar, and S. Buzzi, “Integrated sensing and communications: Toward dual-functional wireless networks for 6g and beyond,” IEEE journal on selected areas in communications, vol. 40, no. 6, pp. 1728–1767, 2022.
- S. Fdida, N. Makris, T. Korakis, R. Bruno, A. Passarella, P. Andreou, B. Belter, C. Crettaz, W. Dabbous, Y. Demchenko et al., “Slices, a scientific instrument for the networking community,” Computer Communications, vol. 193, pp. 189–203, 2022.
- D. Simeonidou, “Bristol is open,” in 5G Radio Technology Seminar. Exploring Technical Challenges in the Emerging 5G Ecosystem, 2015, pp. 1–32.
- R. Martínez, R. Munoz, M. Requena, J. Sorribes, J. Comellas, and G. Junyent, “Adrenaline testbed: architecture and implementation of gmpls-based network resource manager and routing controller,” in Proc. of TRIDENTCOM’06, 2006, pp. 10–pp.
- M. Berman, J. S. Chase, L. Landweber, A. Nakao, M. Ott, D. Raychaudhuri, R. Ricci, and I. Seskar, “Geni: A federated testbed for innovative network experiments,” Computer Networks, vol. 61, pp. 5–23, 2014.
- M. Hibler, R. Ricci, L. Stoller, J. Duerig, S. Guruprasad, T. Stack, K. Webb, and J. Lepreau, “Large-scale virtualization in the emulab network testbed,” in Proc. of USENIX ATC’08, 2008.
- P. Demeester, P. Van Daele, T. Wauters, and H. Hrasnica, “Fed4fire–the largest federation of testbeds in europe,” in Building the future internet through FIRE. River Publishers, 2022, pp. 87–109.
- M. Ott, I. Seskar, R. Siraccusa, and M. Singh, “Orbit testbed software architecture: Supporting experiments as a service,” in Proc. of TRIDENTCOM’05, 2005, pp. 136–145.
- D. e. a. Raychaudhuri, “Challenge: Cosmos: A city-scale programmable testbed for experimentation with advanced wireless,” in Proc. of MobiCom 2020, New York, NY, USA, 2020.
- J. e. a. Breen, “Powder: Platform for open wireless data-driven experimental research,” in Proc. of WiNTECH ’20, ser. WiNTECH ’20, New York, NY, USA, 2020, p. 17–24. [Online]. Available: https://doi.org/10.1145/3411276.3412204
- A. P. Silva, C. Tranoris, S. Denazis, S. Sargento, J. Pereira, M. Luís, R. Moreira, F. Silva, I. Vidal, B. Nogales, R. Nejabati, and D. Simeonidou, “5ginfire: An end-to-end open5g vertical network function ecosystem,” Ad Hoc Networks, vol. 93, p. 101895, 2019.
- J. Kalliovaara, R. Ekman, J. Paavola, T. Jokela, J. Hallio, J. Auranen, P. Talmola, and H. Kokkinen, “Designing a testbed infrastructure for experimental validation and trialing of 5g vertical applications,” in Cognitive Radio Oriented Wireless Networks. Cham: Springer International Publishing, 2018, pp. 247–263.
- B. Chun, D. Culler, T. Roscoe, A. Bavier, L. Peterson, M. Wawrzoniak, and M. Bowman, “Planetlab: an overlay testbed for broad-coverage services,” ACM SIGCOMM Computer Communication Review, vol. 33, no. 3, pp. 3–12, 2003.
- S. Fdida, T. Friedman, and T. Parmentelat, “Onelab: An open federated facility for experimentally driven future internet research,” in New Network Architectures: The Path to the Future Internet. Springer, 2010, pp. 141–152.
- R. Ricci, E. Eide, and C. Team, “Introducing cloudlab: Scientific infrastructure for advancing cloud architectures and applications,” ; login:: the magazine of USENIX & SAGE, vol. 39, no. 6, pp. 36–38, 2014.
- S. Sharma, S. Urumkar, G. Fontanesi, B. Ramamurthy, and A. Nag, “Future wireless networking experiments escaping simulations,” Future Internet, vol. 14, no. 4, p. 120, 2022.
- M. D. Renzo, M. Debbah, D.-T. Phan-Huy, A. Zappone, M.-S. Alouini, C. Yuen, V. Sciancalepore, G. C. Alexandropoulos, J. Hoydis, H. Gacanin et al., “Smart radio environments empowered by reconfigurable ai meta-surfaces: An idea whose time has come,” EURASIP Journal on Wireless Communications and Networking, vol. 2019, no. 1, pp. 1–20, 2019.
- M. Di Renzo, A. Zappone, M. Debbah, M.-S. Alouini, C. Yuen, J. De Rosny, and S. Tretyakov, “Smart radio environments empowered by reconfigurable intelligent surfaces: How it works, state of research, and the road ahead,” IEEE journal on selected areas in communications, vol. 38, no. 11, pp. 2450–2525, 2020.
- W. Li, Q. Ma, C. Liu, Y. Zhang, X. Wu, J. Wang, S. Gao, T. Qiu, T. Liu, Q. Xiao et al., “Intelligent metasurface system for automatic tracking of moving targets and wireless communications based on computer vision,” Nature Communications, vol. 14, no. 1, p. 989, 2023.
- J. Han, D. Zhang, G. Cheng, N. Liu, and D. Xu, “Advanced deep-learning techniques for salient and category-specific object detection: a survey,” IEEE Signal Processing Magazine, vol. 35, no. 1, pp. 84–100, 2018.
- “O-ran alliance,” https://www.o-ran.org/, accessed: Feb. 16, 2024.
- “Openairinterface — 5g software alliance for democratising wireless innovation,” https://openairinterface.org//, accessed: Feb. 16, 2024.
- Y. Liu, S. K. Crisp, and D. M. Blough, “Performance study of statistical and deterministic channel models for mmwave wi-fi networks in ns-3,” in Proc. of WNS3’21, 2021, pp. 33–40.
- D. Adesina, C.-C. Hsieh, Y. E. Sagduyu, and L. Qian, “Adversarial machine learning in wireless communications using rf data: A review,” IEEE Communications Surveys & Tutorials, 2022.
- K. Faisal and W. Choi, “Machine learning approaches for reconfigurable intelligent surfaces: A survey,” IEEE Access, vol. 10, pp. 27 343–27 367, 2022.
- A. Adate and B. Tripathy, “A survey on deep learning methodologies of recent applications,” Deep learning in data analytics: Recent techniques, practices and applications, pp. 145–170, 2022.
- L. Vilaça, Y. Yu, and P. Viana, “Recent advances and challenges in deep audio-visual correlation learning,” arXiv preprint arXiv:2202.13673, 2022.
- J. Goldsmith, C. Ramsay, D. Northcote, K. W. Barlee, L. H. Crockett, and R. W. Stewart, “Control and visualisation of a software defined radio system on the xilinx rfsoc platform using the pynq framework,” IEEE Access, vol. 8, pp. 129 012–129 031, 2020.
- “3gpp ts 38.215, 5g nr physical layer measurements,” https://www.etsi.org/deliver/etsi_ts/138200_138299/138215/16.02.00_60 /ts_138215v160200p.pdf, accessed: Feb. 16, 2024.
- “Converge project,” https://converge-project.eu, accessed: Feb. 16, 2024.
- “Oaibox,” http://www.oaibox.com/, accessed: Feb. 16, 2024.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.
