HawkRover: An Autonomous mmWave Vehicular Communication Testbed with Multi-sensor Fusion and Deep Learning (2401.01822v2)
Abstract: Connected and automated vehicles (CAVs) have become a transformative technology that can change our daily life. Currently, millimeter-wave (mmWave) bands are identified as the promising CAV connectivity solution. While it can provide high data rate, their realization faces many challenges such as high attenuation during mmWave signal propagation and mobility management. Existing solution has to initiate pilot signal to measure channel information, then apply signal processing to calculate the best narrow beam towards the receiver end to guarantee sufficient signal power. This process takes significant overhead and time, hence not suitable for vehicles. In this study, we propose an autonomous and low-cost testbed to collect extensive co-located mmWave signal and other sensors data such as LiDAR (Light Detection and Ranging), cameras, ultrasonic, etc, traditionally for automated'', to facilitate mmWave vehicular communications. Intuitively, these sensors can build a 3D map around the vehicle and signal propagation path can be estimated, eliminating iterative the process via pilot signals. This multimodal data fusion, together with AI, is expected to bring significant advances inconnected'' research.
- “World Health Organization (WHO) global status report on road safety 2018,” https://www.who.int/publications/i/item/9789241565684, accessed: 2023-10-1.
- J. B. Kenney, “Dedicated short-range communications (dsrc) standards in the united states,” Proceedings of the IEEE, vol. 99, no. 7, pp. 1162–1182, 2011.
- L. Zhang, H. Sun, J. Sun, R. Parasuraman, Y. Ye, and R. Q. Hu, “Map2schedule: An end-to-end link scheduling method for urban v2v communications,” 2023.
- A. Klautau, N. González-Prelcic, and R. W. Heath, “Lidar data for deep learning-based mmwave beam-selection,” IEEE Wireless Communications Letters, vol. 8, no. 3, pp. 909–912, 2019.
- W. Xu, F. Gao, S. Jin, and A. Alkhateeb, “3d scene-based beam selection for mmwave communications,” IEEE Wireless Communications Letters, vol. 9, no. 11, pp. 1850–1854, 2020.
- M. Alrabeiah, A. Hredzak, Z. Liu, and A. Alkhateeb, “Viwi: A deep learning dataset framework for vision-aided wireless communications,” in 2020 IEEE 91st Vehicular Technology Conference (VTC2020-Spring). IEEE, 2020, pp. 1–5.
- M. Quigley, K. Conley, B. Gerkey, J. Faust, T. Foote, J. Leibs, R. Wheeler, A. Y. Ng et al., “Ros: an open-source robot operating system,” in ICRA workshop on open source software, vol. 3, no. 3.2. Kobe, Japan, 2009, p. 5.
- Q. Zhang and C. Yang, “Testbed and performance evaluation of 3d mmwave beam tracking in mobility scenario,” in IEEE INFOCOM 2022-IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS). IEEE, 2022, pp. 1–2.
- “An opensource diy self driving platform for small scale cars.” https://www.donkeycar.com, accessed: 2023-10-1.
- D. Steinmetzer, D. Wegemer, M. Schulz, J. Widmer, and M. Hollick, “Compressive millimeter-wave sector selection in off-the-shelf ieee 802.11 ad devices,” in Proceedings of the 13th International Conference on emerging Networking EXperiments and Technologies, 2017, pp. 414–425.
- M. Pajovic, P. Wang, T. Koike-Akino, H. Sun, and P. V. Orlik, “Fingerprinting-based indoor localization with commercial mmwave wifi-part i: Rss and beam indices,” in 2019 IEEE Global Communications Conference (GLOBECOM). IEEE, 2019, pp. 1–6.
- T. Koike-Akino, P. Wang, M. Pajovic, H. Sun, and P. V. Orlik, “Fingerprinting-based indoor localization with commercial mmwave wifi: A deep learning approach,” IEEE Access, vol. 8, pp. 84 879–84 892, 2020.
- P. Wang, M. Pajovic, T. Koike-Akino, H. Sun, and P. V. Orlik, “Fingerprinting-based indoor localization with commercial mmwave wifi-part ii: Spatial beam snrs,” in 2019 IEEE Global Communications Conference (GLOBECOM). IEEE, 2019, pp. 1–6.
- T. Dalgaty, T. Mesquida, D. Joubert, A. Sironi, P. Vivet, and C. Posch, “Hugnet: Hemi-spherical update graph neural network applied to low-latency event-based optical flow,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 3952–3961.
- S. Jiang and A. Alkhateeb, “Computer vision aided beam tracking in a real-world millimeter wave deployment,” in 2022 IEEE Globecom Workshops (GC Wkshps). IEEE, 2022, pp. 142–147.