PACP: Priority-Aware Collaborative Perception for Connected and Autonomous Vehicles (2404.06891v3)
Abstract: Surrounding perceptions are quintessential for safe driving for connected and autonomous vehicles (CAVs), where the Bird's Eye View has been employed to accurately capture spatial relationships among vehicles. However, severe inherent limitations of BEV, like blind spots, have been identified. Collaborative perception has emerged as an effective solution to overcoming these limitations through data fusion from multiple views of surrounding vehicles. While most existing collaborative perception strategies adopt a fully connected graph predicated on fairness in transmissions, they often neglect the varying importance of individual vehicles due to channel variations and perception redundancy. To address these challenges, we propose a novel Priority-Aware Collaborative Perception (PACP) framework to employ a BEV-match mechanism to determine the priority levels based on the correlation between nearby CAVs and the ego vehicle for perception. By leveraging submodular optimization, we find near-optimal transmission rates, link connectivity, and compression metrics. Moreover, we deploy a deep learning-based adaptive autoencoder to modulate the image reconstruction quality under dynamic channel conditions. Finally, we conduct extensive studies and demonstrate that our scheme significantly outperforms the state-of-the-art schemes by 8.27\% and 13.60\%, respectively, in terms of utility and precision of the Intersection over Union.
- S. Hu, Z. Fang, Y. Deng, X. Chen, and Y. Fang, “Collaborative perception for connected and autonomous driving: Challenges, possible solutions and opportunities,” arXiv preprint arXiv:2401.01544, 2024.
- S. Hu, Z. Fang, H. An, G. Xu, Y. Zhou, X. Chen, and Y. Fang, “Adaptive communications in collaborative perception with domain alignment for autonomous driving,” arXiv preprint arXiv:2310.00013, 2023.
- S. Hu, Z. Fang, X. Chen, Y. Fang, and S. Kwong, “Towards full-scene domain generalization in multi-agent collaborative bird’s eye view segmentation for connected and autonomous driving,” arXiv preprint arXiv:2311.16754, 2023.
- X. Chen, Y. Deng, H. Ding, G. Qu, H. Zhang, P. Li, and Y. Fang, “Vehicle as a service (VaaS): Leverage vehicles to build service networks and capabilities for smart cities,” arXiv preprint arXiv:2304.11397, 2023.
- Y. Xiao, F. Codevilla, A. Gurram, O. Urfalioglu, and A. M. López, “Multimodal end-to-end autonomous driving,” IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 1, pp. 537–547, Aug. 2022.
- R. Xu, Z. Tu, H. Xiang, W. Shao, B. Zhou, and J. Ma, “CoBEVT: Cooperative bird’s eye view semantic segmentation with sparse transformers,” in Conference on Robot Learning (CoRL), Auckland, NZ, Dec. 2022.
- Y. Zhang, H. An, Z. Fang, G. Xu, Y. Zhou, X. Chen, and Y. Fang, “SmartCooper: Vehicular collaborative perception with adaptive fusion and judger mechanism,” in IEEE International Conference on Robotics and Automation (ICRA), Yokohama, Japan, May 2024.
- Y. Yuan, H. Cheng, and M. Sester, “Keypoints-based deep feature fusion for cooperative vehicle detection of autonomous driving,” IEEE Robotics and Automation Letters, vol. 7, no. 2, pp. 3054–3061, Jan. 2022.
- M. Noor-A-Rahim, Z. Liu, H. Lee, M. O. Khyam, J. He, D. Pesch, K. Moessner, W. Saad, and H. V. Poor, “6G for vehicle-to-everything (V2X) communications: Enabling technologies, challenges, and opportunities,” Proceedings of the IEEE, vol. 110, no. 6, pp. 712–734, May 2022.
- Y.-C. Liu, J. Tian, N. Glaser, and Z. Kira, “When2com: Multi-agent perception via communication graph grouping,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA (Virtual), 2020, pp. 4106–4115.
- Z. Wang, Z. Zhang, J. Wang, C. Jiang, W. Wei, and Y. Ren, “AUV-assisted node repair for IoUT relying on multi-agent reinforcement learning,” IEEE Internet of Things Journal, (DOI: 10.1109/JIOT.2023.3298522), 2023.
- A. Geiger, P. Lenz, and R. Urtasun, “Are we ready for autonomous driving? The KITTI vision benchmark suite,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, Jul. 2012, pp. 3354–3361.
- Q. Chen, X. Ma, S. Tang, J. Guo, Q. Yang, and S. Fu, “F-cooper: Feature based cooperative perception for autonomous vehicle edge computing system using 3D point clouds,” in Proceedings of the 4th ACM/IEEE Symposium on Edge Computing, Arlington, Virginia, Nov. 2019, pp. 88–100.
- T.-H. Wang, S. Manivasagam, M. Liang, B. Yang, W. Zeng, and R. Urtasun, “V2VNet: Vehicle-to-vehicle communication for joint perception and prediction,” in European Conference on Computer Vision (ECCV), Glasgow, United Kingdom, Aug. 2020, pp. 605–621.
- J. Li, R. Xu, X. Liu, J. Ma, Z. Chi, J. Ma, and H. Yu, “Learning for vehicle-to-vehicle cooperative perception under lossy communication,” IEEE Transactions on Intelligent Vehicles, vol. 8, no. 4, pp. 2650–2660, Mar. 2023.
- S. Wang, Y. Hong, R. Wang, Q. Hao, Y.-C. Wu, and D. W. K. Ng, “Edge federated learning via unit-modulus over-the-air computation,” IEEE Transactions on Communications, vol. 70, no. 5, pp. 3141–3156, Feb. 2022.
- A. Skodras, C. Christopoulos, and T. Ebrahimi, “The JPEG 2000 still image compression standard,” IEEE Signal Processing Magazine, vol. 18, no. 5, pp. 36–58, Sep. 2001.
- H. Liu, H. Yuan, Q. Liu, J. Hou, and J. Liu, “A comprehensive study and comparison of core technologies for MPEG 3-D point cloud compression,” IEEE Transactions on Broadcasting, vol. 66, no. 3, pp. 701–717, Dec. 2020.
- Q. Chen, S. Tang, Q. Yang, and S. Fu, “Cooper: Cooperative perception for connected autonomous vehicles based on 3d point clouds,” in IEEE 39th International Conference on Distributed Computing Systems (ICDCS), Dallas, TX, Oct. 2019, pp. 514–524.
- Z. Y. Rawashdeh and Z. Wang, “Collaborative automated driving: A machine learning-based method to enhance the accuracy of shared information,” in 21st International Conference on Intelligent Transportation Systems (ITSC), Maui, Hawaii, Dec. 2018, pp. 3961–3966.
- X. Lyu, C. Zhang, C. Ren, and Y. Hou, “Distributed graph-based optimization of multicast data dissemination for internet of vehicles,” IEEE Transactions on Intelligent Transportation Systems, vol. 24, no. 3, pp. 3117–3128, Dec. 2022.
- B. L. Nguyen, D. T. Ngo, N. H. Tran, M. N. Dao, and H. L. Vu, “Dynamic V2I/V2V cooperative scheme for connectivity and throughput enhancement,” IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 2, pp. 1236–1246, Sep. 2022.
- Y. Ma, W. Liang, J. Wu, and Z. Xu, “Throughput maximization of NFV-enabled multicasting in mobile edge cloud networks,” IEEE Transactions on Parallel and Distributed Systems, vol. 31, no. 2, pp. 393–407, 2020.
- S. Zhang, J. Chen, F. Lyu, N. Cheng, W. Shi, and X. Shen, “Vehicular communication networks in the automated driving era,” IEEE Communications Magazine, vol. 56, no. 9, pp. 26–32, Sep. 2018.
- F. Yang, L. Herranz, J. Van De Weijer, J. A. I. Guitián, A. M. López, and M. G. Mozerov, “Variable rate deep image compression with modulated autoencoder,” IEEE Signal Processing Letters, vol. 27, pp. 331–335, Jul. 2020.
- E. R. Magsino and I. W.-H. Ho, “An enhanced information sharing roadside unit allocation scheme for vehicular networks,” IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 9, pp. 15 462–15 475, Jan. 2022.
- A. Dosovitskiy, G. Ros, F. Codevilla, A. Lopez, and V. Koltun, “CARLA: An open urban driving simulator,” in Conference on robot learning (CoRL), Mountain View, California, Nov. 2017, pp. 1–16.
- R. Xu, H. Xiang, X. Xia, X. Han, J. Li, and J. Ma, “OPV2V: An open benchmark dataset and fusion pipeline for perception with vehicle-to-vehicle communication,” in International Conference on Robotics and Automation (ICRA), Philadelphia, PA, May 2022, pp. 2583–2589.
- Y. Yu, T. Wang, and S. C. Liew, “Deep-reinforcement learning multiple access for heterogeneous wireless networks,” IEEE Journal on Selected Areas in Communications, vol. 37, no. 6, pp. 1277–1290, Jun. 2019.
- M. Adil, H. Song, J. Ali, M. A. Jan, M. Attique, S. Abbas, and A. Farouk, “Enhanced-AODV: A robust three phase priority-based traffic load balancing scheme for internet of things,” IEEE Internet of Things Journal, vol. 9, no. 16, pp. 14 426–14 437, Apr. 2022.
- X. Luo and P. Li, “Learning-based off-chain transaction scheduling in prioritized payment channel networks,” IEEE Journal on Selected Areas in Communications, vol. 40, no. 12, pp. 3589–3599, Oct. 2022.
- W. Anwar, N. Franchi, and G. Fettweis, “Physical layer evaluation of V2X communications technologies: 5G NR-V2X, LTE-V2X, IEEE 802.11bd, and IEEE 802.11p,” in IEEE 90th Vehicular Technology Conference (VTC2019-Fall), Honolulu, HI, Sep. 2019, pp. 1–7.
- M. Adil, H. Song, J. Ali, M. A. Jan, M. Attique, S. Abbas, and A. Farouk, “Enhanced-AODV: A robust three phase priority-based traffic load balancing scheme for internet of things,” IEEE Internet of Things Journal, vol. 9, no. 16, pp. 14 426–14 437, Apr. 2021.
- Z. Xiao, Z. Han, A. Nallanathan, O. A. Dobre, B. Clerckx, J. Choi, C. He, and W. Tong, “Antenna array enabled space/air/ground communications and networking for 6G,” IEEE Journal on Selected Areas in Communications, vol. 40, no. 10, pp. 2773–2804, Aug. 2022.
- W. Chen, X. Lin, J. Lee, A. Toskala, S. Sun, C. F. Chiasserini, and L. Liu, “5G-Advanced toward 6G: Past, present, and future,” IEEE Journal on Selected Areas in Communications, vol. 41, no. 6, pp. 1592–1619, Jun. 2023.
- S. Dobzinski and J. Vondrák, “Communication complexity of combinatorial auctions with submodular valuations,” in Twenty-Fourth Annual ACM-SIAM Symposium on Discrete Algorithms, 2013, pp. 1205–1215.
- A. Krause and D. Golovin, “Submodular function maximization.” Tractability, vol. 3, no. 71-104, p. 3, 2014.
- J. Ballé, V. Laparra, and E. P. Simoncelli, “End-to-end optimized image compression,” in International Conference on Learning Representations (ICLR), Toulon, France, Apr. 2017, pp. 1–27.