AdaMap: High-Scalable Real-Time Cooperative Perception at the Edge (2309.13526v2)
Abstract: Cooperative perception is the key approach to augment the perception of connected and automated vehicles (CAVs) toward safe autonomous driving. However, it is challenging to achieve real-time perception sharing for hundreds of CAVs in large-scale deployment scenarios. In this paper, we propose AdaMap, a new high-scalable real-time cooperative perception system, which achieves assured percentile end-to-end latency under time-varying network dynamics. To achieve AdaMap, we design a tightly coupled data plane and control plane. In the data plane, we design a new hybrid localization module to dynamically switch between object detection and tracking, and a novel point cloud representation module to adaptively compress and reconstruct the point cloud of detected objects. In the control plane, we design a new graph-based object selection method to un-select excessive multi-viewed point clouds of objects, and a novel approximated gradient descent algorithm to optimize the representation of point clouds. We implement AdaMap on an emulation platform, including realistic vehicle and server computation and a simulated 5G network, under a 150-CAV trace collected from the CARLA simulator. The evaluation results show that, AdaMap reduces up to 49x average transmission data size at the cost of 0.37 reconstruction loss, as compared to state-of-the-art solutions, which verifies its high scalability, adaptability, and computation efficiency.
- Fawad Ahmad et al. 2020. Carmap: Fast 3d feature map updates for automobiles. In 17th {normal-{\{{USENIX}normal-}\}} Symposium on Networked Systems Design and Implementation ({normal-{\{{NSDI}normal-}\}} 20). 1063–1081.
- Social lstm: Human trajectory prediction in crowded spaces. In Proceedings of the IEEE conference on computer vision and pattern recognition. 961–971.
- Florent Altché and Arnaud de La Fortelle. 2017. An LSTM network for highway trajectory prediction. In 2017 IEEE 20th international conference on intelligent transportation systems (ITSC). IEEE, 353–359.
- Edge-SLAM: Edge-assisted visual simultaneous localization and mapping. ACM Transactions on Embedded Computing Systems 22, 1 (2022), 1–31.
- Convex optimization. Cambridge university press.
- Edge Computing Resources Reservation in Vehicular Networks: A Meta-Learning Approach. IEEE Transactions on Vehicular Technology 69, 5 (2020), 5634–5646. https://doi.org/10.1109/TVT.2020.2983445
- Adaptive Delivery for High Definition Map Using A Multi-Arm Bandit Approach. In 2023 32nd Wireless and Optical Communications Conference (WOCC). 1–6. https://doi.org/10.1109/WOCC58016.2023.10139782
- Juan Chen et al. 2021. A DRL Agent for Jointly Optimizing Computation Offloading and Resource Allocation in MEC. IEEE Internet of Things Journal (2021).
- F-cooper: Feature based cooperative perception for autonomous vehicle edge computing system using 3D point clouds. In Proceedings of the 4th ACM/IEEE Symposium on Edge Computing. 88–100.
- Yann Collet and Murray Kucherawy. 2018. Zstandard Compression and the application/zstd Media Type. Technical Report.
- Automotive Edge Computing Consortium. June. 2021. Break Down the Barriers to Automotive Edge Adoption. White Paper. Automotive Edge Computing Consortium. https://aecc.org/events/breaking-down-the-barriers-to-automotive-edge-adoption/
- Recent advances in connected and automated vehicles. journal of traffic and transportation engineering (English edition) 6, 2 (2019), 109–131.
- Ryuichi Fukatsu and Kei Sakaguchi. 2019. Millimeter-wave V2V communications with cooperative perception for automated driving. In 2019 IEEE 89th vehicular technology conference (VTC2019-Spring). IEEE, 1–5.
- Deep learning for 3d point clouds: A survey. IEEE transactions on pattern analysis and machine intelligence 43, 12 (2020), 4338–4364.
- Where2comm: Communication-efficient collaborative perception via spatial confidence maps. Advances in neural information processing systems 35 (2022), 4874–4886.
- A guide to sample average approximation. Handbook of simulation optimization (2015), 207–243.
- An introduction to variational autoencoders. Foundations and Trends® in Machine Learning 12, 4 (2019), 307–392.
- Pointpillars: Fast encoders for object detection from point clouds. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 12697–12705.
- Luyang Liu and Marco Gruteser. 2021. EdgeSharing: Edge assisted real-time localization and object sharing in urban streets. In IEEE INFOCOM 2021-IEEE Conference on Computer Communications. IEEE, 1–10.
- Computing systems for autonomous driving: State of the art and challenges. IEEE Internet of Things Journal 8, 8 (2020), 6469–6486.
- Morphing and sampling network for dense point cloud completion. In Proceedings of the AAAI conference on artificial intelligence, Vol. 34. 11596–11603.
- Constraint-Aware Deep Reinforcement Learning for End-to-End Resource Orchestration in Mobile Networks. In 2021 IEEE 29th International Conference on Network Protocols (ICNP). IEEE, 1–11.
- OnSlicing: online end-to-end network slicing with reinforcement learning. In Proceedings of the 17th International Conference on emerging Networking EXperiments and Technologies. 141–153.
- EdgeSlice: Slicing wireless edge computing network with decentralized deep reinforcement learning. In 2020 IEEE 40th International Conference on Distributed Computing Systems (ICDCS). IEEE, 234–244.
- LiveMap: Real-Time Dynamic Map in Automotive Edge Computing. In IEEE INFOCOM 2021-IEEE Conference on Computer Communications. IEEE, 1–10.
- ORB-SLAM: a versatile and accurate monocular SLAM system. IEEE transactions on robotics 31, 5 (2015), 1147–1163.
- Online. 2022. Video appears to show a Tesla’s autopilot system confusing horse-drawn carriage for truck. https://www.businessinsider.com/video-tesla-autopilot-appears-to-confuse-horse-drawn-carriage-truck-2022-8
- An open-source techno-economic assessment framework for 5G deployment. IEEE Access 7 (2019), 155930–155940.
- Pointnet: Deep learning on point sets for 3d classification and segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition. 652–660.
- Hang Qiu et al. 2022. AutoCast: scalable infrastructure-less cooperative perception for distributed collaborative driving. In Proceedings of the 20th Annual International Conference on Mobile Systems, Applications and Services. 128–141.
- Avr: Augmented vehicular reality. In Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services. 81–95.
- Xukan Ran et al. 2018. Deepdecision: A mobile deep learning framework for edge video analytics. In IEEE Conference on Computer Communications. IEEE, 1421–1429.
- Alexander Shapiro and Andy Philpott. 2007. A tutorial on stochastic programming. Manuscript. Available at www2. isye. gatech. edu/ashapiro/publications. html 17 (2007).
- VIPS: Real-time perception fusion for infrastructure-assisted autonomous driving. In Proceedings of the 28th Annual International Conference on Mobile Computing And Networking. 133–146.
- Jack Stilgoe and Jack Stilgoe. 2020. Who killed elaine herzberg? Who’s Driving Innovation? New Technologies and the Collaborative State (2020), 1–6.
- AutoC2X: Open-source software to realize V2X cooperative perception among autonomous vehicles. In 2020 IEEE 92nd Vehicular Technology Conference (VTC2020-Fall). IEEE, 1–6.
- Elisabeth Uhlemann. 2018. Time for autonomous vehicles to connect [connected vehicles]. IEEE vehicular technology magazine 13, 3 (2018), 10–13.
- Bill Vlasic and Neal E Boudette. 2016. Self-driving Tesla was involved in fatal crash, US says. New York Times 302016 (2016).
- Networking and communications in autonomous driving: A survey. IEEE Communications Surveys & Tutorials 21, 2 (2018), 1243–1274.
- An introduction to the Kalman filter. (1995).
- Pmp-net: Point cloud completion by learning multi-step point moving paths. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 7443–7452.
- Balanced chamfer distance as a comprehensive metric for point cloud completion. Advances in Neural Information Processing Systems 34 (2021), 29088–29100.
- Edge-assisted collaborative perception in autonomous driving: A reflection on communication design. In 2021 IEEE/ACM Symposium on Edge Computing (SEC). IEEE, 371–375.
- Pointr: Diverse point cloud completion with geometry-aware transformers. In Proceedings of the IEEE/CVF international conference on computer vision. 12498–12507.
- A survey of autonomous driving: Common practices and emerging technologies. IEEE access 8 (2020), 58443–58469.
- Jing Zhang et al. 2018. Joint computation offloading and resource allocation optimization in heterogeneous networks with mobile edge computing. IEEE Access 6 (2018), 19324–19337.
- Emp: Edge-assisted multi-vehicle perception. In Proceedings of the 27th Annual International Conference on Mobile Computing and Networking. 545–558.
- Review of advanced driver assistance systems (ADAS). In AIP Conference Proceedings, Vol. 1906. AIP Publishing.