Federated Learning with Heterogeneous Data Handling for Robust Vehicular Object Detection (2405.01108v1)
Abstract: In the pursuit of refining precise perception models for fully autonomous driving, continual online model training becomes essential. Federated Learning (FL) within vehicular networks offers an efficient mechanism for model training while preserving raw sensory data integrity. Yet, FL struggles with non-identically distributed data (e.g., quantity skew), leading to suboptimal convergence rates during model training. In previous work, we introduced FedLA, an innovative Label-Aware aggregation method addressing data heterogeneity in FL for generic scenarios. In this paper, we introduce FedProx+LA, a novel FL method building upon the state-of-the-art FedProx and FedLA to tackle data heterogeneity, which is specifically tailored for vehicular networks. We evaluate the efficacy of FedProx+LA in continuous online object detection model training. Through a comparative analysis against conventional and state-of-the-art methods, our findings reveal the superior convergence rate of FedProx+LA. Notably, if the label distribution is very heterogeneous, our FedProx+LA approach shows substantial improvements in detection performance compared to baseline methods, also outperforming our previous FedLA approach. Moreover, both FedLA and FedProx+LA increase convergence speed by 30% compared to baseline methods.
- Autonomous vehicle perception: The technology of today and tomorrow. Transportation research part C: emerging technologies, 89:384–406, 2018.
- Computing systems for autonomous driving: State of the art and challenges. IEEE Internet of Things Journal, 8(8):6469–6486, 2020.
- Collective perception: A safety perspective. Sensors, 21(1):159, 2020.
- Situational collective perception: Adaptive and efficient collective perception in future vehicular systems. In International Conference on Vehicle Technology and Intelligent Transport Systems, pages 346–352, 2022.
- Communication-efficient learning of deep networks from decentralized data. In Artificial intelligence and statistics, pages 1273–1282. PMLR, 2017.
- Priyanka Mary Mammen. Federated learning: Opportunities and challenges. arXiv preprint arXiv:2101.05428, 2021.
- Resource constrained vehicular edge federated learning with highly mobile connected vehicles. IEEE Journal on Selected Areas in Communications, 2023.
- Rethinking data heterogeneity in federated learning: Introducing a new notion and standard benchmarks. IEEE Transactions on Artificial Intelligence, 2023.
- Heterogeneous federated learning: State-of-the-art and research challenges. ACM Computing Surveys, 56(3):1–44, 2023.
- Label-aware aggregation for improved federated learning. In 2023 Eighth International Conference on Fog and Mobile Edge Computing (FMEC), pages 216–223. IEEE, 2023.
- Federated optimization in heterogeneous networks. Proceedings of Machine learning and systems, 2:429–450, 2020.
- Advances and open problems in federated learning. Foundations and Trends® in Machine Learning, 14(1–2):1–210, 2021.
- Federated learning on non-iid data silos: An experimental study. In 2022 IEEE 38th International Conference on Data Engineering (ICDE), pages 965–978. IEEE, 2022.
- Federated learning with non-iid data. arXiv preprint arXiv:1806.00582, 2018.
- On the convergence of fedavg on non-iid data. arXiv preprint arXiv:1907.02189, 2019.
- Measuring the effects of non-identical data distribution for federated visual classification. arXiv preprint arXiv:1909.06335, 2019.
- Tackling the objective inconsistency problem in heterogeneous federated optimization. Advances in neural information processing systems, 33:7611–7623, 2020.
- Model-contrastive federated learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10713–10722, 2021.
- Fed2a: Federated learning mechanism in asynchronous and adaptive modes. Electronics, 11(9):1393, 2022.
- Fedbikd: Federated bidirectional knowledge distillation for distracted driving detection. IEEE Internet of Things Journal, 2023.
- Emnist: an extension of mnist to handwritten letters (2017). arXiv preprint arXiv:1702.05373, 2017.
- Cifar-100 (canadian institute for advanced research). 2009.
- nuscenes: A multimodal dataset for autonomous driving, 2019.
- Sven Elflein. Out-of-distribution detection with energy-based models. arXiv preprint arXiv:2302.12002, 2023.
- YOLO by Ultralytics, January 2023.
- Bharat Mahaur and KK Mishra. Small-object detection based on yolov5 in autonomous driving systems. Pattern Recognition Letters, 168:115–122, 2023.
- Generalized intersection over union: A metric and a loss for bounding box regression. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 658–666, 2019.