Using Decentralized Aggregation for Federated Learning with Differential Privacy (2311.16008v1)
Abstract: Nowadays, the ubiquitous usage of mobile devices and networks have raised concerns about the loss of control over personal data and research advance towards the trade-off between privacy and utility in scenarios that combine exchange communications, big databases and distributed and collaborative (P2P) Machine Learning techniques. On the other hand, although Federated Learning (FL) provides some level of privacy by retaining the data at the local node, which executes a local training to enrich a global model, this scenario is still susceptible to privacy breaches as membership inference attacks. To provide a stronger level of privacy, this research deploys an experimental environment for FL with Differential Privacy (DP) using benchmark datasets. The obtained results show that the election of parameters and techniques of DP is central in the aforementioned trade-off between privacy and utility by means of a classification example.
- Deep learning with differential privacy. In Proceedings of the 2016 ACM SIGSAC conference on computer and communications security. 308–318.
- IFed: A novel federated learning framework for local differential privacy in Power Internet of Things. International J. of Distributed Sensor Networks 16, 5 (2020), 1550147720919698.
- Differential privacy-enabled federated learning for sensitive health data. arXiv preprint arXiv:1910.02578 (2019).
- Cynthia Dwork and Aaron Roth. 2014. The algorithmic foundations of differential privacy. Foundations and Trends® in Theoretical Computer Science 9, 3–4 (2014), 211–407.
- Differential privacy for industrial internet of things: Opportunities, applications, and challenges. IEEE Internet of Things J. 8, 13 (2021), 10430–10451.
- Differential privacy protection over deep learning: An investigation of its impacted factors. Computers & Security 99 (2020), 102061.
- Communication-efficient learning of deep networks from decentralized data. In Artificial intelligence and statistics. PMLR, 1273–1282.
- Federated learning with differential privacy: Algorithms and performance analysis. IEEE Trans. on Information Forensics and Security 15 (2020), 3454–3469.
- A survey on federated learning. Knowledge-Based Systems 216 (2021), 106775.
- Understanding Clipping for Federated Learning: Convergence and Client-Level Differential Privacy. arXiv preprint arXiv:2106.13673 (2021).
- Utility Optimization of Federated Learning with Differential Privacy. Discrete Dynamics in Nature and Society 2021 (2021).