Data Poisoning Attacks in Gossip Learning
Abstract: Traditional machine learning systems were designed in a centralized manner. In such designs, the central entity maintains both the machine learning model and the data used to adjust the model's parameters. As data centralization yields privacy issues, Federated Learning was introduced to reduce data sharing and have a central server coordinate the learning of multiple devices. While Federated Learning is more decentralized, it still relies on a central entity that may fail or be subject to attacks, provoking the failure of the whole system. Then, Decentralized Federated Learning removes the need for a central server entirely, letting participating processes handle the coordination of the model construction. This distributed control urges studying the possibility of malicious attacks by the participants themselves. While poisoning attacks on Federated Learning have been extensively studied, their effects in Decentralized Federated Learning did not get the same level of attention. Our work is the first to propose a methodology to assess poisoning attacks in Decentralized Federated Learning in both churn free and churn prone scenarios. Furthermore, in order to evaluate our methodology on a case study representative for gossip learning we extended the gossipy simulator with an attack injector module.
- PEPPER: Empowering User-Centric Recommender Systems over Gossip Learning. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 6(3):101:1–101:27, Sept. 2022.
- Decentralized Federated Learning: Fundamentals, State of the Art, Frameworks, Trends, and Challenges. IEEE Communications Surveys & Tutorials, pages 1–1, 2023.
- signSGD: Compressed Optimisation for Non-Convex Problems. In Proceedings of the 35th International Conference on Machine Learning, pages 560–569. PMLR, July 2018.
- signSGD with Majority Vote is Communication Efficient and Fault Tolerant. In International Conference on Learning Representations, Sept. 2018.
- Improving Gossip Learning via Limited Model Merging. In Advances in Computational Collective Intelligence, Communications in Computer and Information Science, pages 351–363, Cham, 2023. Springer Nature Switzerland.
- P. Erdős and A. Rényi. On random graphs I. Publicationes Mathematicae Debrecen, 6:290–297, 1959.
- L. Giaretta and Š. Girdzijauskas. Gossip Learning: Off the Beaten Path. In 2019 IEEE International Conference on Big Data (Big Data), pages 1117–1124, Dec. 2019.
- User-Centric Online Gossip Training for Autoencoder-Based CSI Feedback. IEEE Journal of Selected Topics in Signal Processing, 16(3):559–572, Apr. 2022.
- Decentralized learning works: An empirical comparison of gossip learning and federated learning. Journal of Parallel and Distributed Computing, 148:109–124, Feb. 2021.
- MNIST handwritten digit database. ATT Labs [Online], 2, 2010.
- Threats, attacks and defenses to federated learning: Issues, taxonomy and perspectives. Cybersecurity, 5(1):1–19, Dec. 2022.
- Impact of random failures and attacks on Poisson and power-law random networks. ACM Computing Surveys, 43(3):13:1–13:31, Apr. 2011.
- Communication-Efficient Learning of Deep Networks from Decentralized Data, Feb. 2016.
- Gossip learning with linear models on fully distributed data. Concurrency and Computation: Practice and Experience, 25(4):556–571, 2013.
- PyTorch: An Imperative Style, High-Performance Deep Learning Library. In Advances in Neural Information Processing Systems, volume 32. Curran Associates, Inc., 2019.
- FL-SEC: Privacy-Preserving Decentralized Federated Learning Using SignSGD for the Internet of Artificially Intelligent Things. IEEE Internet of Things Magazine, 5(1):85–90, Mar. 2022.
- Collective dynamics of ‘small-world’ networks. Nature, 393(6684):440–442, June 1998.
- Mitigating Backdoor Attacks in Federated Learning, Jan. 2021.
- Poisoning Attacks in Federated Learning: A Survey. IEEE Access, 11:10708–10722, 2023.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.