Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
102 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

The Implications of Decentralization in Blockchained Federated Learning: Evaluating the Impact of Model Staleness and Inconsistencies (2310.07471v2)

Published 11 Oct 2023 in cs.NI, cs.AI, and cs.DC

Abstract: Blockchain promises to enhance distributed ML approaches such as federated learning (FL) by providing further decentralization, security, immutability, and trust, which are key properties for enabling collaborative intelligence in next-generation applications. Nonetheless, the intrinsic decentralized operation of peer-to-peer (P2P) blockchain nodes leads to an uncharted setting for FL, whereby the concepts of FL round and global model become meaningless, as devices' synchronization is lost without the figure of a central orchestrating server. In this paper, we study the practical implications of outsourcing the orchestration of FL to a democratic setting such as in a blockchain. In particular, we focus on the effects that model staleness and inconsistencies, endorsed by blockchains' modus operandi, have on the training procedure held by FL devices asynchronously. Using simulation, we evaluate the blockchained FL operation by applying two different ML models (ranging from low to high complexity) on the well-known MNIST and CIFAR-10 datasets, respectively, and focus on the accuracy and timeliness of the solutions. Our results show the high impact of model inconsistencies on the accuracy of the models (up to a ~35% decrease in prediction accuracy), which underscores the importance of properly designing blockchain systems based on the characteristics of the underlying FL application.

PDF HTML Abstract
Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Bookmark Chat Bubble Oval Streamline Icon: https://streamlinehq.com Chat (Pro)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (59)
  1. Z. Zhou, X. Chen, E. Li, L. Zeng, K. Luo, and J. Zhang, “Edge intelligence: Paving the last mile of artificial intelligence with edge computing,” Proceedings of the IEEE, vol. 107, no. 8, pp. 1738–1762, 2019.
  2. E. Guerra, F. Wilhelmi, M. Miozzo, and D. Paolo, “The Cost of Training Machine Learning Models over Distributed Data Sources,” IEEE Open Journal of the Communications Society, 2023.
  3. J. Konečnỳ, H. B. McMahan, F. X. Yu, P. Richtárik, A. T. Suresh, and D. Bacon, “Federated learning: Strategies for improving communication efficiency,” arXiv preprint arXiv:1610.05492, 2016.
  4. B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. y Arcas, “Communication-efficient learning of deep networks from decentralized data,” in Artificial intelligence and statistics.   PMLR, 2017, pp. 1273–1282.
  5. T. Li, A. K. Sahu, A. Talwalkar, and V. Smith, “Federated learning: Challenges, methods, and future directions,” IEEE Signal Processing Magazine, vol. 37, no. 3, pp. 50–60, 2020.
  6. S. R. Pokhrel and J. Choi, “A decentralized federated learning approach for connected autonomous vehicles,” in 2020 IEEE Wireless Communications and Networking Conference Workshops (WCNCW).   IEEE, 2020, pp. 1–6.
  7. S. Nakamoto, “Bitcoin: A Peer-to-Peer electronic cash system,” Tech. Rep., 2008.
  8. U. Majeed and C. S. Hong, “FLchain: Federated learning via MEC-enabled blockchain network,” in 2019 20th Asia-Pacific Network Operations and Management Symposium (APNOMS).   IEEE, 2019, pp. 1–4.
  9. E. K. Wang, Z. Liang, C.-M. Chen, S. Kumari, and M. K. Khan, “PoRX: A reputation incentive scheme for blockchain consensus of IIoT,” Future generation computer systems, vol. 102, pp. 140–151, 2020.
  10. F. Wilhelmi, E. Guerra, and P. Dini, “On the decentralization of blockchain-enabled asynchronous federated learning,” in 2023 IEEE 9th International Conference on Network Softwarization (NetSoft).   IEEE, 2023, pp. 408–413.
  11. ——, “BlockFLsim: Blockchain Federated Learning Simulator,” 2022. [Online]. Available: https://gitlab.cttc.es/supercom/blockFLsim/-/tree/BlockFLsim
  12. M. Alharby and A. Van Moorsel, “Blocksim: a simulation framework for blockchain systems,” ACM SIGMETRICS Performance Evaluation Review, vol. 46, no. 3, pp. 135–138, 2019.
  13. A. Paszke, S. Gross, F. Massa, A. Lerer, J. Bradbury, G. Chanan, T. Killeen, Z. Lin, N. Gimelshein, L. Antiga, A. Desmaison, A. Kopf, E. Yang, Z. DeVito, M. Raison, A. Tejani, S. Chilamkurthy, B. Steiner, L. Fang, J. Bai, and S. Chintala, “PyTorch: An Imperative Style, High-Performance Deep Learning Library,” in Advances in Neural Information Processing Systems 32.   Curran Associates, Inc., 2019, pp. 8024–8035.
  14. L. Deng, “The mnist database of handwritten digit images for machine learning research [best of the web],” IEEE signal processing magazine, vol. 29, no. 6, pp. 141–142, 2012.
  15. A. Krizhevsky, G. Hinton et al., “Learning multiple layers of features from tiny images,” 2009.
  16. A. Koloskova, N. Loizou, S. Boreiri, M. Jaggi, and S. Stich, “A unified theory of decentralized SGD with changing topology and local updates,” in Proceedings of the 37th International Conference on Machine Learning, ser. Proceedings of Machine Learning Research, H. D. III and A. Singh, Eds., vol. 119.   PMLR, 13–18 Jul 2020, pp. 5381–5393. [Online]. Available: https://proceedings.mlr.press/v119/koloskova20a.html
  17. A. Lalitha, S. Shekhar, T. Javidi, and F. Koushanfar, “Fully decentralized federated learning,” in Third workshop on bayesian deep learning (NeurIPS), vol. 2, 2018.
  18. R. Ormándi, I. Hegedűs, and M. Jelasity, “Gossip learning with linear models on fully distributed data,” Concurrency and Computation: Practice and Experience, vol. 25, no. 4, pp. 556–571, 2013.
  19. M. Miozzo, Z. Ali, L. Giupponi, and P. Dini, “Distributed and multi-task learning at the edge for energy efficient radio access networks,” IEEE Access, vol. 9, pp. 12 491–12 505, 2021.
  20. C. Hu, J. Jiang, and Z. Wang, “Decentralized federated learning: A segmented gossip approach,” arXiv preprint arXiv:1908.07782, 2019.
  21. T. Sun, D. Li, and B. Wang, “Decentralized federated averaging,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 45, no. 4, pp. 4289–4301, 2022.
  22. H. Xing, O. Simeone, and S. Bi, “Decentralized federated learning via SGD over wireless D2D networks,” in 2020 IEEE 21st international workshop on signal processing advances in wireless communications (SPAWC).   IEEE, 2020, pp. 1–5.
  23. Y. Qu, H. Dai, Y. Zhuang, J. Chen, C. Dong, F. Wu, and S. Guo, “Decentralized federated learning for UAV networks: Architecture, challenges, and opportunities,” IEEE Network, vol. 35, no. 6, pp. 156–162, 2021.
  24. A. G. Roy, S. Siddiqui, S. Pölsterl, N. Navab, and C. Wachinger, “Braintorrent: A peer-to-peer environment for decentralized federated learning,” arXiv preprint arXiv:1905.06731, 2019.
  25. S. Wang, T. Tuor, T. Salonidis, K. K. Leung, C. Makaya, T. He, and K. Chan, “Adaptive federated learning in resource constrained edge computing systems,” IEEE Journal on Selected Areas in Communications, vol. 37, no. 6, pp. 1205–1221, 2019.
  26. L. Liu, J. Zhang, S. Song, and K. B. Letaief, “Client-edge-cloud hierarchical federated learning,” in ICC 2020-2020 IEEE International Conference on Communications (ICC).   IEEE, 2020, pp. 1–6.
  27. Q. Chen, Z. Wang, Y. Zhou, J. Chen, D. Xiao, and X. Lin, “CFL: Cluster Federated Learning in Large-Scale Peer-to-Peer Networks,” in International Conference on Information Security.   Springer, 2022, pp. 464–472.
  28. E. T. M. Beltrán, M. Q. Pérez, P. M. S. Sánchez, S. L. Bernal, G. Bovet, M. G. Pérez, G. M. Pérez, and A. H. Celdrán, “Decentralized federated learning: Fundamentals, state-of-the-art, frameworks, trends, and challenges,” arXiv preprint arXiv:2211.08413, 2022.
  29. Q. W. Khan, A. N. Khan, A. Rizwan, R. Ahmad, S. Khan, and D. H. Kim, “Decentralized machine learning training: a survey on synchronization, consolidation, and topologies,” IEEE Access, 2023.
  30. E. Gabrielli, G. Pica, and G. Tolomei, “A Survey on Decentralized Federated Learning,” arXiv preprint arXiv:2308.04604, 2023.
  31. H. Kim, J. Park, M. Bennis, and S.-L. Kim, “Blockchained on-device federated learning,” IEEE Communications Letters, vol. 24, no. 6, pp. 1279–1283, 2019.
  32. D. C. Nguyen, M. Ding, Q.-V. Pham, P. N. Pathirana, L. B. Le, A. Seneviratne, J. Li, D. Niyato, and H. V. Poor, “Federated learning meets blockchain in edge computing: Opportunities and challenges,” IEEE Internet of Things Journal, vol. 8, no. 16, pp. 12 806–12 825, 2021.
  33. D. Hou, J. Zhang, K. L. Man, J. Ma, and Z. Peng, “A systematic literature review of blockchain-based federated learning: Architectures, applications and issues,” in 2021 2nd Information Communication Technologies Conference (ICTC).   IEEE, 2021, pp. 302–307.
  34. N. Afraz, F. Wilhelmi, H. Ahmadi, and M. Ruffini, “Blockchain and Smart Contracts for Telecommunications: Requirements vs. Cost Analysis,” IEEE Access, 2023.
  35. Y. Lu, X. Huang, K. Zhang, S. Maharjan, and Y. Zhang, “Blockchain empowered asynchronous federated learning for secure data sharing in internet of vehicles,” IEEE Transactions on Vehicular Technology, vol. 69, no. 4, pp. 4298–4311, 2020.
  36. Y. Zhao, J. Zhao, L. Jiang, R. Tan, D. Niyato, Z. Li, L. Lyu, and Y. Liu, “Privacy-preserving blockchain-based federated learning for IoT devices,” IEEE Internet of Things Journal, vol. 8, no. 3, pp. 1817–1829, 2020.
  37. F. Wilhelmi, L. Giupponi, and P. Dini, “Analysis and evaluation of synchronous and asynchronous FLchain,” Computer Networks, vol. 218, p. 109390, 2022.
  38. Y. Qu, L. Gao, T. H. Luan, Y. Xiang, S. Yu, B. Li, and G. Zheng, “Decentralized privacy using blockchain-enabled federated learning in fog computing,” IEEE Internet of Things Journal, vol. 7, no. 6, pp. 5171–5183, 2020.
  39. M. Ali, H. Karimipour, and M. Tariq, “Integration of blockchain and federated learning for Internet of Things: Recent advances and future challenges,” Computers & Security, vol. 108, p. 102355, 2021.
  40. D. C. Nguyen, P. N. Pathirana, M. Ding, and A. Seneviratne, “Integration of blockchain and cloud of things: Architecture, applications and challenges,” IEEE Communications surveys & tutorials, vol. 22, no. 4, pp. 2521–2549, 2020.
  41. Y. Qi, M. S. Hossain, J. Nie, and X. Li, “Privacy-preserving blockchain-based federated learning for traffic flow prediction,” Future Generation Computer Systems, vol. 117, pp. 328–337, 2021.
  42. Y. Lu, X. Huang, K. Zhang, S. Maharjan, and Y. Zhang, “Low-latency federated learning and blockchain for edge association in digital twin empowered 6G networks,” IEEE Transactions on Industrial Informatics, vol. 17, no. 7, pp. 5098–5107, 2020.
  43. S. R. Pokhrel and J. Choi, “Federated learning with blockchain for autonomous vehicles: Analysis and design challenges,” IEEE Transactions on Communications, vol. 68, no. 8, pp. 4734–4746, 2020.
  44. Y. Liu, Y. Qu, C. Xu, Z. Hao, and B. Gu, “Blockchain-enabled asynchronous federated learning in edge computing,” Sensors, vol. 21, no. 10, p. 3335, 2021.
  45. R. Wang and W.-T. Tsai, “Asynchronous Federated Learning System Based on Permissioned Blockchains,” Sensors, vol. 22, no. 4, p. 1672, 2022.
  46. L. Feng, Y. Zhao, S. Guo, X. Qiu, W. Li, and P. Yu, “BAFL: A Blockchain-Based Asynchronous Federated Learning Framework,” IEEE Transactions on Computers, vol. 71, no. 05, pp. 1092–1103, 2022.
  47. L. Kan, Y. Wei, A. H. Muhammad, W. Siyuan, L. C. Gao, and H. Kai, “A multiple blockchains architecture on inter-blockchain communication,” in 2018 IEEE international conference on software quality, reliability and security companion (QRS-C).   IEEE, 2018, pp. 139–145.
  48. L. Tseng, L. Wong, S. Otoum, M. Aloqaily, and J. B. Othman, “Blockchain for managing heterogeneous internet of things: A perspective architecture,” IEEE network, vol. 34, no. 1, pp. 16–23, 2020.
  49. X. Wang, S. Garg, H. Lin, G. Kaddoum, J. Hu, and M. S. Hossain, “A secure data aggregation strategy in edge computing and blockchain-empowered internet of things,” IEEE Internet of Things Journal, vol. 9, no. 16, pp. 14 237–14 246, 2020.
  50. M. Aledhari, R. Razzak, R. M. Parizi, and F. Saeed, “Federated learning: A survey on enabling technologies, protocols, and applications,” IEEE Access, vol. 8, pp. 140 699–140 725, 2020.
  51. M. B. Taylor, “The evolution of bitcoin hardware,” Computer, vol. 50, no. 9, pp. 58–66, 2017.
  52. F. Wilhelmi, S. Barrachina-Muñoz, and P. Dini, “End-to-End Latency Analysis and Optimal Block Size of Proof-of-Work Blockchain Applications,” IEEE Communications Letters, pp. 1–1, 2022.
  53. S. An, M. Lee, S. Park, H. Yang, and J. So, “An ensemble of simple convolutional neural network models for mnist digit recognition,” arXiv preprint arXiv:2008.10400, 2020.
  54. A. Tsymbal, “The problem of concept drift: definitions and related work,” Computer Science Department, Trinity College Dublin, vol. 106, no. 2, p. 58, 2004.
  55. K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” arXiv preprint arXiv:1409.1556, 2014.
  56. Z. Zhu, J. Hong, and J. Zhou, “Data-free knowledge distillation for heterogeneous federated learning,” in International conference on machine learning.   PMLR, 2021, pp. 12 878–12 889.
  57. T. Nishio and R. Yonetani, “Client selection for federated learning with heterogeneous resources in mobile edge,” in ICC 2019-2019 IEEE international conference on communications (ICC).   IEEE, 2019, pp. 1–7.
  58. X. Wang, S. Garg, H. Lin, M. J. Piran, J. Hu, and M. S. Hossain, “Enabling secure authentication in industrial iot with transfer learning empowered blockchain,” IEEE Transactions on Industrial Informatics, vol. 17, no. 11, pp. 7725–7733, 2021.
  59. X. Wang, S. Garg, H. Lin, G. Kaddoum, J. Hu, and M. M. Hassan, “Heterogeneous blockchain and ai-driven hierarchical trust evaluation for 5g-enabled intelligent transportation systems,” IEEE Transactions on Intelligent Transportation Systems, 2021.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (4)
  1. Francesc Wilhelmi (38 papers)
  2. Nima Afraz (8 papers)
  3. Elia Guerra (6 papers)
  4. Paolo Dini (29 papers)
Citations (2)
View on Semantic Scholar
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets