Enhancing Trust and Privacy in Distributed Networks: A Comprehensive Survey on Blockchain-based Federated Learning (2403.19178v1)
Abstract: While centralized servers pose a risk of being a single point of failure, decentralized approaches like blockchain offer a compelling solution by implementing a consensus mechanism among multiple entities. Merging distributed computing with cryptographic techniques, decentralized technologies introduce a novel computing paradigm. Blockchain ensures secure, transparent, and tamper-proof data management by validating and recording transactions via consensus across network nodes. Federated Learning (FL), as a distributed machine learning framework, enables participants to collaboratively train models while safeguarding data privacy by avoiding direct raw data exchange. Despite the growing interest in decentralized methods, their application in FL remains underexplored. This paper presents a thorough investigation into Blockchain-based FL (BCFL), spotlighting the synergy between blockchain's security features and FL's privacy-preserving model training capabilities. First, we present the taxonomy of BCFL from three aspects, including decentralized, separate networks, and reputation-based architectures. Then, we summarize the general architecture of BCFL systems, providing a comprehensive perspective on FL architectures informed by blockchain. Afterward, we analyze the application of BCFL in healthcare, IoT, and other privacy-sensitive areas. Finally, we identify future research directions of BCFL.
- Protecting personal healthcare record using blockchain & federated learning technologies. In 2022 24th International Conference on Advanced Communication Technology (ICACT), pages 109–112. IEEE, 2022.
- Energy-aware blockchain and federated learning-supported vehicular networks. IEEE Transactions on Intelligent Transportation Systems, 2021.
- Hyperledger fabric: a distributed operating system for permissioned blockchains. In Proceedings of the thirteenth EuroSys conference, pages 1–15, 2018.
- A blockchain based federated learning for message dissemination in vehicular networks. IEEE Transactions on Vehicular Technology, 2021.
- Internet of vehicles security situation awareness based on intrusion detection protection systems. Journal of Computational Methods in Sciences and Engineering, 22(1):189–195, 2022.
- A survey on blockchain for information systems management and security. Information Processing & Management, 58(1):102397, 2021.
- Bindaas: Blockchain-based deep-learning as-a-service in healthcare 4.0 applications. IEEE transactions on network science and engineering, 8(2):1242–1255, 2019.
- Towards federated learning at scale: System design. Proceedings of Machine Learning and Systems, 1:374–388, 2019.
- Federatedgrids: Federated learning and blockchain-assisted p2p energy sharing. IEEE Transactions on Green Communications and Networking, 2022.
- California State Legislature, USA. California consumer privacy act home page. https://www.caprivacy.org/. Online; accessed 14/02/2021.
- A hierarchical blockchain-enabled federated learning algorithm for knowledge sharing in internet of vehicles. IEEE Transactions on Intelligent Transportation Systems, 22(7):3975–3986, 2020.
- Proof of federated training: Accountable cross-network model training and inference. arXiv preprint arXiv:2204.06919, 2022.
- Federated learning of large language models with parameter-efficient prompt tuning and adaptive optimization. In Empirical Methods in Natural Language Processing (EMNLP), pages 1–18, 2023.
- Federated fingerprint learning with heterogeneous architectures. In IEEE Int. Conf. on Data Mining (ICDM), pages 31–40. IEEE, 2022.
- Repbfl: Reputation based blockchain-enabled federated learning framework for data sharing in internet of vehicles. In International Conference on Parallel and Distributed Computing: Applications and Technologies, pages 536–547. Springer, 2021.
- Bdfl: a byzantine-fault-tolerance decentralized federated learning method for autonomous vehicle. IEEE Transactions on Vehicular Technology, 70(9):8639–8652, 2021.
- When machine learning meets blockchain: A decentralized, privacy-preserving and secure design. In 2018 IEEE international conference on big data (big data), pages 1178–1187. IEEE, 2018.
- A methodology for high-efficient federated-learning with consortium blockchain. In 2020 IEEE 4th Conference on Energy Internet and Energy System Integration (EI2), pages 3090–3095. IEEE, 2020.
- A blockchain-empowered cluster-based federated learning model for blade icing estimation on iot-enabled wind turbine. IEEE Transactions on Industrial Informatics, 2022.
- Shane Cook. CUDA programming: a developer’s guide to parallel computing with GPUs. Newnes, 2012.
- Red belly: A secure, fair and scalable open blockchain. In 2021 IEEE Symposium on Security and Privacy (SP), pages 466–483. IEEE, 2021.
- Flex: Trading edge computing resources for federated learning via blockchain. In IEEE INFOCOM 2021-IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), pages 1–2. IEEE, 2021.
- Blockchain-based authentication and authorization for smart city applications. Information Processing & Management, 58(2):102468, 2021.
- Mobile devices strategies in blockchain-based federated learning: A dynamic game perspective. IEEE Transactions on Network Science and Engineering, 2022.
- Two-layered blockchain architecture for federated learning over mobile edge network. IEEE Network, 2021.
- Privacy and big data. Computer, 47(6):7–9, 2014.
- Blockchain meets cloud computing: A survey. IEEE Communications Surveys & Tutorials, 22(3):2009–2030, 2020.
- Sok: A consensus taxonomy in the blockchain era. In Cryptographers’ track at the RSA conference, pages 284–318. Springer, 2020.
- Demystifying swarm learning: A new paradigm of blockchain-based decentralized federated learning. arXiv preprint arXiv:2201.05286, 2022.
- Bift: A blockchain-based federated learning system for connected and autonomous vehicles. IEEE Internet of Things Journal, 2021.
- Blockchain and federated edge learning for privacy-preserving mobile crowdsensing. IEEE Internet of Things Journal, 2021.
- The blockchain-based edge computing framework for privacy-preserving federated learning. In IEEE Int. Conf. on Blockchain (Blockchain), pages 566–571, 2021.
- Distance-aware hierarchical federated learning in blockchain-enabled edge computing network. IEEE Internet of Things Journal, 10(21):19163–19176, 2023.
- Blockchain-based federated learning for securing internet of things: A comprehensive survey. ACM Computing Surveys, 55(9):1–43, 2023.
- Efficient asynchronous federated learning with sparsification and quantization. Concurrency and Computation: Practice and Experience, page e8002, 2023.
- A reward response game in the blockchain-powered federated learning system. International Journal of Parallel, Emergent and Distributed Systems, 37(1):68–90, 2022.
- Accelerated federated learning with decoupled adaptive optimization. In Int. Conf. on Machine Learning (ICML), pages 10298–10322. PMLR, 2022.
- In-datacenter performance analysis of a tensor processing unit. In Int. Symposium on Computer Architecture (ISCA), pages 1–12, 2017.
- {{\{{BlockSci}}\}}: Design and applications of a blockchain analysis platform. In 29th USENIX Security Symposium (USENIX Security 20), pages 2721–2738, 2020.
- Incentive mechanism for reliable federated learning: A joint optimization approach to combining reputation and contract theory. IEEE Internet of Things Journal, 6(6):10700–10714, 2019.
- Toward secure blockchain-enabled internet of vehicles: Optimizing consensus management using reputation and contract theory. IEEE Transactions on Vehicular Technology, 68(3):2906–2920, 2019.
- Reliable federated learning for mobile networks. IEEE Wireless Communications, 27(2):72–80, 2020.
- Scaffold: Stochastic controlled averaging for federated learning. In International Conference on Machine Learning, pages 5132–5143. PMLR, 2020.
- Dispersed federated learning: Vision, taxonomy, and future directions. IEEE Wireless Communications, 28(5):192–198, 2021.
- Improved raft algorithm exploiting federated learning for private blockchain performance enhancement. In 2021 International Conference on Information Networking (ICOIN), pages 828–832. IEEE, 2021.
- Core concepts, challenges, and future directions in blockchain: A centralized tutorial. ACM Computing Surveys (CSUR), 53(1):1–39, 2020.
- Achieving blockchain-based privacy-preserving location proofs under federated learning. In ICC 2021-IEEE International Conference on Communications, pages 1–6. IEEE, 2021.
- Blockchain-federated-learning and deep learning models for covid-19 detection using ct imaging. IEEE Sensors Journal, 21(14):16301–16314, 2021.
- Blockchain for federated learning toward secure distributed machine learning systems: a systemic survey. Soft Computing, 26(9):4423–4440, 2022.
- Fedhisyn: A hierarchical synchronous federated learning framework for resource and data heterogeneity. In Int. Conf. on Parallel Processing (ICPP), pages 1–11, 2022.
- Blockchain assisted decentralized federated learning (blade-fl): Performance analysis and resource allocation. IEEE Transactions on Parallel and Distributed Systems, 2021.
- Model-contrastive federated learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 10713–10722, 2021.
- A survey on federated learning systems: vision, hype and reality for data privacy and protection. IEEE Transactions on Knowledge and Data Engineering, 2021.
- Ditto: Fair and robust federated learning through personalization. In International Conference on Machine Learning, pages 6357–6368. PMLR, 2021.
- Federated optimization in heterogeneous networks. Proceedings of Machine learning and systems, 2:429–450, 2020.
- Fedbn: Federated learning on non-iid features via local batch normalization. arXiv preprint arXiv:2102.07623, 2021.
- A blockchain-based decentralized federated learning framework with committee consensus. IEEE Network, 35(1):234–241, 2020.
- Local model update for blockchain enabled federated learning: Approach and analysis. In IEEE Int. Conf. on Blockchain (Blockchain), pages 113–121, 2021.
- Secure data storage and recovery in industrial blockchain network environments. IEEE Transactions on Industrial Informatics, 16(10):6543–6552, 2020.
- Blockchain and federated learning for collaborative intrusion detection in vehicular edge computing. IEEE Transactions on Vehicular Technology, 70(6):6073–6084, 2021.
- Aedfl: efficient asynchronous decentralized federated learning with heterogeneous devices. In SIAM Conference on Data Mining, pages 1–15, 2023.
- From distributed machine learning to federated learning: A survey. Knowledge and Information Systems, 64(4):885–917, 2022.
- Fedasmu: Efficient asynchronous federated learning with dynamic staleness-aware model update. In AAAI, pages 1–18, 2023.
- Multi-job intelligent scheduling with cross-device federated learning. IEEE Transactions on Parallel and Distributed Systems, 34(2):535–551, 2022.
- Heterps: Distributed deep learning with reinforcement learning based scheduling in heterogeneous environments. Future Generation Computer Systems, 2023.
- Distributed and deep vertical federated learning with big data. Concurrency and Computation: Practice and Experience, page e7697, 2023.
- Fedcoin: A peer-to-peer payment system for federated learning. In Federated Learning, pages 125–138. Springer, 2020.
- Blockchain-based trustworthy federated learning architecture. arXiv preprint arXiv:2108.06912, 2021.
- Blockchain and federated learning for privacy-preserved data sharing in industrial iot. IEEE Transactions on Industrial Informatics, 16(6):4177–4186, 2019.
- Blockchain empowered asynchronous federated learning for secure data sharing in internet of vehicles. IEEE Transactions on Vehicular Technology, 69(4):4298–4311, 2020.
- Communication-efficient federated learning and permissioned blockchain for digital twin edge networks. IEEE Internet of Things Journal, 8(4):2276–2288, 2020.
- Low-latency federated learning and blockchain for edge association in digital twin empowered 6g networks. IEEE Transactions on Industrial Informatics, 17(7):5098–5107, 2020.
- Secure architectures implementing trusted coalitions for blockchained distributed learning (tclearn). IEEE Access, 7:181789–181799, 2019.
- Collaborative fairness in federated learning. In Federated Learning, pages 189–204. Springer, 2020.
- When federated learning meets blockchain: A new distributed learning paradigm. arXiv preprint arXiv:2009.09338, 2020.
- Transparent contribution evaluation for secure federated learning on blockchain. In 2021 IEEE 37th International Conference on Data Engineering Workshops (ICDEW), pages 88–91. IEEE, 2021.
- Communication-efficient learning of deep networks from decentralized data. In Artificial intelligence and statistics, pages 1273–1282. PMLR, 2017.
- Comparative analysis of various platforms of blockchain. Smart and Sustainable Intelligent Systems, pages 323–340, 2021.
- Energy-efficient distributed federated learning offloading and scheduling healthcare system in blockchain based networks. Internet of Things, 22:100815, 2023.
- Fabricfl: Blockchain-in-the-loop federated learning for trusted decentralized systems. IEEE Systems Journal, 2021.
- Towards a secure and reliable federated learning using blockchain. In IEEE Global Communications Conf. (GLOBECOM), pages 1–6, 2021.
- Blockchain meets federated learning in healthcare: A systematic review with challenges and opportunities. IEEE Internet of Things Journal, 2023.
- Federated learning meets blockchain in edge computing: Opportunities and challenges. IEEE Internet of Things Journal, 2021.
- Latency optimization for blockchain-empowered federated learning in multi-server edge computing. arXiv preprint arXiv:2203.09670, 2022.
- Official Journal of the European Union. General data protection regulation. https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:32016R0679, 2016. Online; accessed 12/02/2021.
- A federated learning and blockchain-enabled sustainable energy-trade at the edge: A framework for industry 4.0. IEEE Internet of Things Journal, 2022.
- Blockchain-supported federated learning for trustworthy vehicular networks. In GLOBECOM 2020-2020 IEEE Global Communications Conference, pages 1–6. IEEE, 2020.
- Artificial identification: A novel privacy framework for federated learning based on blockchain. IEEE Transactions on Computational Social Systems, 10(6):3576–3585, 2023.
- A crowdsourcing framework for on-device federated learning. IEEE Transactions on Wireless Communications, 19(5):3241–3256, 2020.
- Blockchain-orchestrated machine learning for privacy preserving federated learning in electronic health data. In IEEE Int. Conf. on Blockchain (Blockchain), pages 550–555, 2020.
- A blockchain-orchestrated federated learning architecture for healthcare consortia. arXiv preprint arXiv:1910.12603, 2019.
- Falcondb: Blockchain-based collaborative database. In Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data, pages 637–652, 2020.
- Shiva Raj Pokhrel. Blockchain brings trust to collaborative drones and leo satellites: an intelligent decentralized learning in the space. IEEE sensors journal, 21(22):25331–25339, 2021.
- A decentralized federated learning approach for connected autonomous vehicles. In 2020 IEEE Wireless Communications and Networking Conference Workshops (WCNCW), pages 1–6. IEEE, 2020.
- Securing federated learning with blockchain: a systematic literature review. Artificial Intelligence Review, 56(5):3951–3985, 2023.
- Proof of federated learning: A novel energy-recycling consensus algorithm. IEEE Transactions on Parallel and Distributed Systems, 32(8):2074–2085, 2021.
- Decentralized privacy using blockchain-enabled federated learning in fog computing. IEEE Internet of Things Journal, 7(6):5171–5183, 2020.
- Blockchain-enabled 5g edge networks and beyond: an intelligent cross-silo federated learning approach. Security and Communication Networks, 2021, 2021.
- Secure and provenance enhanced internet of health things framework: A blockchain managed federated learning approach. Ieee Access, 8:205071–205087, 2020.
- Baffle: Blockchain based aggregator free federated learning. In IEEE Int. Conf. on Blockchain (Blockchain), pages 72–81. IEEE, 2020.
- Practical secure computation outsourcing: A survey. ACM Computing Surveys (CSUR), 51(2):1–40, 2018.
- Biscotti: A blockchain system for private and secure federated learning. IEEE Transactions on Parallel and Distributed Systems, 32(7):1513–1525, 2020.
- Applications of blockchain in ensuring the security and privacy of electronic health record systems: A survey. Computers & security, 97:101966, 2020.
- Fusionfedblock: Fusion of blockchain and federated learning to preserve privacy in industry 5.0. Information Fusion, 90:233–240, 2023.
- Standing Committee of the National People’s Congress. Cybersecurity law of the people’s republic of china. https://www.newamerica.org/cybersecurity-initiative/digichina/blog/translation-cybersecurity-law-peoples-republic-china/. Online; accessed 22/02/2021.
- Permissioned blockchain frame for secure federated learning. IEEE Communications Letters, 26(1):13–17, 2021.
- A blockchain-based machine learning framework for edge services in iiot. IEEE Transactions on Industrial Informatics, 18(3):1918–1929, 2021.
- Blockchain-enabled federated learning with mechanism design. IEEE Access, 8:219744–219756, 2020.
- A hybrid approach to privacy-preserving federated learning. In Proceedings of the 12th ACM workshop on artificial intelligence and security, pages 1–11, 2019.
- Incentive mechanisms for federated learning: From economic and game theoretic perspective. IEEE Transactions on Cognitive Communications and Networking, 2022.
- Trustfed: a framework for fair and trustworthy cross-device federated learning in iiot. IEEE Transactions on Industrial Informatics, 17(12):8485–8494, 2021.
- Privacy-preserving blockchain-enabled federated learning for b5g-driven edge computing. Computer Networks, 204:108671, 2022.
- Asynchronous federated learning system based on permissioned blockchains. Sensors, 22(4):1672, 2022.
- A survey on consensus mechanisms and mining strategy management in blockchain networks. Ieee Access, 7:22328–22370, 2019.
- Blockchain empowered federated learning for medical data sharing model. In International Conference on Wireless Algorithms, Systems, and Applications, pages 537–544. Springer, 2021.
- Blockchain-based federated learning: A comprehensive survey. arXiv preprint arXiv:2110.02182, 2021.
- Incentive mechanism design for joint resource allocation in blockchain-based federated learning. arXiv preprint arXiv:2202.10938, 2022.
- Swarm learning for decentralized and confidential clinical machine learning. Nature, 594(7862):265–270, 2021.
- Deepchain: Auditable and privacy-preserving deep learning with blockchain-based incentive. IEEE Transactions on Dependable and Secure Computing, 18(5):2438–2455, 2019.
- When mobile blockchain meets edge computing. IEEE Communications Magazine, 56(8):33–39, 2018.
- Spdl: Blockchain-secured and privacy-preserving decentralized learning. arXiv preprint arXiv:2201.01989, 2022.
- An explainable federated learning and blockchain-based secure credit modeling method. European Journal of Operational Research, 2023.
- Privacy-preserved credit data sharing integrating blockchain and federated learning for industrial 4.0. IEEE Transactions on Industrial Informatics, 2022.
- Heterogeneous federated learning: State-of-the-art and research challenges. ACM Computing Surveys, 56(3):1–44, 2023.
- A comprehensive survey of privacy-preserving federated learning: A taxonomy, review, and future directions. ACM Computing Surveys (CSUR), 54(6):1–36, 2021.
- Ohie: Blockchain scaling made simple. In 2020 IEEE Symposium on Security and Privacy (SP), pages 90–105. IEEE, 2020.
- Bayesian nonparametric federated learning of neural networks. In International Conference on Machine Learning, pages 7252–7261. PMLR, 2019.
- A comprehensive survey of incentive mechanism for federated learning. arXiv preprint arXiv:2106.15406, 2021.
- A learning-based incentive mechanism for federated learning. IEEE Internet of Things Journal, 7(7):6360–6368, 2020.
- Federated learning meets blockchain: State channel based distributed data sharing trust supervision mechanism. IEEE Internet of Things Journal, 2021.
- Fedduap: Federated learning with dynamic update and adaptive pruning using shared data on the server. In Int. Joint Conf. on Artificial Intelligence (IJCAI), 2022.
- Blockchain-based privacy-preserving medical data sharing scheme using federated learning. In International Conference on Knowledge Science, Engineering and Management, pages 634–646. Springer, 2021.
- Blockchain empowered reliable federated learning by worker selection: A trustworthy reputation evaluation method. In 2021 IEEE Wireless Communications and Networking Conference Workshops (WCNCW), pages 1–6. IEEE, 2021.
- Enabling execution assurance of federated learning at untrusted participants. In IEEE INFOCOM 2020-IEEE Conference on Computer Communications, pages 1877–1886. IEEE, 2020.
- Fedpd: A federated learning framework with optimal rates and adaptivity to non-iid data. arXiv: Learning, 2020.
- Refiner: a reliable incentive-driven federated learning system powered by blockchain. Proceedings of the VLDB Endowment, 14(12):2659–2662, 2021.
- A blockchain based decentralized gradient aggregation design for federated learning. In International Conference on Artificial Neural Networks, pages 359–371. Springer, 2021.
- Mobile edge computing, blockchain and reputation-based crowdsourcing iot federated learning: A secure, decentralized and privacy-preserving system. arXiv preprint arXiv:1906.10893, 2020.
- Applications of federated learning in smart cities: recent advances, taxonomy, and open challenges. Connection Science, 34(1):1–28, 2022.
- Efficient device scheduling with multi-job federated learning. In AAAI Conf. on Artificial Intelligence, volume 36, pages 9971–9979, 2022.
- Blockchain-empowered federated learning: Challenges, solutions, and future directions. ACM Computing Surveys, 55(11):1–31, 2023.