2000 character limit reached
A Distributed Computation Model Based on Federated Learning Integrates Heterogeneous models and Consortium Blockchain for Solving Time-Varying Problems (2306.16023v1)
Published 28 Jun 2023 in cs.AI, cs.DC, and cs.LG
Abstract: The recurrent neural network has been greatly developed for effectively solving time-varying problems corresponding to complex environments. However, limited by the way of centralized processing, the model performance is greatly affected by factors like the silos problems of the models and data in reality. Therefore, the emergence of distributed artificial intelligence such as federated learning (FL) makes it possible for the dynamic aggregation among models. However, the integration process of FL is still server-dependent, which may cause a great risk to the overall model. Also, it only allows collaboration between homogeneous models, and does not have a good solution for the interaction between heterogeneous models. Therefore, we propose a Distributed Computation Model (DCM) based on the consortium blockchain network to improve the credibility of the overall model and effective coordination among heterogeneous models. In addition, a Distributed Hierarchical Integration (DHI) algorithm is also designed for the global solution process. Within a group, permissioned nodes collect the local models' results from different permissionless nodes and then sends the aggregated results back to all the permissionless nodes to regularize the processing of the local models. After the iteration is completed, the secondary integration of the local results will be performed between permission nodes to obtain the global results. In the experiments, we verify the efficiency of DCM, where the results show that the proposed model outperforms many state-of-the-art models based on a federated learning framework.
- A hierarchical blockchain-enabled federated learning algorithm for knowledge sharing in internet of vehicles. IEEE Transactions on Intelligent Transportation Systems, 22(7):3975–3986, 2020.
- Ke Chen and Zhaoxiang Zhang. An improved recurrent network for online equality-constrained quadratic programming. In International Conference on Brain Inspired Cognitive Systems, pages 1–10. Springer, 2016.
- Consortium blockchains: Overview, applications and challenges. International Journal On Advances in Telecommunications, 11(1&2):51–64, 2018.
- Distributed load forecasting using smart meter data: Federated learning with recurrent neural networks. International Journal of Electrical Power & Energy Systems, 137:107669, 2022.
- A survey of consensus algorithms in public blockchain systems for crypto-currencies. Journal of Network and Computer Applications, 182:103035, 2021.
- A novel method for food market regulation by emotional tendencies predictions from food reviews based on blockchain and saes. Foods, 10(6):1398, 2021.
- An isomerism learning model to solve time-varying problems through intelligent collaboration,. IEEE/CAA Journal of Automatica Sinica, 10(8):1765–1767, 2023.
- A novel public sentiment analysis method based on an isomerism learning model via multiphase processing. IEEE Transactions on Neural Networks and Learning Systems, 2023.
- Noise-tolerant znn models for solving time-varying zero-finding problems: A control-theoretic approach. IEEE Transactions on Automatic Control, 62(2):992–997, 2016.
- Zeroing neural networks: A survey. Neurocomputing, 267:597–604, 2017.
- Cooperative motion generation in a distributed network of redundant robot manipulators with noises. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 48(10):1715–1724, 2017.
- A noise-suppressing neural algorithm for solving the time-varying system of linear equations: A control-based approach. IEEE Transactions on Industrial Informatics, 15(1):236–246, 2018.
- Perturbed manipulability optimization in a distributed network of redundant robots. IEEE Transactions on Industrial Electronics, 68(8):7209–7220, 2020.
- Advances and open problems in federated learning. Foundations and Trends® in Machine Learning, 14(1–2):1–210, 2021.
- Multilayer perceptrons and radial basis function neural network methods for the solution of differential equations: a survey. Computers & Mathematics with Applications, 62(10):3796–3811, 2011.
- Distributed recurrent neural networks for cooperative control of manipulators: A game-theoretic perspective. IEEE transactions on neural networks and learning systems, 28(2):415–426, 2016.
- A survey on federated learning systems: vision, hype and reality for data privacy and protection. IEEE Transactions on Knowledge and Data Engineering, 2021.
- Blockchain for federated learning toward secure distributed machine learning systems: a systemic survey. Soft Computing, 26(9):4423–4440, 2022.
- Taylor o(h3)𝑜superscriptℎ3o(h^{3})italic_o ( italic_h start_POSTSUPERSCRIPT 3 end_POSTSUPERSCRIPT ) discretization of znn models for dynamic equality-constrained quadratic programming with application to manipulators. IEEE transactions on neural networks and learning systems, 27(2):225–237, 2015.
- Federated learning for open banking. In Federated learning, pages 240–254. Springer, 2020.
- Novel automatic food trading system using consortium blockchain. Arabian Journal for Science and Engineering, 44(4):3439–3455, 2019.
- Federated learning of deep networks using model averaging. arXiv preprint arXiv:1602.05629, 2, 2016.
- Federated learning for face recognition with gradient correction. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 36, pages 1999–2007, 2022.
- Survey on private blockchain consensus algorithms. In 2019 1st International Conference on Innovations in Information and Communication Technology (ICIICT), pages 1–6. IEEE, 2019.
- Agent architecture of an intelligent medical system based on federated learning and blockchain technology. Journal of Information Security and Applications, 58:102748, 2021.
- Fedproto: Federated prototype learning across heterogeneous clients. In AAAI Conference on Artificial Intelligence, volume 1, page 3, 2022.
- A noise-suppressing newton-raphson iteration algorithm for solving the time-varying lyapunov equation and robotic tracking problems. Information Sciences, 550:239–251, 2021.
- Convergence and robustness of bounded recurrent neural networks for solving dynamic lyapunov equations. Information Sciences, 588:106–123, 2022.
- New zeroing neural network with finite-time convergence for dynamic complex-value linear equation and its applications. Chaos, Solitons & Fractals, 164:112674, 2022.
- An activated variable parameter gradient-based neural network for time-variant constrained quadratic programming and its applications. CAAI Transactions on Intelligence Technology, 2023.
- A robust newton iterative algorithm for acoustic location based on solving linear matrix equations in the presence of various noises. Applied Intelligence, 53(2):1219–1232, 2023.
- A review of irregular time series data handling with gated recurrent neural networks. Neurocomputing, 441:161–178, 2021.
- Smartidx: Reducing communication cost in federated learning by exploiting the cnns structures. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 36, pages 4254–4262, 2022.
- Federated machine learning: Concept and applications. ACM Transactions on Intelligent Systems and Technology (TIST), 10(2):1–19, 2019.
- Federated learning. Synthesis Lectures on Artificial Intelligence and Machine Learning, 13(3):1–207, 2019.
- A roadmap for big model. arXiv preprint arXiv:2203.14101, 2022.
- A recurrent neural network for solving sylvester equation with time-varying coefficients. IEEE Transactions on Neural Networks, 13(5):1053–1063, 2002.
- From zhang neural network to newton iteration for matrix inversion. IEEE Transactions on Circuits and Systems I: Regular Papers, 56(7):1405–1415, 2008.
- Global exponential convergence and stability of gradient-based neural network for online matrix inversion. Applied Mathematics and Computation, 215(3):1301–1306, 2009.
- A method to predict the performance and storage of executing contract for ethereum consortium-blockchain. In International Conference on Blockchain, pages 63–74. Springer, 2018.