Papers
Topics
Authors
Recent
2000 character limit reached

FCNCP: A Coupled Nonnegative CANDECOMP/PARAFAC Decomposition Based on Federated Learning (2404.11890v1)

Published 18 Apr 2024 in math.NA, cs.LG, and cs.NA

Abstract: In the field of brain science, data sharing across servers is becoming increasingly challenging due to issues such as industry competition, privacy security, and administrative procedure policies and regulations. Therefore, there is an urgent need to develop new methods for data analysis and processing that enable scientific collaboration without data sharing. In view of this, this study proposes to study and develop a series of efficient non-negative coupled tensor decomposition algorithm frameworks based on federated learning called FCNCP for the EEG data arranged on different servers. It combining the good discriminative performance of tensor decomposition in high-dimensional data representation and decomposition, the advantages of coupled tensor decomposition in cross-sample tensor data analysis, and the features of federated learning for joint modelling in distributed servers. The algorithm utilises federation learning to establish coupling constraints for data distributed across different servers. In the experiments, firstly, simulation experiments are carried out using simulated data, and stable and consistent decomposition results are obtained, which verify the effectiveness of the proposed algorithms in this study. Then the FCNCP algorithm was utilised to decompose the fifth-order event-related potential (ERP) tensor data collected by applying proprioceptive stimuli on the left and right hands. It was found that contralateral stimulation induced more symmetrical components in the activation areas of the left and right hemispheres. The conclusions drawn are consistent with the interpretations of related studies in cognitive neuroscience, demonstrating that the method can efficiently process higher-order EEG data and that some key hidden information can be preserved.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (45)
  1. F. L. Hitchcock. The expression of a tensor or a polyadic as a sum of products. Journal of Mathematical Physics, 6(1):164–189, 1927.
  2. Tensor decomposition for signal processing and machine learning. 2016.
  3. Tensor decompositions for signal processing applications from two-way to multiway component analysis. IEEE Signal Processing Magazine, 32(2):145–163, 2015.
  4. Linked component analysis from matrices to high order tensors: Applications to biomedical data, 2015.
  5. Morten MøRup. Applications of tensor (multiway array) factorizations and decompositions in data mining. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 1(1):24–40, 2011.
  6. Ledyard Tucker. Some mathematical notes on three-mode factor analysis. Psychometrika, 31(3):279–311, 1966.
  7. Parafac2—part i. a direct fitting algorithm for the parafac2 model. Journal of Chemometrics, 12(3):223–238, 1999.
  8. Tracing network evolution using the parafac2 model. In IEEE International Conference on Acoustics, Speech and Signal Processing, 2020.
  9. Nonnegative Matrix and Tensor Factorizations: Applications to Exploratory Multi-Way Data Analysis and Blind Source Separation. Nonnegative Matrix and Tensor Factorizations: Applications to Exploratory Multi-Way Data Analysis and Blind Source Separation, 2009.
  10. Hierarchical als algorithms for nonnegative matrix and 3d tensor factorization. In International Conference on Independent Component Analysis and Signal Separation, page 169–176. Springer, 2007.
  11. Fast local algorithms for large scale nonnegative matrix and tensor factorizations. IEICE transactions on fundamentals of electronics, communications and computer sciences, 92(3):708–721, 2009.
  12. Distributed optimization and statistical learning via the alternating direction method of multipliers. Foundations and Trends in Machine learning, 3(1):1–122, 2011.
  13. Fast nonnegative tensor factorization with an active-set-like method. In High-Performance Scientific Computing, page 311–326. Springer, 2012.
  14. Yangyang Xu. Alternating proximal gradient method for sparse nonnegative tucker decomposition. Mathematical Programming Computation, 7(1):39–70, 2015.
  15. An inexact alternating proximal gradient algorithm for nonnegative cp tensor decomposition. Science China Technological Sciences, 64(9):1893–1906, 2021.
  16. Low-rank approximation based non-negative multi-way array decomposition on event-related potentials. International Journal of Neural Systems, 24(8), 2014.
  17. Linked component analysis from matrices to high-order tensors: Applications to biomedical data. Proceedings of the IEEE, 104(2):310–331, 2016.
  18. Structure-revealing data fusion model with applications in metabolomics. in embc (pp.6023-6026). In 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pages 6023–6026, Osaka, Japan, July 2013.
  19. Unraveling diagnostic biomarkers of schizophrenia through structure-revealing fusion of multi-modal neuroimaging data. Frontiers in Neuroscience, 13, 2019.
  20. Group analysis of ongoing eeg data based on fast double-coupled nonnegative tensor decomposition. Journal of Neuroscience Methods, 330:108502, 2020.
  21. Exploring oscillatory dysconnectivity networks in major depression during resting state using coupled tensor decomposition. IEEE Transactions on Biomedical Engineering, 69(8):2691–2700, 2022.
  22. Tensor decompositions and data fusion in epileptic electroencephalography and functional magnetic resonance imaging data. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 7(1):e1197, 2017.
  23. Concurrent eeg/fmri analysis by multiway partial least squares. Neuroimage, 22(3):1023–1034, 2004.
  24. Tensor-based fusion of eeg and fmri to understand neurological changes in schizophrenia. In 2017 IEEE International Symposium on Circuits and Systems (ISCAS), page 1–4. IEEE, 2017.
  25. Extraction of common task features in eeg-fmri data using coupled tensor-tensor decomposition. Brain Topography, 33(5):636–650, 2020.
  26. Edge computing: Vision and challenges. IEEE internet of things journal, 3(5):637–646, 2016.
  27. New rsa encryption mechanism using one-time encryption keys and unpredictable bio-signal for wireless communication devices. Electronics, 9(2):246, 2020.
  28. A review of applications in federated learning. Computers & Industrial Engineering, 149:106854, 2020.
  29. Federated learning: Challenges, methods, and future directions. IEEE Signal Processing Magazine, 37(3):50–60, 2020.
  30. A survey on federated learning. Knowledge-Based Systems, 216(1):106775, 2021.
  31. Mammen P. Mammen Jr. Federated learning: Opportunities and challenges. 2021.
  32. Federated machine learning: Concept and applications. ACM Transactions on Intelligent Systems and Technology (TIST), 10(2):1–19, 2019.
  33. A survey on federated learning: The journey from centralized to distributed on-site learning and beyond. IEEE Internet of Things Journal, 8(7):5476–5497, 2020.
  34. Communication-efficient learning of deep networks from decentralized data. In Artificial intelligence and statistics, page 1273–1282. PMLR, 2017.
  35. Federated tensor mining for secure industrial internet of things. IEEE Transactions on Industrial Informatics, 16(3):2144–2153, 2019.
  36. Federated tensor factorization for computational phenotyping. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, page 887–895, 2017.
  37. Federated tensor decomposition-based feature extraction approach for industrial iot. IEEE Transactions on Industrial Informatics, 17(12):8541–8549, 2021.
  38. Deep learning with elastic averaging sgd. Advances in neural information processing systems, 28, 2015.
  39. Erpwavelab: a toolbox for multi-channel analysis of time–frequency transformed event related potentials. Journal of neuroscience methods, 161(2):361–368, 2007.
  40. Decomposing the time-frequency representation of eeg using non-negative matrix and multi-way factorization. Technical report, Technical University of Denmark Technical Report, 2006.
  41. Eeglab: an open source toolbox for analysis of single-trial eeg dynamics including independent component analysis. Journal of neuroscience methods, 134(1):9–21, 2004.
  42. Mechanisms of evoked and induced responses in meg/eeg. Neuroimage, 31(4):1580–1591, 2006.
  43. Mike X Cohen. Analyzing neural time series data: theory and practice. MIT press, 2014.
  44. Extracting multi-mode erp features using fifth-order nonnegative tensor decomposition. Journal of Neuroscience Methods, pages 240–247, 2018.
  45. Attenuation of beta and gamma oscillations in schizophrenia spectrum patients following hand posture perturbation. Psychiatry Research, 185(1-2):215–224, 2011.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
Slide Deck Streamline Icon: https://streamlinehq.com

Whiteboard

Dice Question Streamline Icon: https://streamlinehq.com

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now
Lightbulb Streamline Icon: https://streamlinehq.com

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now
List To Do Tasks Checklist Streamline Icon: https://streamlinehq.com

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up