Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
144 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

EEG Decoding for Datasets with Heterogenous Electrode Configurations using Transfer Learning Graph Neural Networks (2306.13109v1)

Published 20 Jun 2023 in eess.SP and cs.LG

Abstract: Brain-Machine Interfacing (BMI) has greatly benefited from adopting machine learning methods for feature learning that require extensive data for training, which are often unavailable from a single dataset. Yet, it is difficult to combine data across labs or even data within the same lab collected over the years due to the variation in recording equipment and electrode layouts resulting in shifts in data distribution, changes in data dimensionality, and altered identity of data dimensions. Our objective is to overcome this limitation and learn from many different and diverse datasets across labs with different experimental protocols. To tackle the domain adaptation problem, we developed a novel machine learning framework combining graph neural networks (GNNs) and transfer learning methodologies for non-invasive Motor Imagery (MI) EEG decoding, as an example of BMI. Empirically, we focus on the challenges of learning from EEG data with different electrode layouts and varying numbers of electrodes. We utilise three MI EEG databases collected using very different numbers of EEG sensors (from 22 channels to 64) and layouts (from custom layouts to 10-20). Our model achieved the highest accuracy with lower standard deviations on the testing datasets. This indicates that the GNN-based transfer learning framework can effectively aggregate knowledge from multiple datasets with different electrode layouts, leading to improved generalization in subject-independent MI EEG classification. The findings of this study have important implications for Brain-Computer-Interface (BCI) research, as they highlight a promising method for overcoming the limitations posed by non-unified experimental setups. By enabling the integration of diverse datasets with varying electrode layouts, our proposed approach can help advance the development and application of BMI technologies.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (59)
  1. Imagenet large scale visual recognition challenge. International journal of computer vision. 2015;115:211-52.
  2. Transfer learning in biomedical natural language processing: an evaluation of BERT and ELMo on ten benchmarking datasets. arXiv preprint arXiv:190605474. 2019.
  3. Sleep stage classification using EEG signal analysis: a comprehensive survey and new investigation. Entropy. 2016;18(9):272.
  4. GraphSleepNet: Adaptive Spatial-Temporal Graph Convolutional Networks for Sleep Stage Classification. In: IJCAI; 2020. p. 1324-30.
  5. Rao RP. Brain-computer interfacing: an introduction. Cambridge University Press; 2013.
  6. Pfurtscheller G. Mapping of event-related desynchronization and type of derivation. Electroencephalography and clinical neurophysiology. 1988;70(2):190-3.
  7. Brain oscillations control hand orthosis in a tetraplegic. Neuroscience letters. 2000;292(3):211-4.
  8. Carlson T, Millan JdR. Brain-controlled wheelchairs: a robotic architecture. IEEE Robotics & Automation Magazine. 2013;20(1):65-73.
  9. Nessi: an EEG-controlled web browser for severely paralyzed patients. Computational intelligence and neuroscience. 2007;2007.
  10. Review of the BCI competition IV. Frontiers in neuroscience. 2012:55.
  11. BCI2000: a general-purpose brain-computer interface (BCI) system. IEEE Transactions on biomedical engineering. 2004;51(6):1034-43.
  12. EEG dataset and OpenBMI toolbox for three BCI paradigms: an investigation into BCI illiteracy. GigaScience. 2019;8(5):giz002.
  13. Deep convolutional neural networks for brain computer interface using motor imagery. Imperial college of science, technology and medicine department of computing. 2015:68.
  14. Compact convolutional neural networks for multi-class, personalised, closed-loop EEG-BCI. In: 2018 7th IEEE International Conference on Biomedical Robotics and Biomechatronics (Biorob). IEEE; 2018. p. 136-41.
  15. EEGNet: a compact convolutional neural network for EEG-based brain–computer interfaces. Journal of neural engineering. 2018;15(5):056013.
  16. Deep learning with convolutional neural networks for EEG decoding and visualization. Human brain mapping. 2017;38(11):5391-420.
  17. EEG-inception: an accurate and robust end-to-end neural network for EEG-based motor imagery classification. Journal of Neural Engineering. 2021;18(4):046014.
  18. LSTM-based EEG classification in motor imagery tasks. IEEE transactions on neural systems and rehabilitation engineering. 2018;26(11):2086-95.
  19. Cascade and parallel convolutional recurrent neural networks on EEG-based intention recognition for brain computer interface. In: Proceedings of the aaai conference on artificial intelligence. vol. 32; 2018. .
  20. Filter bank common spatial pattern (FBCSP) in brain-computer interface. In: 2008 IEEE international joint conference on neural networks (IEEE world congress on computational intelligence). IEEE; 2008. p. 2390-7.
  21. Subasi A, Gursoy MI. EEG signal classification using PCA, ICA, LDA and support vector machines. Expert systems with applications. 2010;37(12):8659-66.
  22. Motor imagery classification via temporal attention cues of graph embedded EEG signals. IEEE journal of biomedical and health informatics. 2020;24(9):2570-9.
  23. Ortega P, Faisal A. HemCNN: Deep Learning enables decoding of fNIRS cortical signals in hand grip motor tasks. In: 2021 10th International IEEE/EMBS Conference on Neural Engineering (NER). IEEE; 2021. p. 718-21.
  24. Ortega P, Faisal AA. Deep learning multimodal fNIRS and EEG signals for bimanual grip force decoding. Journal of Neural Engineering. 2021;18(4):0460e6.
  25. Toward open-world electroencephalogram decoding via deep learning: a comprehensive survey. IEEE Signal Processing Magazine. 2022;39(2):117-34.
  26. Data-efficient hand motor imagery decoding in EEG-BCI by using Morlet wavelets & common spatial pattern algorithms. In: 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER). IEEE; 2015. p. 948-51.
  27. Inter-subject deep transfer learning for motor imagery eeg decoding. In: 2021 10th International IEEE/EMBS Conference on Neural Engineering (NER). IEEE; 2021. p. 21-4.
  28. Transfer learning for EEG-based brain–computer interfaces: A review of progress made since 2016. IEEE Transactions on Cognitive and Developmental Systems. 2020;14(1):4-19.
  29. HYGRIP: full-stack characterization of neurobehavioral signals (fNIRS, EEG, EMG, Force, and Breathing) during a bimanual grip force control task. Frontiers in Neuroscience. 2020;14:919.
  30. Neurocognitive barriers to the embodiment of technology. Nature Biomedical Engineering. 2017;1(1):1-3.
  31. Transfer learning for medical images analyses: A survey. Neurocomputing. 2022;489:230-54.
  32. Transfer learning in natural language processing. In: Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: Tutorials; 2019. p. 15-8.
  33. A review on transfer learning in EEG signal analysis. Neurocomputing. 2021;421:1-14.
  34. Domain Adaptation With Self-Guided Adaptive Sampling Strategy: Feature Alignment for Cross-User Myoelectric Pattern Recognition. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 2022;30:1374-83.
  35. Domain adaptation for EEG emotion recognition based on latent representation similarity. IEEE Transactions on Cognitive and Developmental Systems. 2019;12(2):344-53.
  36. Disentangled adversarial autoencoder for subject-invariant physiological feature extraction. IEEE signal processing letters. 2020;27:1565-9.
  37. 2021 BEETL Competition: Advancing Transfer Learning for Subject Independence and Heterogenous EEG Data Sets. In: Proceedings of the NeurIPS 2021 Competitions and Demonstrations Track. vol. 176 of Proceedings of Machine Learning Research. PMLR; 2022. p. 205-19.
  38. EEG-GNN: Graph Neural Networks for Classification of Electroencephalogram (EEG) Signals. In: 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC). IEEE; 2021. p. 1061-7.
  39. Generalizable Movement Intention Recognition with Multiple Heterogenous EEG Datasets. In: 2023 IEEE International Conference on Robotics and Automation (ICRA); 2023. .
  40. EEG emotion recognition using dynamical graph convolutional neural networks. IEEE Transactions on Affective Computing. 2018;11(3):532-41.
  41. EEG-based emotion recognition using regularized graph neural networks. IEEE Transactions on Affective Computing. 2020.
  42. EEG-GAT: Graph Attention Networks for Classification of Electroencephalogram (EEG) Signals. In: 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC). IEEE; 2022. p. 30-5.
  43. Welling M, Kipf TN. Semi-supervised classification with graph convolutional networks. In: J. International Conference on Learning Representations (ICLR 2017); 2016. .
  44. Self-attention graph pooling. In: International conference on machine learning. PMLR; 2019. p. 3734-43.
  45. Understanding attention and generalization in graph neural networks. Advances in neural information processing systems. 2019;32.
  46. Alon U, Yahav E. On the bottleneck of graph neural networks and its practical implications. arXiv preprint arXiv:200605205. 2020.
  47. Self-Supervised Graph Neural Networks for Improved Electroencephalographic Seizure Analysis. In: International Conference on Learning Representations; 2021. .
  48. A comprehensive survey on graph neural networks. IEEE transactions on neural networks and learning systems. 2020;32(1):4-24.
  49. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In: Proceedings of the IEEE international conference on computer vision; 2015. p. 1026-34.
  50. Maximum density divergence for domain adaptation. IEEE transactions on pattern analysis and machine intelligence. 2020;43(11):3918-30.
  51. Rethinking the item order in session-based recommendation with graph neural networks. In: Proceedings of the 28th ACM international conference on information and knowledge management; 2019. p. 579-88.
  52. Session-based recommendation with graph neural networks. In: Proceedings of the AAAI conference on artificial intelligence. vol. 33; 2019. p. 346-53.
  53. Cross-subject EEG signal recognition using deep domain adaptation network. IEEE Access. 2019;7:128273-82.
  54. Deep representation-based domain adaptation for nonstationary EEG classification. IEEE Transactions on Neural Networks and Learning Systems. 2020;32(2):535-45.
  55. Tang X, Zhang X. Conditional adversarial domain adaptation neural network for motor imagery EEG decoding. Entropy. 2020;22(1):96.
  56. Hhhfl: Hierarchical heterogeneous horizontal federated learning for electroencephalography. arXiv preprint arXiv:190905784. 2019.
  57. Federated transfer learning for EEG signal classification. In: 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC). IEEE; 2020. p. 3040-5.
  58. Learning from multiple datasets with heterogeneous and partial labels for universal lesion detection in CT. IEEE Transactions on Medical Imaging. 2020;40(10):2759-70.
  59. Deep learning for heterogeneous medical data analysis. World Wide Web. 2020;23:2715-37.
Citations (9)

Summary

We haven't generated a summary for this paper yet.