Graph Neural Networks in EEG-based Emotion Recognition: A Survey (2402.01138v3)
Abstract: Compared to other modalities, EEG-based emotion recognition can intuitively respond to the emotional patterns in the human brain and, therefore, has become one of the most concerning tasks in the brain-computer interfaces field. Since dependencies within brain regions are closely related to emotion, a significant trend is to develop Graph Neural Networks (GNNs) for EEG-based emotion recognition. However, brain region dependencies in emotional EEG have physiological bases that distinguish GNNs in this field from those in other time series fields. Besides, there is neither a comprehensive review nor guidance for constructing GNNs in EEG-based emotion recognition. In the survey, our categorization reveals the commonalities and differences of existing approaches under a unified framework of graph construction. We analyze and categorize methods from three stages in the framework to provide clear guidance on constructing GNNs in EEG-based emotion recognition. In addition, we discuss several open challenges and future directions, such as Temporal full-connected graph and Graph condensation.
- Linking multi-layer dynamical gcn with style-based recalibration cnn for eeg-based emotion recognition. Frontiers in Neurorobotics, 16:834952, 2022.
- Sfe-net: Eeg-based emotion recognition with symmetrical spatial feature extraction. In Proceedings of the 29th ACM international conference on multimedia, pages 2391–2400, 2021.
- Yi Ding and Cuntai Guan. Gign: Learning graph-in-graph representations of eeg signals for continuous emotion recognition. In 2023 45th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), pages 1–5. IEEE, 2023.
- Lggnet: Learning from local-global-graph representations for brain–computer interface. IEEE Transactions on Neural Networks and Learning Systems, 2023.
- A multi-dimensional graph convolution network for eeg emotion recognition. IEEE Transactions on Instrumentation and Measurement, 71:1–11, 2022.
- Eeg-based emotion recognition using spatial-temporal graph convolutional lstm with attention mechanism. IEEE Journal of Biomedical and Health Informatics, 26(11):5406–5417, 2022.
- Hetemotionnet: two-stream heterogeneous graph recurrent neural network for multi-modal emotion recognition. In Proceedings of the 29th ACM International Conference on Multimedia, pages 1047–1056, 2021.
- Elastic graph transformer networks for eeg-based emotion recognition. In ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 1–5. IEEE, 2023.
- Eeg-based emotion recognition using graph convolutional network with learnable electrode relations. In 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), pages 5953–5957. IEEE, 2021.
- From regional to global brain: A novel hierarchical spatial-temporal neural network model for eeg emotion recognition. IEEE Transactions on Affective Computing, 13(2):568–578, 2019.
- A novel bi-hemispheric discrepancy model for eeg emotion recognition. IEEE Transactions on Cognitive and Developmental Systems, 13(2):354–367, 2020.
- Cross-subject eeg emotion recognition with self-organized graph neural network. Frontiers in Neuroscience, 15:611653, 2021.
- A multi-domain adaptive graph convolutional network for eeg-based emotion recognition. In Proceedings of the 29th ACM International Conference on Multimedia, pages 5565–5573, 2021.
- Attention-based spatio-temporal graphic lstm for eeg emotion recognition. In 2021 International Joint Conference on Neural Networks (IJCNN), pages 1–8. IEEE, 2021.
- Semi-supervised eeg emotion recognition model based on enhanced graph fusion and gcn. Journal of Neural Engineering, 19(2):026039, 2022.
- Gmss: Graph-based multi-task self-supervised learning for eeg emotion recognition. IEEE Transactions on Affective Computing, 2022.
- Eeg-based emotion recognition using trainable adjacency relation driven graph convolutional network. IEEE Transactions on Cognitive and Developmental Systems, 2023.
- Emotion recognition using spatial-temporal eeg features through convolutional graph attention network. Journal of Neural Engineering, 20(1):016046, 2023.
- Sparse graphic attention lstm for eeg emotion recognition. In International Conference on Neural Information Processing, pages 690–697. Springer, 2019.
- Minimum spanning tree based graph neural network for emotion classification using eeg. Neural Networks, 145:308–318, 2022.
- Cr-gat: Consistency regularization enhanced graph attention network for semi-supervised eeg emotion recognition. In 2022 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pages 2017–2023. IEEE, 2022.
- Emotion downregulation targets interoceptive brain regions while emotion upregulation targets other affective brain regions. Journal of Neuroscience, 42(14):2973–2985, 2022.
- Multimodal physiological signals fusion for online emotion recognition. In Proceedings of the 31st ACM International Conference on Multimedia, pages 5879–5888, 2023.
- Ogssl: A semi-supervised classification model coupled with optimal graph learning for eeg emotion recognition. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 30:1288–1297, 2022.
- Cross-session emotion recognition by joint label-common and label-specific eeg features exploration. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 31:759–768, 2022.
- A multi-head residual connection gcn for eeg emotion recognition. Computers in Biology and Medicine, page 107126, 2023.
- Neurophysiological architecture of functional magnetic resonance images of human brain. Cerebral cortex, 15(9):1332–1342, 2005.
- Eeg emotion recognition using dynamical graph convolutional neural networks. IEEE Transactions on Affective Computing, 11(3):532–541, 2018.
- Variational instance-adaptive graph for eeg emotion recognition. IEEE Transactions on Affective Computing, 2021.
- Graph-embedded convolutional neural network for image-based eeg emotion recognition. IEEE Transactions on Emerging Topics in Computing, 10(3):1399–1413, 2021.
- A dual-branch dynamic graph convolution based adaptive transformer feature fusion network for eeg emotion recognition. IEEE Transactions on Affective Computing, 13(4):2218–2228, 2022.
- Dagam: a domain adversarial graph attention model for subject-independent eeg-based emotion recognition. Journal of Neural Engineering, 20(1):016022, 2023.
- Adaptive hierarchical graph convolutional network for eeg emotion recognition. In 2022 International Joint Conference on Neural Networks (IJCNN), pages 1–8. IEEE, 2022.
- Eeg based emotion recognition by hierarchical bayesian spectral regression framework. Journal of Neuroscience Methods, 402:110015, 2024.
- Hierarchical dynamic graph convolutional network with interpretability for eeg-based emotion recognition. IEEE Transactions on Neural Networks and Learning Systems, 2022.
- Siam-gcan: a siamese graph convolutional attention network for eeg emotion recognition. IEEE Transactions on Instrumentation and Measurement, 71:1–9, 2022.
- Gcb-net: Graph convolutional broad network and its application in emotion recognition. IEEE Transactions on Affective Computing, 13(1):379–388, 2019.
- Variational pathway reasoning for eeg emotion recognition. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 34, pages 2709–2716, 2020.
- Sparsedgcnn: Recognizing emotion from multichannel eeg signals. IEEE Transactions on Affective Computing, 2021.
- Scc-mpgcn: Self-attention coherence clustering based on multi-pooling graph convolutional network for eeg emotion recognition. Journal of Neural Engineering, 19(2):026051, 2022.
- Investigating critical frequency bands and channels for eeg-based emotion recognition with deep neural networks. IEEE Transactions on autonomous mental development, 7(3):162–175, 2015.
- Eeg emotion recognition based on hierarchy graph convolution network. In 2021 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pages 1628–1632. IEEE, 2021.
- Eeg-based emotion recognition using regularized graph neural networks. IEEE Transactions on Affective Computing, 13(3):1290–1301, 2020.
- Chenyu Liu (37 papers)
- Xinliang Zhou (11 papers)
- Yihao Wu (9 papers)
- Ruizhi Yang (31 papers)
- Liming Zhai (8 papers)
- Ziyu Jia (13 papers)
- Yang Liu (2253 papers)
- Zhongruo Wang (11 papers)