Papers
Topics
Authors
Recent
Search
2000 character limit reached

Domain Generalization for Zero-calibration BCIs with Knowledge Distillation-based Phase Invariant Feature Extraction

Published 18 May 2024 in cs.HC and eess.SP | (2405.11163v1)

Abstract: The distribution shift of electroencephalography (EEG) data causes poor generalization of braincomputer interfaces (BCIs) in unseen domains. Some methods try to tackle this challenge by collecting a portion of user data for calibration. However, it is time-consuming, mentally fatiguing, and user-unfriendly. To achieve zerocalibration BCIs, most studies employ domain generalization (DG) techniques to learn invariant features across different domains in the training set. However, they fail to fully explore invariant features within the same domain, leading to limited performance. In this paper, we present an novel method to learn domain-invariant features from both interdomain and intra-domain perspectives. For intra-domain invariant features, we propose a knowledge distillation framework to extract EEG phase-invariant features within one domain. As for inter-domain invariant features, correlation alignment is used to bridge distribution gaps across multiple domains. Experimental results on three public datasets validate the effectiveness of our method, showcasing stateof-the-art performance. To the best of our knowledge, this is the first domain generalization study that exploit Fourier phase information as an intra-domain invariant feature to facilitate EEG generalization. More importantly, the zerocalibration BCI based on inter- and intra-domain invariant features has significant potential to advance the practical applications of BCIs in real world.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (43)
  1. P. R. Kennedy, R. A. Bakay, M. M. Moore, K. Adams, and J. Goldwaithe, “Direct control of a computer from the human central nervous system,” IEEE Transactions on rehabilitation engineering, vol. 8, no. 2, pp. 198–202, 2000.
  2. Y. Zhong, L. Yao, J. Wang, and Y. Wang, “Tactile sensation assisted motor imagery training for enhanced bci performance: A randomized controlled study,” IEEE Transactions on Biomedical Engineering, vol. 70, no. 2, pp. 694–702, 2023.
  3. A. Chowdhury, Y. K. Meena, H. Raza, B. Bhushan, A. K. Uttam, N. Pandey, A. A. Hashmi, A. Bajpai, A. Dutta, and G. Prasad, “Active physical practice followed by mental practice using bci-driven hand exoskeleton: A pilot trial for clinical effectiveness and usability,” IEEE Journal of Biomedical and Health Informatics, vol. 22, no. 6, pp. 1786–1795, 2018.
  4. H. He and D. Wu, “Transfer learning for brain–computer interfaces: A euclidean space data alignment approach,” IEEE Transactions on Biomedical Engineering, vol. 67, no. 2, pp. 399–410, 2019.
  5. Y. Zhu, F. Zhuang, J. Wang, G. Ke, J. Chen, J. Bian, H. Xiong, and Q. He, “Deep subdomain adaptation network for image classification,” IEEE Transactions on Neural Networks and Learning Systems, vol. 32, no. 4, pp. 1713–1722, 2021.
  6. D. Liu, J. Zhang, H. Wu, S. Liu, and J. Long, “Multi-source transfer learning for eeg classification based on domain adversarial neural network,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 31, pp. 218–228, 2023.
  7. Y. Jiao, Y. Zhang, X. Chen, E. Yin, J. Jin, X. Wang, and A. Cichocki, “Sparse group representation model for motor imagery eeg classification,” IEEE Journal of Biomedical and Health Informatics, vol. 23, no. 2, pp. 631–641, 2019.
  8. A. M. Azab, L. Mihaylova, K. K. Ang, and M. Arvaneh, “Weighted transfer learning for improving motor imagery-based brain–computer interface,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 27, no. 7, pp. 1352–1359, 2019.
  9. Z. Liang, Z. Zheng, W. Chen, Z. Pei, J. Wang, and J. Chen, “Manifold embedded instance selection to suppress negative transfer in motor imagery-based brain–computer interface,” Biomedical Signal Processing and Control, vol. 88, p. 105556, 2024.
  10. K. Zhou, Z. Liu, Y. Qiao, T. Xiang, and C. C. Loy, “Domain generalization: A survey,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 45, no. 4, pp. 4396–4415, 2023.
  11. J. Han, X. Gu, G.-Z. Yang, and B. Lo, “Noise-factorized disentangled representation learning for generalizable motor imagery eeg classification,” IEEE Journal of Biomedical and Health Informatics, vol. 28, no. 2, pp. 765–776, 2024.
  12. Y. Kwak, K. Kong, W.-J. Song, and S.-E. Kim, “Subject-invariant deep neural networks based on baseline correction for eeg motor imagery bci,” IEEE Journal of Biomedical and Health Informatics, vol. 27, no. 4, pp. 1801–1812, 2023.
  13. M.-H. Bui, T. Tran, A. Tran, and D. Phung, “Exploiting domain-specific features to enhance domain generalization,” Advances in Neural Information Processing Systems, vol. 34, pp. 21189–21201, 2021.
  14. H. Zhao, R. T. Des Combes, K. Zhang, and G. Gordon, “On learning invariant representations for domain adaptation,” in International conference on machine learning, pp. 7523–7532, PMLR, 2019.
  15. W. Lu, J. Wang, H. Li, Y. Chen, and X. Xie, “Domain-invariant feature exploration for domain generalization,” arXiv preprint arXiv:2207.12020, 2022.
  16. Y. Yang, D. Lao, G. Sundaramoorthi, and S. Soatto, “Phase consistent ecological domain adaptation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9011–9020, 2020.
  17. A. V. Oppenheim and J. S. Lim, “The importance of phase in signals,” Proceedings of the IEEE, vol. 69, no. 5, pp. 529–541, 1981.
  18. S. Lin, Z. Zhang, Z. Huang, Y. Lu, C. Lan, P. Chu, Q. You, J. Wang, Z. Liu, A. Parulkar, et al., “Deep frequency filtering for domain generalization,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 11797–11807, 2023.
  19. S. Ben-David, J. Blitzer, K. Crammer, and F. Pereira, “Analysis of representations for domain adaptation,” Advances in neural information processing systems, vol. 19, 2006.
  20. K. M. Borgwardt, A. Gretton, M. J. Rasch, H.-P. Kriegel, B. Schölkopf, and A. J. Smola, “Integrating structured biological data by kernel maximum mean discrepancy,” Bioinformatics, vol. 22, no. 14, pp. e49–e57, 2006.
  21. B. Sun, J. Feng, and K. Saenko, “Return of frustratingly easy domain adaptation,” in Proceedings of the AAAI conference on artificial intelligence, vol. 30, 2016.
  22. G. Hinton, O. Vinyals, and J. Dean, “Distilling the knowledge in a neural network,” arXiv preprint arXiv:1503.02531, 2015.
  23. M. Wang, T. Lin, Y. Peng, W. Zhu, Y. Zhou, F. Shi, K. Yu, Q. Meng, Y. Liu, Z. Chen, Y. Shen, D. Xiang, H. Chen, and X. Chen, “Self-guided optimization semi-supervised method for joint segmentation of macular hole and cystoid macular edema in retinal oct images,” IEEE Transactions on Biomedical Engineering, vol. 70, no. 7, pp. 2013–2024, 2023.
  24. M. Rahimpour, J. Bertels, A. Radwan, H. Vandermeulen, S. Sunaert, D. Vandermeulen, F. Maes, K. Goffin, and M. Koole, “Cross-modal distillation to improve mri-based brain tumor segmentation with missing mri sequences,” IEEE Transactions on Biomedical Engineering, vol. 69, no. 7, pp. 2153–2164, 2022.
  25. Q. Xu, R. Zhang, Y. Zhang, Y. Wang, and Q. Tian, “A fourier-based framework for domain generalization,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 14383–14392, 2021.
  26. Y. Yang and S. Soatto, “Fda: Fourier domain adaptation for semantic segmentation,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 4085–4095, 2020.
  27. V. J. Lawhern, A. J. Solon, N. R. Waytowich, S. M. Gordon, C. P. Hung, and B. J. Lance, “Eegnet: a compact convolutional neural network for eeg-based brain–computer interfaces,” Journal of neural engineering, vol. 15, no. 5, p. 056013, 2018.
  28. S. Sakhavi, C. Guan, and S. Yan, “Learning temporal information for brain-computer interface using convolutional neural networks,” IEEE transactions on neural networks and learning systems, vol. 29, no. 11, pp. 5619–5629, 2018.
  29. R. T. Schirrmeister, J. T. Springenberg, L. D. J. Fiederer, M. Glasstetter, K. Eggensperger, M. Tangermann, F. Hutter, W. Burgard, and T. Ball, “Deep learning with convolutional neural networks for eeg decoding and visualization,” Human brain mapping, vol. 38, no. 11, pp. 5391–5420, 2017.
  30. G. Parascandolo, A. Neitz, A. Orvieto, L. Gresele, and B. Schölkopf, “Learning explanations that are hard to vary,” in International Conference on Learning Representations (ICLR 2021), OpenReview, 2021.
  31. D. Krueger, E. Caballero, J.-H. Jacobsen, A. Zhang, J. Binas, D. Zhang, R. Le Priol, and A. Courville, “Out-of-distribution generalization via risk extrapolation (rex),” in International Conference on Machine Learning, pp. 5815–5826, PMLR, 2021.
  32. S. Sagawa, P. W. Koh, T. B. Hashimoto, and P. Liang, “Distributionally robust neural networks for group shifts: On the importance of regularization for worst-case generalization,” arXiv preprint arXiv:1911.08731, 2019.
  33. Z. Huang, H. Wang, E. P. Xing, and D. Huang, “Self-challenging improves cross-domain generalization,” in Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part II 16, pp. 124–140, Springer, 2020.
  34. Y. Ganin, E. Ustinova, H. Ajakan, P. Germain, H. Larochelle, F. Laviolette, M. March, and V. Lempitsky, “Domain-adversarial training of neural networks,” Journal of machine learning research, vol. 17, no. 59, pp. 1–35, 2016.
  35. B. Sun and K. Saenko, “Deep coral: Correlation alignment for deep domain adaptation,” in Computer Vision–ECCV 2016 Workshops: Amsterdam, The Netherlands, October 8-10 and 15-16, 2016, Proceedings, Part III 14, pp. 443–450, Springer, 2016.
  36. H. Zhang, M. Cisse, Y. N. Dauphin, and D. Lopez-Paz, “mixup: Beyond empirical risk minimization,” in International Conference on Learning Representations, 2018.
  37. D. Li, Y. Yang, Y.-Z. Song, and T. Hospedales, “Learning to generalize: Meta-learning for domain generalization,” in Proceedings of the AAAI conference on artificial intelligence, vol. 32, 2018.
  38. D. Arpit, H. Wang, Y. Zhou, and C. Xiong, “Ensemble of averages: Improving model selection and boosting performance in domain generalization,” Advances in Neural Information Processing Systems, vol. 35, pp. 8265–8277, 2022.
  39. E. Jeon, W. Ko, J. S. Yoon, and H.-I. Suk, “Mutual information-driven subject-invariant and class-relevant deep representation learning in bci,” IEEE Transactions on Neural Networks and Learning Systems, vol. 34, no. 2, pp. 739–749, 2023.
  40. S. Liang, C. Xuan, W. Hang, B. Lei, J. Wang, J. Qin, K.-S. Choi, and Y. Zhang, “Domain-generalized eeg classification with category-oriented feature decorrelation and cross-view consistency learning,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 31, pp. 3285–3296, 2023.
  41. P. Autthasan, R. Chaisaen, T. Sudhawiyangkul, P. Rangpong, S. Kiatthaveephong, N. Dilokthanakul, G. Bhakdisongkhram, H. Phan, C. Guan, and T. Wilaiprasitporn, “Min2net: End-to-end multi-task learning for subject-independent motor imagery eeg classification,” IEEE Transactions on Biomedical Engineering, vol. 69, no. 6, pp. 2105–2118, 2022.
  42. Y. Song, Q. Zheng, B. Liu, and X. Gao, “Eeg conformer: Convolutional transformer for eeg decoding and visualization,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 31, pp. 710–719, 2023.
  43. G. Pfurtscheller, A. Stancak Jr, and C. Neuper, “Event-related synchronization (ers) in the alpha band—an electrophysiological correlate of cortical idling: a review,” International journal of psychophysiology, vol. 24, no. 1-2, pp. 39–46, 1996.
Citations (1)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Summarize

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up