CLEEGN: A Convolutional Neural Network for Plug-and-Play Automatic EEG Reconstruction (2210.05988v2)
Abstract: Human electroencephalography (EEG) is a brain monitoring modality that senses cortical neuroelectrophysiological activity in high-temporal resolution. One of the greatest challenges posed in applications of EEG is the unstable signal quality susceptible to inevitable artifacts during recordings. To date, most existing techniques for EEG artifact removal and reconstruction are applicable to offline analysis solely, or require individualized training data to facilitate online reconstruction. We have proposed CLEEGN, a novel convolutional neural network for plug-and-play automatic EEG reconstruction. CLEEGN is based on a subject-independent pre-trained model using existing data and can operate on a new user without any further calibration. The performance of CLEEGN was validated using multiple evaluations including waveform observation, reconstruction error assessment, and decoding accuracy on well-studied labeled datasets. The results of simulated online validation suggest that, even without any calibration, CLEEGN can largely preserve inherent brain activity and outperforms leading online/offline artifact removal methods in the decoding accuracy of reconstructed EEG data. In addition, visualization of model parameters and latent features exhibit the model behavior and reveal explainable insights related to existing knowledge of neuroscience. We foresee pervasive applications of CLEEGN in prospective works of online plug-and-play EEG decoding and analysis.
- S. Koike, Y. Nishimura, R. Takizawa, N. Yahata, and K. Kasai, “Near-infrared spectroscopy in schizophrenia: a possible biomarker for predicting clinical outcome and treatment response,” Frontiers in psychiatry, vol. 4, p. 145, 2013.
- R. K. Mehta and R. Parasuraman, “Neuroergonomics: a review of applications to physical and cognitive work,” Frontiers in human neuroscience, vol. 7, p. 889, 2013.
- T. J. Sejnowski, P. S. Churchland, and J. A. Movshon, “Putting big data to good use in neuroscience,” Nature neuroscience, vol. 17, no. 11, p. 1440, 2014.
- L. F. Nicolas-Alonso and J. Gomez-Gil, “Brain computer interfaces, a review,” sensors, vol. 12, no. 2, pp. 1211–1279, 2012.
- M. X. Cohen, “Where does eeg come from and what does it mean?” Trends in neurosciences, vol. 40, no. 4, pp. 208–218, 2017.
- R. J. Croft and R. J. Barry, “Removal of ocular artifact from the eeg: a review,” Neurophysiologie Clinique/Clinical Neurophysiology, vol. 30, no. 1, pp. 5–19, 2000.
- G. L. Wallstrom, R. E. Kass, A. Miller, J. F. Cohn, and N. A. Fox, “Automatic correction of ocular artifacts in the eeg: a comparison of regression-based and component-based methods,” International journal of psychophysiology, vol. 53, no. 2, pp. 105–119, 2004.
- S. Romero, M. A. Mañanas, and M. J. Barbanoj, “A comparative study of automatic techniques for ocular artifact reduction in spontaneous eeg signals based on clinical target variables: a simulation case,” Computers in biology and medicine, vol. 38, no. 3, pp. 348–360, 2008.
- S. Seifzadeh, K. Faez, and M. Amiri, “Comparison of different linear filter design methods for handling ocular artifacts in brain computer interface system,” Journal of Computer & Robotics, vol. 7, pp. 51–56, 2014.
- A. Schlogl, C. Keinrath, D. Zimmermann, R. Scherer, R. Leeb, and G. Pfurtscheller, “A fully automated correction method of eog artifacts in eeg recordings,” Clinical Neurophysiology, vol. 118, no. 1, pp. 98–104, 2007.
- M. Alam and B. Samanta, “Performance evaluation of empirical mode decomposition for eeg artifact removal,” International Mechanical Engineering Congress and Exposition, p. V04BT05A024, 11 2017.
- A. Egambaram, N. Badruddin, V. S. Asirvadam, and T. Begum, “Comparison of envelope interpolation techniques in empirical mode decomposition (emd) for eyeblink artifact removal from eeg,” in 2016 IEEE EMBS Conference on Biomedical Engineering and Sciences (IECBES), 2016, pp. 590–595.
- Y. Chen, Q. Zhao, B. Hu, J. Li, H. Jiang, W. Lin, Y. Li, S. Zhou, and H. Peng, “A method of removing ocular artifacts from eeg using discrete wavelet transform and kalman filtering,” in 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), 2016, pp. 1485–1492.
- W. De Clercq, A. Vergult, B. Vanrumste, W. Van Paesschen, and S. Van Huffel, “Canonical correlation analysis applied to remove muscle artifacts from the electroencephalogram,” IEEE Transactions on Biomedical Engineering, vol. 53, no. 12, pp. 2583–2587, 2006.
- S. Makeig, A. Bell, T.-P. Jung, and T. J. Sejnowski, “Independent component analysis of electroencephalographic data,” in Advances in Neural Information Processing Systems, D. Touretzky, M. Mozer, and M. Hasselmo, Eds., vol. 8. MIT Press, 1995.
- C.-Y. Chang, S.-H. Hsu, L. Pion-Tonachini, and T.-P. Jung, “Evaluation of artifact subspace reconstruction for automatic artifact components removal in multi-channel eeg recordings,” IEEE Transactions on Biomedical Engineering, vol. 67, no. 4, pp. 1114–1121, 2020.
- N. P. Castellanos and V. A. Makarov, “Recovering eeg brain signals: Artifact suppression with wavelet enhanced independent component analysis,” Journal of Neuroscience Methods, vol. 158, no. 2, pp. 300–312, 2006.
- K. Zeng, D. Chen, G. Ouyang, L. Wang, X. Liu, and X. Li, “An eemd-ica approach to enhancing artifact rejection for noisy multivariate neural data,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 24, no. 6, pp. 630–638, 2016.
- X. Chen, Q. Chen, Y. Zhang, and Z. J. Wang, “A novel eemd-cca approach to removing muscle artifacts for pervasive eeg,” IEEE Sensors Journal, vol. 19, no. 19, pp. 8420–8431, 2019.
- J. A. Urigüen and B. Garcia-Zapirain, “Eeg artifact removal—state-of-the-art and guidelines,” Journal of neural engineering, vol. 12, no. 3, p. 031001, 2015.
- X. Jiang, G.-B. Bian, and Z. Tian, “Removal of artifacts from eeg signals: a review,” Sensors, vol. 19, no. 5, p. 987, 2019.
- Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,” nature, vol. 521, no. 7553, pp. 436–444, 2015.
- Y.-T. Pan, J.-L. Chou, and C.-S. Wei, “MAtt: A manifold attention network for EEG decoding,” in Advances in Neural Information Processing Systems, A. H. Oh, A. Agarwal, D. Belgrave, and K. Cho, Eds., 2022. [Online]. Available: https://openreview.net/forum?id=YG4Dg7xtETg
- C.-S. Wei, T. Koike-Akino, and Y. Wang, “Spatial component-wise convolutional network (sccnet) for motor-imagery eeg classification,” in 2019 9th International IEEE/EMBS Conference on Neural Engineering (NER). IEEE, 2019, pp. 328–331.
- V. J. Lawhern, A. J. Solon, N. R. Waytowich, S. M. Gordon, C. P. Hung, and B. J. Lance, “Eegnet: a compact convolutional neural network for eeg-based brain–computer interfaces,” Journal of neural engineering, vol. 15, no. 5, p. 056013, 2018.
- R. T. Schirrmeister, J. T. Springenberg, L. D. J. Fiederer, M. Glasstetter, K. Eggensperger, M. Tangermann, F. Hutter, W. Burgard, and T. Ball, “Deep learning with convolutional neural networks for eeg decoding and visualization,” Human Brain Mapping, 2017.
- N. M. N. Leite, E. T. Pereira, E. C. Gurjão, and L. R. Veloso, “Deep convolutional autoencoder for eeg noise filtering,” in 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM). IEEE, 2018, pp. 2605–2612.
- W. Sun, Y. Su, X. Wu, and X. Wu, “A novel end-to-end 1d-rescnn model to remove artifact from eeg signals,” Neurocomputing, vol. 404, pp. 108–121, 2020.
- H. Zhang, M. Zhao, C. Wei, D. Mantini, Z. Li, and Q. Liu, “Eegdenoisenet: A benchmark dataset for end-to-end deep learning solutions of eeg denoising,” 2020.
- S. S. Lee, K. Lee, and G. Kang, “Eeg artifact removal by bayesian deep learning & ica,” in 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC). IEEE, 2020, pp. 932–935.
- F. Lopes, A. Leal, J. Medeiros, M. F. Pinto, A. Dourado, M. Dümpelmann, and C. Teixeira, “Automatic electroencephalogram artifact removal using deep convolutional neural networks,” IEEE Access, vol. 9, pp. 149 955–149 970, 2021.
- C.-H. Chuang, K.-Y. Chang, C.-S. Huang, and T.-P. Jung, “Ic-u-net: A u-net-based denoising autoencoder using mixtures of independent components for automatic eeg artifact removal,” NeuroImage, vol. 263, p. 119586, 2022.
- B. Noureddin, P. D. Lawrence, and G. E. Birch, “Time-frequency analysis of eye blinks and saccades in eog for eeg artifact removal,” in 2007 3rd International IEEE/EMBS Conference on Neural Engineering, 2007, pp. 564–567.
- L. Pion-Tonachini, K. Kreutz-Delgado, and S. Makeig, “Iclabel: An automated electroencephalographic independent component classifier, dataset, and website,” NeuroImage, vol. 198, pp. 181–197, 2019.
- S. Ioffe and C. Szegedy, “Batch normalization: Accelerating deep network training by reducing internal covariate shift,” 2015.
- M. Pal, R. Roy, J. Basu, and M. S. Bepari, “Blind source separation: A review and analysis,” in 2013 International Conference Oriental COCOSDA held jointly with 2013 Conference on Asian Spoken Language Research and Evaluation (O-COCOSDA/CASLRE), 2013, pp. 1–5. [Online]. Available: https://ieeexplore.ieee.org/document/6709849
- M. T. Akhtar, T.-P. Jung, S. Makeig, and G. Cauwenberghs, “Recursive independent component analysis for online blind source separation,” in 2012 IEEE International Symposium on Circuits and Systems (ISCAS), 2012, pp. 2813–2816.
- D. M. Olvet and G. Hajcak, “The error-related negativity (ern) and psychopathology: Toward an endophenotype,” Clinical Psychology Review, 2008. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0272735808001098
- S. J. Luck, G. F. Woodman, and E. K. Vogel, “Event-related potential studies of attention,” Trends in Cognitive Sciences, 2000. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S136466130001545X
- D. J. Krusienski, E. W. Sellers, D. J. McFarland, T. M. Vaughan, and J. R. Wolpaw, “Toward enhanced p300 speller performance,” Journal of neuroscience methods, vol. 167, no. 1, pp. 15–21, 2008.
- A. Delorme and S. Makeig, “Eeglab: an open source toolbox for analysis of single-trial eeg dynamics including independent component analysis,” Journal of neuroscience methods, vol. 134, no. 1, pp. 9–21, 2004.
- Z. Iscan and V. V. Nikulin, “Steady state visual evoked potential (ssvep) based brain-computer interface (bci) performance under different perturbations,” PLOS ONE, 2018.
- A. Hyvärinen and E. Oja, “A fast fixed-point algorithm for independent component analysis,” Neural Computation, vol. 9, no. 7, pp. 1483–1492, 1997.
- L. van der Maaten and G. Hinton, “Visualizing data using t-sne,” Journal of Machine Learning Research, vol. 9, no. 86, pp. 2579–2605, 2008. [Online]. Available: http://jmlr.org/papers/v9/vandermaaten08a.html
- A. Barachant, S. Bonnet, M. Congedo, and C. Jutten, “Classification of covariance matrices using a riemannian-based kernel for bci applications,” Neurocomputing, vol. 112, pp. 172–178, 2013.
- G. G. K., S. S. Prabhu, and N. Sinha, “Sleep eeg analysis utilizing inter-channel covariance matrices,” Biocybernetics and Biomedical Engineering, vol. 40, no. 1, pp. 527–545, 2020.