UMM: Unsupervised Mean-difference Maximization (2306.11830v1)
Abstract: Many brain-computer interfaces make use of brain signals that are elicited in response to a visual, auditory or tactile stimulus, so-called event-related potentials (ERPs). In visual ERP speller applications, sets of letters shown on a screen are flashed randomly, and the participant attends to the target letter they want to spell. When this letter flashes, the resulting ERP is different compared to when any other non-target letter flashes. We propose a new unsupervised approach to detect this attended letter. In each trial, for every available letter our approach makes the hypothesis that it is in fact the attended letter, and calculates the ERPs based on each of these hypotheses. We leverage the fact that only the true hypothesis produces the largest difference between the class means. Note that this unsupervised method does not require any changes to the underlying experimental paradigm and therefore can be employed in almost any ERP-based setup. To deal with limited data, we use a block-Toeplitz regularized covariance matrix that models the background activity. We implemented the proposed novel unsupervised mean-difference maximization (UMM) method and evaluated it in offline replays of brain-computer interface visual speller datasets. For a dataset that used 16 flashes per symbol per trial, UMM correctly classifies 3651 out of 3654 letters ($99.92\,\%$) across 25 participants. In another dataset with fewer and shorter trials, 7344 out of 7383 letters ($99.47\,\%$) are classified correctly across 54 participants with two sessions each. Even in more challenging datasets obtained from patients with amyotrophic lateral sclerosis ($77.86\,\%$) or when using auditory ERPs ($82.52\,\%$), the obtained classification rates obtained by UMM are competitive. In addition, UMM provides stable confidence measures which can be used to monitor convergence.
- A plug&play P300 BCI using information geometry. arXiv preprint arXiv:1409.0107, 2014.
- Single-trial analysis and classification of ERP components—a tutorial. NeuroImage, 56(2):814–825, 2011.
- Convolutional neural networks for P300 detection with application to brain-computer interfaces. IEEE transactions on pattern analysis and machine intelligence, 33(3):433–445, 2010.
- Stationarity of the human electroencephalogram. Medical and Biological Engineering and Computing, 15(5):513–518, 1977.
- Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. Electroencephalography and Clinical Neurophysiology, 70(6):510–523, 1988.
- Application of P300 event-related potential in brain-computer interface. Event-Related Potentials and Evoked Potentials, 1:19–36, 2017.
- Brain-controlled applications using dynamic P300 speller matrices. Artificial intelligence in medicine, 63(1):7–17, 2015.
- Hübner, D. From Supervised to Unsupervised Machine Learning Methods for Brain-Computer Interfaces and Their Application in Language Rehabilitation. PhD thesis, University of Freiburg, 2020.
- Learning from label proportions in brain-computer interfaces: online unsupervised learning with guarantees. PloS one, 12(4), 2017.
- Unsupervised learning for brain-computer interfaces based on event-related potentials: Review and online comparison. IEEE Computational Intelligence Magazine, 13(2):66–77, 2018.
- Transfer learning in brain-computer interfaces. IEEE Computational Intelligence Magazine, 11(1):20–31, 2016.
- Analyzing and visualizing single-trial event-related potentials. Advances in neural information processing systems, 11, 1998.
- Flashing characters with famous faces improves ERP-based brain–computer interface performance. Journal of neural engineering, 8(5):056016, 2011.
- A Bayesian model for exploiting application constraints to enable unsupervised training of a P300-based BCI. PloS one, 7(4):e33758, 2012.
- A case-study on naive labelling for the nearest mean and the linear discriminant classifiers. Pattern Recognition, 41(10):3010–3020, 2008.
- A well-conditioned estimator for large-dimensional covariance matrices. Journal of multivariate analysis, 88(2):365–411, 2004.
- EEG dataset and OpenBMI toolbox for three BCI paradigms: An investigation into BCI illiteracy. GigaScience, 8(5):giz002, 2019.
- A hybrid BCI system combining P300 and SSVEP and its application to wheelchair control. IEEE Transactions on Biomedical Engineering, 60(11):3156–3166, 2013.
- A novel P300 BCI speller based on the triple RSVP paradigm. Scientific reports, 8(1):3350, 2018.
- A review of classification algorithms for EEG-based brain–computer interfaces: a 10 year update. Journal of neural engineering, 15(3):031005, 2018.
- The importance of the normality assumption in large public health data sets. Annual review of public health, 23(1):151–169, 2002.
- BCI for stroke rehabilitation: motor and beyond. Journal of Neural Engineering, 17(4):041001, 2020.
- Aphasia recovery by language training using a brain-computer interface – a proof-of-concept study. Brain Communications, 2022. doi: 10.1093/braincomms/fcac008.
- Nunez, P. L. Electric and magnetic fields produced by the brain. Brain-Computer Interfaces: Principles and Practice, pp. 171–212, 2012.
- A superfast Toeplitz matrix inversion method for single-and multi-channel inverse filters and its application to room equalization. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 29:3144–3157, 2021.
- Attention and P300-based BCI performance in people with amyotrophic lateral sclerosis. Frontiers in human neuroscience, 7:732, 2013.
- Schreuder, E.-J. M. Towards efficient auditory BCI through optimized paradigms and methods. Technische Universitaet Berlin (Germany), 2014.
- Introducing block-Toeplitz covariance matrices to remaster linear discriminant analysis for event-related potential brain-computer interfaces. Journal of Neural Engineering, 2022. doi: 10.1088/1741-2552/ac9c98.
- A visual brain-computer interface as communication aid for patients with amyotrophic lateral sclerosis. Clinical Neurophysiology, 132(10):2404–2415, 2021.
- Improving zero-training brain-computer interfaces by mixing model estimators. Journal of neural engineering, 14(3):036021, 2017.
- Brain-computer interfaces: principles and practice. OUP USA, 2012.