2000 character limit reached
Continuous Speech Recognition using EEG and Video (1912.07730v5)
Published 16 Dec 2019 in cs.LG, eess.AS, eess.IV, and stat.ML
Abstract: In this paper we investigate whether electroencephalography (EEG) features can be used to improve the performance of continuous visual speech recognition systems. We implemented a connectionist temporal classification (CTC) based end-to-end automatic speech recognition (ASR) model for performing recognition. Our results demonstrate that EEG features are helpful in enhancing the performance of continuous visual speech recognition systems.