Leveraging Data Collection and Unsupervised Learning for Code-switched Tunisian Arabic Automatic Speech Recognition (2309.11327v2)
Abstract: Crafting an effective Automatic Speech Recognition (ASR) solution for dialects demands innovative approaches that not only address the data scarcity issue but also navigate the intricacies of linguistic diversity. In this paper, we address the aforementioned ASR challenge, focusing on the Tunisian dialect. First, textual and audio data is collected and in some cases annotated. Second, we explore self-supervision, semi-supervision and few-shot code-switching approaches to push the state-of-the-art on different Tunisian test sets; covering different acoustic, linguistic and prosodic conditions. Finally, and given the absence of conventional spelling, we produce a human evaluation of our transcripts to avoid the noise coming from spelling inadequacies in our testing references. Our models, allowing to transcribe audio samples in a linguistic mix involving Tunisian Arabic, English and French, and all the data used during training and testing are released for public use and further improvements.
- “Robust speech recognition via large-scale weak supervision,” 2022.
- “Scaling speech technology to 1,000+ languages,” arXiv, 2023.
- “A conventional orthography for tunisian arabic.,” in LREC, 2014, pp. 2355–2361.
- “Tunisian dialect sentiment analysis: a natural language processing-based approach,” Computación y Sistemas, vol. 22, no. 4, 2018.
- “Automatic speech recognition system for tunisian dialect,” Language Resources and Evaluation, vol. 52, pp. 249–267, 2018.
- “Tunisian dialectal end-to-end speech recognition based on deepspeech,” Procedia Computer Science, vol. 189, pp. 183–190, 2021.
- Jonatas Grosman, “Fine-tuned XLSR-53 large model for speech recognition in Arabic,” 2021.
- Lotfi Sayahi, “Code-switching and language change in tunisia,” vol. 2011, no. 211, pp. 113–133, 2011.
- “The asru 2019 mandarin-english code-switching speech recognition challenge: Open datasets, tracks, methods and results,” arXiv preprint arXiv:2007.05916, 2020.
- “Addressing Code-Switching in French/Algerian Arabic Speech,” in Interspeech 2017, Stockholm, Sweden, Aug. 2017, pp. 62–66.
- “Investigations on speech recognition systems for low-resource dialectal arabic–english code-switching speech,” Computer Speech & Language, vol. 72, pp. 101278, 2022.
- “A survey of code-switched speech and language processing,” 2019.
- Karen McNeil, “Tunisian arabic corpus: Creating a written corpus of an ‘unwritten’language,” Arabic corpus linguistics, vol. 30, 2018.
- “doccano: Text annotation tool for human,” 2018.
- “Pyannote. audio: neural building blocks for speaker diarization,” in ICASSP. IEEE, 2020.
- “On-trac consortium systems for the iwslt 2022 dialect and low-resource speech translation tasks,” .
- “Findings of the iwslt 2022 evaluation campaign.,” in IWSLT 2022. ACL, 2022.
- “Speech self-supervised representation benchmarking: Are we doing it right?,” arXiv preprint arXiv:2306.00452, 2023.
- “Xls-r: Self-supervised cross-lingual speech representation learning at scale,” 2021.
- “Wavlm: Large-scale self-supervised pre-training for full stack speech processing,” IEEE JSTSP, 2022.
- “Speech recognition with deep recurrent neural networks,” in ICASSP. IEEE, 2013, pp. 6645–6649.
- Kenneth Heafield, “KenLM: Faster and smaller language model queries,” in Proceedings of the Sixth Workshop on Statistical Machine Translation, Edinburgh, Scotland, July 2011, pp. 187–197, ACL.
- “Continuous pseudo-labeling from the start,” ICLR, 2023.
- “Towards zero-shot code-switched speech recognition,” in ICASSP, 2023.
- “Common voice: A massively-multilingual speech corpus,” 2020.