Optimality of UTF-8 as a byte-level output representation for ASR
Determine whether UTF-8 byte encoding is optimal as a byte-level output representation for end-to-end automatic speech recognition (ASR) systems.
References
While UTF-8 has proven to be an effective output representation for ASR, it is unclear whether it is optimal.
— Optimizing Byte-level Representation for End-to-end ASR
(2406.09676 - Hsiao et al., 2024) in Section 1 (Introduction)
Decoding is greedy CTC without an external LLM: a token-level LM would tie the decoding vocabulary to the tokenizer under study and conflate its language-modeling contribution with the acoustic comparison. Every WER/CER/PER reported here therefore reflects the encoder plus tokenizer-specific head in isolation; LM rescoring, and the tokenizer--LM interaction it opens up, is left to future work (§\ref{sec:conclusion}).
— Phonologically Informed Tokenization for German Speech Recognition: A Cross-Domain Study
(2610.11646 - Witzl et al., 8 Oct 2026) in Section 2, Evaluation protocol; reiterated in Section 7, Conclusion