Papers
Topics
Authors
Recent
Search
2000 character limit reached

Qualitative Evaluation of Language Model Rescoring in Automatic Speech Recognition

Published 30 Apr 2026 in cs.CL | (2604.27533v1)

Abstract: Evaluating automatic speech recognition (ASR) systems is a classical but difficult and still open problem, which often boils down to focusing only on the word error rate (WER). However, this metric suffers from many limitations and does not allow an in-depth analysis of automatic transcription errors. In this paper, we propose to study and understand the impact of rescoring using LLMs in ASR systems by means of several metrics often used in other NLP tasks in addition to the WER. In particular, we introduce two measures related to morpho-syntactic and semantic aspects of transcribed words: 1) the POSER (Part-of-speech Error Rate), which should highlight the grammatical aspects, and 2) the EmbER (Embedding Error Rate), a measurement that modifies the WER by providing a weighting according to the semantic distance of the wrongly transcribed words. These metrics illustrate the linguistic contributions of the LLMs that are applied during a posterior rescoring step on transcription hypotheses.

Summary

  • The paper demonstrates that LM rescoring reduces WER and related syntactic error metrics yet achieves smaller improvements in deep semantic scores.
  • It introduces six complementary metrics including CER, POSER, LER, EmbER, BERTScore, and SemDist to assess ASR linguistic output.
  • Empirical findings highlight a ceiling effect in semantic gains, urging the need for evaluation strategies beyond traditional WER measures.

Qualitative Metrics for LLM Rescoring in ASR

Introduction

The dominance of word error rate (WER) as the primary intrinsic metric for automatic speech recognition (ASR) evaluation obscures the nuanced linguistic performance of ASR models, particularly in post-processing steps such as LLM (LM) rescoring. The paper "Qualitative Evaluation of LLM Rescoring in Automatic Speech Recognition" (2604.27533) presents an in-depth analysis of LM rescoring impacts using a suite of complementary automatic evaluation metrics, each designed to probe distinct syntactic and semantic dimensions of ASR output. Focusing on a French broadcast domain, the authors introduce novel and adapted metrics, produce a critical assessment of their intercorrelations, and provide empirical findings on the qualitative effects of LM rescoring.

Alternative Evaluation Metrics Beyond WER

While WER is widely adopted for its simplicity and annotation requirements, it fails to capture the linguistic granularity of errors and does not account for semantic proximity or the grammatical role of words. This study augments WER with six additional metrics:

  • Character Error Rate (CER): Measures errors at the character level, sensitive to morphosyntactic discrepancies such as gender or tense.
  • Part-of-Speech Error Rate (POSER): Quantifies errors in POS tagging. Two variants are used: detailed (dPOSER) and universal (uPOSER), enabling granular grammatical analysis.
  • Lemma Error Rate (LER): Captures errors at the lemma level, with both word and character-based versions (LCER).
  • Embedding Error Rate (EmbER): Weights WER by the semantic distance between embedding representations (FastText), differentiating between errors that are semantically close versus distant.
  • BERTScore: Evaluates lexical semantic similarity at the token level using contextual embeddings.
  • Sentence Semantic Distance (SemDist): Aggregates semantic discrepancy at the whole-sentence level using SentenceBERT embeddings, highlighting the sentence-level meaning loss that word-level metrics may miss.

These metrics collectively provide a multi-faceted lens on ASR system behavior, discriminating between surface form errors, grammatical mismatches, and semantic divergence.

Experimental Protocol and System Description

The evaluation employs a robust ASR pipeline trained on a comprehensive collection of French radio and TV broadcast corpora (ESTER, EPAC, ETAPE, REPERE, and internal data, totaling 940 hours). Acoustic modeling is handled by a TDNNF architecture with augmentation strategies for increased robustness. For language modeling, a progression is established: a trigram model is used in the initial recognition, followed by a quadrigram and RNNLM for rescoring. POS tagging leverages contextual string embeddings (Flair) via POET, and lemmatization is performed with spaCy.

Metrics are computed exclusively on the test set and fully automatically, without manual POS annotation, ensuring scalability and reproducibility.

Metrics Analysis and Intercorrelation

A Pearson correlation analysis reveals critical relationships among metrics. SemDist exhibits low correlation with traditional metrics (WER, CER), emphasizing its unique sensitivity to meaning preservation at the utterance level. The EmbER metric bridges the gap, showing high correlation both with WER and embedding-based semantic metrics. Notably, LER correlates most strongly with uPOSER, indicating a linguistic affinity between morphological regularity (lemmas) and grammatical structure (POS tags). LCER essentially tracks CER due to their shared sensitivity to minor lexical deviations.

These findings substantiate the claim that improvement in WER does not universally translate to improvement in downstream metrics, particularly for tasks relying on intact sentence semantics or grammaticality.

Empirical Findings on LLM Rescoring

Application of LM rescoring to ASR hypotheses produces an absolute reduction in WER from 15.45% to 13.24% (-14.3%), with comparable reductions in dPOSER (-14.3%), LER (-15.8%), and EmbER (-12.5%). However, notable is the substantially smaller relative improvement in deep semantic metrics: SemDist improves by only -9.0% and BERTScore by -8.1%. This divergence demonstrates that rescoring impacts syntactic and morpholexical accuracy more strongly than broader semantic preservation.

A further analysis by POS reveals that interjections and conjunctions benefit most from rescoring, while numerals and determiners show negligible gains. This fine-grained breakdown highlights which grammatical structures are most affected by LM post-processing.

The authors assert that “the benefits obtained thanks to this rescoring step are not as significant as what the WER suggests,” especially for metrics linked to semantic fidelity. This challenges the sufficiency of WER-centric evaluation for ASR systems intended for downstream NLP tasks or human consumption.

Implications and Future Directions

The results advocate for a multi-metric evaluation approach when benchmarking ASR, particularly for applications where lexical, grammatical, or semantic integrity is paramount. The findings suggest that standard LM rescoring, even with advanced RNNLMs trained on matching corpora, yields marginal semantic gain beyond surface-level improvements. This implies a ceiling effect for n-gram and RNN-based LLMs in rectifying errors that require deep semantic understanding or contextual disambiguation.

The theoretical takeaway is that semantic-aware ASR evaluation and optimization require models and metrics capable of integrating and leveraging meaning at levels surpassing word sequences. Practically, developers should not interpret WER reductions as comprehensive evidence of end-to-end system quality.

For future research, the paper proposes combining metrics (e.g., semantic measures focused on specific POS classes), exploring the error profiles for speech segments with high spontaneity or disfluency, and correlating intrinsic automatic metrics with human perception. Such analysis could drive the community toward designing ASR systems and rescoring strategies attuned to language understanding, not just symbol sequence accuracy.

Conclusion

"Qualitative Evaluation of LLM Rescoring in Automatic Speech Recognition" (2604.27533) compellingly demonstrates the inadequacy of WER as a standalone measure for ASR evaluation, particularly in the context of LM-based rescoring. Through the introduction, adaptation, and systematic comparison of multiple linguistic metrics, the study delineates the nuanced impacts of rescoring, especially the limited gains in true semantic accuracy. These insights hold significant consequences for both the development and assessment of ASR systems, underscoring the necessity of evaluation regimes that reflect the full linguistic demands of end-user applications.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Collections

Sign up for free to add this paper to one or more collections.