LLM-Enabled Post-Correction

• LLM-enabled post-correction is a modular framework where large language models act as selective editors, refining initial outputs using auxiliary signals like confidence scores and retrieved evidence.
• Methodologies range from single-pass structured prompts to iterative feedback loops, achieving measurable gains such as 10-20% WER reduction in ASR and improved error resolution in code generation.
• Research emphasizes balancing correction with preservation of accurate content, highlighting trade-offs between overcorrection and undercorrection through calibrated uncertainty and rule-based constraints.

Searching arXiv for papers on LLM-enabled post-correction across ASR and related domains. LLM-enabled post-correction is a family of methods in which a LLM operates after a primary predictor has already produced an initial output, and then revises that output using auxiliary evidence about likely error locations, alternative candidates, external grounding, or downstream feedback. Recent work instantiates this pattern in automatic speech recognition, code generation, retrieval-augmented generation, speaker diarization, theorem proving, topic modeling, biomedical information extraction, and post-hoc forecasting, with the LLM functioning not as the first-pass model but as a corrective layer over an upstream system (Hernandez et al., 29 Sep 2025, Zhang et al., 16 Jun 2026, Li et al., 2024, Beddows et al., 12 May 2026).

1. Conceptual basis: correction, corruption, and selective editing

A recurring theme in the literature is that post-correction is not equivalent to unrestricted regeneration. In disordered-speech ASR, naive LLM correction can overcorrect already-accurate regions and increase WER, particularly under domain shift; in grammatical error correction, a related contrast appears as undercorrection in supervised small LLMs and overcorrection in larger generative models (Hernandez et al., 29 Sep 2025, Park et al., 25 Sep 2025). The practical problem is therefore dual: repair baseline failures while preserving correct content.

One explicit formalization models a post-correction step as a channel between baseline correctness $E_0 \in \{0,1\}$ and post-step correctness $E_1 \in \{0,1\}$. The correction rate is

$c := \Pr(E_1=1 \mid E_0=0),$

and the corruption rate is

$\gamma := \Pr(E_1=0 \mid E_0=1).$

If baseline accuracy is $p_0 := \Pr(E_0=1)$, then post-step accuracy satisfies

$p_1 = p_0 + (1-p_0)c - p_0\gamma,$

so the expected gain is

$\Delta A = (1-p_0)c - p_0\gamma.$

Improvement occurs only when

$c > \frac{p_0}{1-p_0}\gamma.$

This formulation makes explicit why high-baseline systems are fragile: as $p_0$ rises, even small corruption can offset meaningful correction (Reitich, 20 Apr 2026).

The same tension appears operationally in application-specific designs. Confidence-guided ASR correction tries to discourage edits to high-confidence words; rule-based multi-stage ASR correction restricts the LLM to N-best alternatives and forbids new words; PoCO deliberately induces overcorrection in a first stage and then trains a smaller model to undo erroneous edits in a second stage (Hernandez et al., 29 Sep 2025, Pu et al., 2023, Park et al., 25 Sep 2025). This suggests that modern post-correction systems are best viewed as selective editors rather than generic rewriters.

2. Recurrent architectural patterns

Across domains, the architecture usually has two parts: an upstream model that emits a baseline output, and a corrective component that consumes that output together with additional signals. The additional signals vary by task, but the overall pattern is stable: retrieval, confidence, alternative hypotheses, execution traces, or domain tools are exposed to the LLM so that correction is grounded rather than free-form (Yang et al., 8 Jun 2025, Zhang et al., 16 Jun 2026, Maheshwari et al., 22 Apr 2025, Zhong et al., 2024).

Domain	Upstream output	Corrective signal
Disordered-speech ASR	1-best transcript	Word-level confidence tags
N-best ASR correction	1-best and N-best hypotheses	Uncertainty gate, explicit rules
Code generation	Initial code attempt	Compiler/runtime/test feedback
RAG factual correction	Generated answer or citations	Retrieved evidence
Forecast refinement	Base numerical forecast	Phase, bias, range-validation tools

In speech recognition, one pattern is single-pass correction with structured prompts. Confidence-informed prompting embeds per-word scores inline as WORD[c], while video-guided correction extracts a show title and fine-grained scene description from a video-LLM and passes both to a text LLM for transcript refinement (Hernandez et al., 29 Sep 2025, Yang et al., 8 Jun 2025). A second pattern is selective routing: uncertainty estimation or filtering determines whether the LLM is invoked at all, so that stable utterances bypass correction (Pu et al., 2023).

In code generation, post-correction is typically iterative rather than one-shot. The loop alternates between generation, execution in an external evaluator, ingestion of compiler or testcase feedback, and revision, stopping at either success or a fixed iteration cap (Zhang et al., 16 Jun 2026). In theorem proving, Lyra separates tool correction, which swaps failing prover tactics with a curated portfolio, from conjecture correction, which re-prompts the model with prover error messages (Zheng et al., 2023).

A third pattern is post-generation grounding. RAC decomposes an answer into atomic facts, retrieves supporting documents, verifies facts when appropriate, corrects the unsupported ones, and rewrites the final answer. CiteFix segments an answer into factual points and reassigns citations by matching each point against retrieved documents using keyword overlap, semantic retrieval signals, BERTScore-style contextual similarity, a fine-tuned ranker, or a lightweight LLM judge (Li et al., 2024, Maheshwari et al., 22 Apr 2025).

Agentic post-hoc correction extends the pattern further by exposing tool use directly. In agricultural forecasting, the corrective module is a ReAct-style LLM agent that calls tools for phase detection, bias learning, range validation, trajectory evaluation, and safety verification before emitting a corrected forecast (Beddows et al., 12 May 2026).

3. Signals used to guide correction

The post-correction literature differs less in its end goal than in the signals it exposes to the corrective model. One major signal class is uncertainty. In disordered-speech recognition, word-level confidence is computed from frame-level posterior distributions using normalized Gibbs or Tsallis entropy, aggregated to words by mean, min, or product, and optionally to sentences by geometric mean. These scores are inserted directly into prompts and are intended to focus edits on low-confidence regions while preserving high-confidence content (Hernandez et al., 29 Sep 2025).

A second class is structured alternative evidence. Multi-stage ASR correction uses N-best lists, rescored by a combination of ASR and external LM scores, to decide which utterances should be sent to the LLM and to constrain the edits to words already present in the candidate set. Rare-word GER similarly conditions on N-best hypotheses, but supplements them with phonetic context, including a simplified phoneme representation called LSP, to reduce semantically plausible but phonetically inconsistent corrections (Pu et al., 2023, Yamashita et al., 23 May 2025).

A third class is multimodal or cross-hypothesis context. Video-guided ASR correction extracts two explicit context variables,

$$C_1 = \mathrm{VLMM}(V, P_1), \qquad C_2 = \mathrm{VLMM}(V, P_2),$$

where $E_1 \in \{0,1\}$0 requests TV show recognition and $E_1 \in \{0,1\}$1 requests a fine-grained video description; an LLM then performs

$E_1 \in \{0,1\}$2

For dysarthric speech, a Judge–Editor agent uses top-$E_1 \in \{0,1\}$3 ASR hypotheses and preserves spans with high cross-hypothesis agreement while rewriting uncertain regions (Yang et al., 8 Jun 2025, Zheng et al., 29 Jan 2026).

A fourth class is external environment feedback. In iterative code correction, the feedback channel includes compile errors, runtime traces, failing testcases, expected versus actual outputs, and TLE or MLE notices. In theorem proving, the environment returns raw Isabelle error messages. In both cases the LLM is not expected to infer failure modes from output text alone; it is explicitly conditioned on structured evidence from an evaluator (Zhang et al., 16 Jun 2026, Zheng et al., 2023).

Finally, some systems use rule-preserving or format-preserving signals. Speaker diarization correction enforces label-only edits by parsing LLM output and projecting predicted speaker labels back onto the original ASR tokens. In French biomedical NER, GLiNER predictions are injected as inline XML, and GPT-4.1 is asked to verify labels, boundaries, and omissions under a strict glossary and XML-validity regime (Efstathiadis et al., 2024, Belmadani et al., 3 Oct 2025).

4. Training regimes and inference strategies

Post-correction methods span a wide range of adaptation regimes. Some are entirely training-free. RAC treats the base LLM as a black box and uses prompting for fact extraction, verification, correction, and revision; RLLM-CF uses prompting only, with no fine-tuning, no N-best lists, and no external domain knowledge; LlmCorr wraps an arbitrary predictive model with retrieval and in-context prompting over validation-set behavior (Li et al., 2024, Fang et al., 30 May 2025, Zhong et al., 2024).

Other methods are training-light. Confidence-guided disordered-speech correction fine-tunes LLaMA 3.1 Instruct 8B with LoRA at rank $E_1 \in \{0,1\}$4 and scaling $E_1 \in \{0,1\}$5, updating approximately $E_1 \in \{0,1\}$6M parameters on $E_1 \in \{0,1\}$7k reference–hypothesis pairs. The dysarthric Judge–Editor agent uses LoRA with int8 quantization, updating less than $E_1 \in \{0,1\}$8 of parameters. Speaker diarization correction uses QLoRA to adapt Mistral-7B-Instruct separately for transcripts from AWS, Azure, and WhisperX, and then merges those experts with TIES-Merging (Hernandez et al., 29 Sep 2025, Zheng et al., 29 Jan 2026, Efstathiadis et al., 2024).

Some frameworks are explicitly zero-shot but highly constrained. Multi-stage ASR correction uses a single rule-based prompt that instructs the model to replace words only with N-best alternatives, preserve sentence structure and length, and avoid inventing words. Evolutionary prompt design treats prompt wording itself as the optimizable object and uses an LLM-driven genetic algorithm to search over prompts that minimize WER on a training set (Pu et al., 2023, Sachdev et al., 2024).

Inference strategies also vary. Deterministic decoding or low temperature is common when preserving fidelity is essential, as in dysarthric post-ASR correction and ASR N-best correction. By contrast, iterative code correction increases temperature and tunes top-$E_1 \in \{0,1\}$9 to encourage exploration across attempts; a calibration on DeepSeek-R1 found $c := \Pr(E_1=1 \mid E_0=0),$0 and top-$c := \Pr(E_1=1 \mid E_0=0),$1 best for ISR@10 on a subset (Zheng et al., 29 Jan 2026, Pu et al., 2023, Zhang et al., 16 Jun 2026). Inference-time control therefore serves different ends in different domains: conservatism in fidelity-critical settings, and search diversity in multi-attempt refinement.

5. Empirical performance across domains

Speech recognition is the most extensively studied application area. Confidence-informed prompting for disordered speech achieved a 10% relative WER reduction compared to naive LLM correction on SAP spontaneous speech and a 47% relative reduction on TORGO; on SAP-shared and SAP-unshared subsets, the reported WER changes include 15.64% to 4.95% and 9.94% to 9.47% for Parakeet hypotheses, and 13.10% to 4.19% and 18.00% to 17.72% for Whisper hypotheses (Hernandez et al., 29 Sep 2025). Multi-stage LLM correction with uncertainty gating and rule-based prompting reported 10%–20% relative WER improvement across multiple domains in zero-shot settings, including LibriSpeech clean from 2.8 to 2.1 and Common Voice from 15.3 to 13.4 in one configuration (Pu et al., 2023). Video-guided post-correction on TV series reduced WER across wav2vec 2.0, HuBERT, and WavLM baselines, with the largest reported gain on unfine-tuned WavLM, 45.5 to 35.4 (Yang et al., 8 Jun 2025). Rare-word GER with synthetic data and phonetic context improved both English WER and Japanese CER, including LibriSpeech 2.7 to 2.5 and MedTxt 18.8 to 7.8 for ChatGPT-4o-mini with N-best plus LSP (Yamashita et al., 23 May 2025). RLLM-CF reported relative reductions of 21% on AISHELL-1 CER, 11% on AISHELL-2 CER, 9% on LibriSpeech clean WER, and 11.4% on LibriSpeech other WER, while direct LLM correction without the framework could increase CER catastrophically (Fang et al., 30 May 2025). The dysarthric Judge–Editor framework reported a 14.51% overall WER reduction, alongside +7.59 pp MENLI and +7.66 pp Slot Micro F1 on challenging samples, explicitly showing cases where semantic metrics improved even when WER did not (Zheng et al., 29 Jan 2026).

Beyond ASR, code generation work has emphasized iterative repair rather than single-pass editing. The feedback-loop framework over LeetCode problems introduced pass@1, ISR@k, and MIS, and showed that reasoning models improve steadily over iterations while non-reasoning models plateau early. Error-type analysis found syntactic and runtime failures more tractable than logical or algorithmic failures: in Python, runtime errors were fixed 82.8% of the time, whereas Wrong Answer and TLE errors were fixed 33.6% and 18.6%; in Java, Compile Error was fixed 88.2% of the time, but TLE only 21.4% (Zhang et al., 16 Jun 2026).

Grounded factual correction and citation repair also show measurable gains. RAC reported up to 30% improvements over prior baselines across TruthfulQA and Biography settings, while maintaining much lower latency than iterative alternatives. CiteFix reported a 15.46% relative improvement in overall RAG accuracy metrics and argued that this gain could enable a shift to a model approximately 12x more cost-effective and 3x faster while maintaining comparable performance (Li et al., 2024, Maheshwari et al., 22 Apr 2025).

Other domains exhibit the same corrective pattern with domain-specific metrics. In topic modeling, LLM-enabled post-correction improved topic coherence by 5.86% by removing semantically incoherent words from LDA topic lists (Hong et al., 11 Jul 2025). In agricultural forecasting, LLM-agent refinement of XGBoost on strawberry reduced MAE by 20% and MASE by 56%, with corresponding gains also reported for Moirai2 and Random Forest; on the public USDA corn dataset, improvements were smaller for some baselines but still consistent for the strongest agent configuration (Beddows et al., 12 May 2026). LlmCorr, which uses retrieval over labeled train and validation examples plus the model’s own validation predictions, reported improvements of up to 39% on molecular prediction tasks (Zhong et al., 2024).

6. Limitations, failure regimes, and open directions

Overcorrection, hallucination, and domain shift remain the dominant failure modes. In impaired-speech ASR, confidence can become uniformly low under extremely low intelligibility, making the LLM prone to hallucination; confidence calibration itself requires tuning of entropy family, entropic index, and aggregation strategy (Hernandez et al., 29 Sep 2025). In diarization correction, zero-shot LLMs substantially worsened deltaCP and deltaSA, and ASR-specific fine-tuning generalized poorly across ASR systems, motivating weight-level expert merging rather than a single universal model (Efstathiadis et al., 2024).

A deeper limitation is that decodability does not imply correctability. Work on medical QA showed that an Overthinking failure regime is linearly decodable from hidden states, yet five families of fixed linear residual-stream steering across 29 configurations yielded $c := \Pr(E_1=1 \mid E_0=0),$2 or harmed accuracy. The same paper reported 85–88% overlap between the Overthinking direction and task-critical computation, negative effects from shared-direction steering, and accuracy damage from concept erasure, while still obtaining useful post-generation reliability estimation via abstention (Liu, 7 May 2026). A plausible implication is that some post-correction problems are fundamentally routing problems rather than direct editing problems: a signal may be strong enough to trigger abstention, resampling, or external verification, but not separable enough to support a simple corrective intervention.

Evaluation itself is another open issue. Several papers argue that end-to-end delta metrics alone obscure when a protocol helps and when it hurts. The two-rate interface explicitly isolates correction and corruption; dysarthric-speech work argues that WER is highly sensitive to domain shift and that semantic metrics correlate better with downstream SLU; code-correction work introduces ISR@k and MIS because pass@1 misses the iterative nature of real debugging (Reitich, 20 Apr 2026, Zheng et al., 29 Jan 2026, Zhang et al., 16 Jun 2026). This suggests that post-correction systems are likely to be assessed increasingly as auditable modules with explicit activation policies, transfer diagnostics, and corruption accounting.

Open directions named in the literature are concrete rather than speculative. Speech work proposes diarization, lip-reading, dynamic lexical constraints, multilingual expansion, and larger-context retrieval across episodes; dysarthric-speech work proposes stronger zero-shot self-check mechanisms and human-centric evaluation; protocol-auditing work proposes conditioning on difficulty proxies and richer state when correctness bits do not compose; forecasting work proposes learned orchestration and calibrated uncertainty after correction (Yang et al., 8 Jun 2025, Zheng et al., 29 Jan 2026, Reitich, 20 Apr 2026, Beddows et al., 12 May 2026). Taken together, these directions point toward a broader interpretation of LLM-enabled post-correction: not a single algorithmic recipe, but a modular design space in which correction quality depends on how well the LLM is coupled to evidence, constraints, and decision policies that preserve already-correct structure while targeting the residual error modes of the upstream system.