Energy-Based Decoding

• Energy-based decoding is a family of techniques that integrates energy functions into the candidate generation and full-sequence inference process.
• In neural text generation, methods like COLD and EBD replace traditional left-to-right token selection with global optimization using Langevin dynamics and Metropolis–Hastings sampling.
• Applications span LVLM layer selection, video codec rate-energy-distortion optimization, and physical energy measurement in hardware, highlighting practical trade-offs in performance and efficiency.

Searching arXiv for recent and foundational papers on energy-based decoding across text generation, LVLMs, and codec/system interpretations. arXiv_search.query({"^^^^^^^^5search_query5 Decoding\"^^^^^^^^5 OR ti:\5^^^^^^^^"COLD Decoding\"^^^^^^^^5 OR ti:\5^^^^^^^^"Energy-Guided Decoding\"^^^^^^^^5 OR ti:\5^^^^^^^^"Decoding-Energy-Rate-Distortion\"","max_results":^^^^5all:\5search_query5 Energy-based decoding is a family of decoding-time methods in which an energy quantity influences candidate generation, selection, or refinement. In contemporary research, the term is used in several technically distinct ways. In neural text generation, it often denotes a scalar defined over complete sequences, so decoding becomes approximate inference in an energy-based model rather than left-to-right token choice; representative formulations include PRESERVED_PLACEHOLDER_^^^^5search_query5^^^^ and PRESERVED_PLACEHOLDER_^^^^5all:\5^^^^ (&&&^^^^5search_query5^^^^&&&, &&&^^^^5all:\5^^^^&&&). In large vision-LLMs, it can denote a per-layer logit score PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5^^^^ used to choose the layer from which the next token is decoded (&&&^^^^5 OR ti:\5^^^^&&&). In video coding and systems work, the same phrase instead refers to minimizing the physical energy required by the decoder, for example through objectives such as PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5^^^^ or by comparing the GPU energy of alternative decoding policies (&&&^^^^5 OR ti:\5^^^^&&&, &&&^^^^5 OR ti:\5^^^^&&&). In communication-theoretic and VLSI analyses, it refers even more literally to the physical energy of iterative decoders and decoder circuits (Rehman et al., 2013, Blake et al., 2014).

^^^^5all:\5^^^^. Terminological scope and recurrent structures

Across the cited literature, “energy-based decoding” does not identify a single formalism. It names several practices in which a scalar energy, or a measured/estimated physical energy, becomes part of the decoding rule. The commonality is not the mathematical form alone, but the relocation of decoding away from pure local likelihood maximization toward a broader optimization or inference problem.

Usage in the literature	Energy quantity	Representative papers
Sequence-level neural decoding	Global sequence energy or reward-tilted energy	(&&&^^^^5search_query5^^^^&&&, &&&^^^^5all:\5^^^^&&&)
LVLM layer selection	Per-layer logit energy PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5^^^^	(&&&^^^^5 OR ti:\5^^^^&&&)
Video codec optimization	Predicted decoder processing energy	(&&&^^^^5 OR ti:\5^^^^&&&, &&&^^^^5all:\5all:\5^^^^&&&, &&&^^^^5all:\5 OR ti:\5^^^^&&&, &&&^^^^5all:\5 OR ti:\5^^^^&&&)
Systems and hardware studies	Measured GPU energy, iterative decoding energy, or VLSI area-time energy	(&&&^^^^5 OR ti:\5^^^^&&&, Rehman et al., 2013, Blake et al., 2014)

This terminological breadth matters because superficially similar language can refer to very different decoded objects. In COLD and EBD, the decoded object is a full text response or a relaxed soft-token sequence; in the LVLM setting, the decoded object remains the next token, but the decoding layer changes dynamically; in codec papers, the immediate decision variable is often an encoder-side mode or tool choice chosen to reduce downstream decoder energy; and in hardware theory, the object of study is the physical energy required to perform decoding at all (&&&^^^^5search_query5^^^^&&&, &&&^^^^5 OR ti:\5^^^^&&&, Blake et al., 2014).

^^^^5 OR ti:\5^^^^. Sequence-level energy models in text generation

A canonical sequence-level formulation appears in COLD decoding, which casts constrained text generation as inference in an energy-based model over whole sequences rather than as left-to-right token selection. Constraint scores $f_i(\mathbf{y})\in\mathbb{R}$ are combined into

$$p(\mathbf{y})=\exp\left\{\sum_i \lambda_i f_i(\mathbf{y})\right\}/Z, \qquad E(\mathbf{y})=-\sum_i \lambda_i f_i(\mathbf{y}),$$

with nonnegative weights $\lambda_i\ge 0$. Because text is discrete, COLD relaxes each token position into a logit vector $\tilde{\mathbf{y}}_t\in\mathbb{R}^V$, forms soft tokens with temperature-scaled softmax, and performs Langevin dynamics over the full relaxed sequence: $$\tilde{\mathbf{y}}^{(n+1)}\leftarrow \tilde{\mathbf{y}}^{(n)}-\eta \nabla_{\tilde{\mathbf{y}}}E(\tilde{\mathbf{y}}^{(n)})+\epsilon^{(n)}, \qquad \epsilon^{(n)}\sim \mathcal N(0,\sigma^{(n)}).$$ The framework uses a left-to-right LM fluency term, can optionally add a reverse-LM term, and instantiates additional differentiable energies such as future-token prediction and differentiable PRESERVED_PLACEHOLDER_^^^^5all:\5search_query5^^^^-gram similarity. It is applied without task-specific fine-tuning to lexically constrained generation, abductive reasoning, and counterfactual reasoning. The reported procedure initializes from greedy LM decoding logits, typically uses PRESERVED_PLACEHOLDER_^^^^5all:\5all:\5^^^^ and PRESERVED_PLACEHOLDER_^^^^5all:\5 OR ti:\5^^^^, anneals PRESERVED_PLACEHOLDER_^^^^5all:\5 OR ti:\5^^^^ through PRESERVED_PLACEHOLDER_^^^^5all:\5 OR ti:\5^^^^ at iterations PRESERVED_PLACEHOLDER_^^^^5all:\55^^^^, and finally discretizes with an LM-guided top-PRESERVED_PLACEHOLDER_^^^^5all:\5^^^^6 “guardian” rule rather than naive argmax. Empirically, the method outperforms DeLorean and left-only LM baselines on abductive reasoning, improves coherence over DeLorean on counterfactual rewriting, significantly outperforms Mix-and-Match, and achieves higher keyword coverage than NeuroLogic, while exhibiting a recurring fluency–constraint tradeoff; runtime is reported as about PRESERVED_PLACEHOLDER_^^^^5all:\5^^^^7 seconds per sample with GPT^^^^5 OR ti:\5^^^^-XL and PRESERVED_PLACEHOLDER_^^^^5all:\5^^^^8 seconds with GPT^^^^5 OR ti:\5^^^^-M on counterfactual rewriting (&&&^^^^5search_query5^^^^&&&).

A later sequence-level variant, explicitly titled Energy-Based Decoding, replaces soft-token Langevin refinement with reward-guided posterior sampling over complete responses from frozen base LLMs. EBD begins from the KL-regularized objective

PRESERVED_PLACEHOLDER_^^^^5all:\5^^^^9

whose optimizer is the reward-tilted target

PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5search_query5^^^^

In energy form,

PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5all:\5^^^^

The implementation uses a prompt-normalized standardized advantage

PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5 OR ti:\5^^^^

initializes from a small pool of prior samples, and refines responses with a short block-wise Metropolis–Hastings chain that preserves a prefix, regenerates a suffix from the matched conditional prior, and accepts proposals with

PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5 OR ti:\5^^^^

Because the proposal matches the conditional prior, proposal and prior terms cancel in the MH ratio. Default settings are PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5 OR ti:\5^^^^, PRESERVED_PLACEHOLDER_^^^^5 OR ti:\55^^^^, PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5^^^^6, PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5^^^^7, PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5^^^^8, and PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5^^^^9. On five base models and six benchmarks, EBD improves both objective and subjective evaluations relative to direct decoding and Power Sampling; the abstract highlights Qwen^^^^5 OR ti:\5^^^^-8B-Base on AlpacaEval^^^^5 OR ti:\5^^^^.^^^^5search_query5^^^^ from PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5search_query5^^^^ to PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5all:\5^^^^, an PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5 OR ti:\5^^^^ Math5^^^^5search_query5search_query5^^^^ latency reduction for Mistral-7B relative to prior decoding work, and robustness to reward-model size from PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5 OR ti:\5^^^^B to PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5 OR ti:\5^^^^B (&&&^^^^5all:\5^^^^&&&).

Taken together, these two frameworks show two distinct sequence-level regimes. COLD performs approximate sampling in a continuous relaxation of text with Langevin dynamics. EBD keeps text discrete and instead samples from a reward-tilted posterior with matched block-wise MH proposals. Both reject the assumption that decoding should be identical to ancestral next-token selection, but they do so with markedly different inference mechanisms (&&&^^^^5search_query5^^^^&&&, &&&^^^^5all:\5^^^^&&&).

^^^^5 OR ti:\5^^^^. Energy-guided layer selection in vision-language decoding

In large vision-LLMs, energy-guided decoding is neither an EBM over full responses nor an optimization over physical power. The method introduced for object hallucination mitigation inspects hidden states from all decoder layers at each generation step, projects each layer’s last-position hidden state through the existing LM head, and computes the energy score

PRESERVED_PLACEHOLDER_^^^^5 OR ti:\55^^^^

The chosen layer is

PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5^^^^6

and decoding then proceeds from PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5^^^^7. The method is hyperparameter-free in the energy definition, requires no retraining, no finetuning, no extra model, no visual perturbation, no prompt tuning, and no contrastive pair of distributions. It is evaluated on LLaVA-^^^^5all:\5^^^^.5, InstructBLIP, and mPLUG-Owl^^^^5 OR ti:\5^^^^ across POPE, MME, MMVP, and CHAIR, with a maximum of ^^^^5all:\5^^^^6 new tokens for yes/no evaluations and temperature PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5^^^^8 (&&&^^^^5 OR ti:\5^^^^&&&).

The motivating observation is a strong “Yes”-ratio imbalance in balanced yes/no VQA datasets. The paper argues that ordinary final-layer decoding often over-predicts “Yes,” partly due to language-prior transfer, and that the final layer is not always the most reliable source for the next-token distribution. Selecting the minimum-energy layer is presented as a way to reduce that bias and improve calibration. Empirically, the abstract reports an average accuracy improvement of PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5^^^^9 over greedy decoding and an average yes-ratio gap reduction of PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5search_query5^^^^. The detailed tables show especially large gains on harder POPE settings such as LLaVA-^^^^5all:\5^^^^.5 on GQA adversarial, where accuracy rises from PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5all:\5^^^^ to PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5 OR ti:\5^^^^, F^^^^5all:\5^^^^ from PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5 OR ti:\5^^^^ to PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5 OR ti:\5^^^^, and PRESERVED_PLACEHOLDER_^^^^5 OR ti:\55^^^^ drops from PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5^^^^6 to PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5^^^^7. On MME, LLaVA-^^^^5all:\5^^^^.5 improves from PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5^^^^8 to PRESERVED_PLACEHOLDER_^^^^5 OR ti:\5^^^^9, and on MMVP the method substantially reduces yes-ratio bias, although F^^^^5all:\5^^^^ changes are sometimes small. The layer-wise analysis indicates that the selected hidden states mostly come from the second-last layer, and the penultimate layer often has the lowest energy (&&&^^^^5 OR ti:\5^^^^&&&).

The method is not uniformly dominant in every condition. Some easier MSCOCO POPE settings do not improve on every metric, and in open-ended captioning the method gives the best CHAIR$f_i(\mathbf{y})\in\mathbb{R}$^^^^5search_query5^^^^ but worse CHAIR$f_i(\mathbf{y})\in\mathbb{R}$^^^^5all:\5^^^^; for LLaVA-^^^^5all:\5^^^^.5, CHAIR$f_i(\mathbf{y})\in\mathbb{R}$^^^^5 OR ti:\5^^^^ changes from $f_i(\mathbf{y})\in\mathbb{R}$^^^^5 OR ti:\5^^^^ to $f_i(\mathbf{y})\in\mathbb{R}$^^^^5 OR ti:\5^^^^ while CHAIR$f_i(\mathbf{y})\in\mathbb{R}$5 changes from $f_i(\mathbf{y})\in\mathbb{R}$6 to $f_i(\mathbf{y})\in\mathbb{R}$7. This establishes a narrower but precise meaning of energy-guided decoding: a layer-selection rule defined by log-sum-exp over vocabulary logits, used chiefly as a reliability and calibration signal during autoregressive decoding (&&&^^^^5 OR ti:\5^^^^&&&).

^^^^5 OR ti:\5^^^^. Decoder-energy-rate-distortion optimization in video coding

In video coding, energy-based decoding refers primarily to decoder-energy-aware encoding. The foundational DERDO formulation extends classical rate-distortion optimization by treating decoder processing energy as a first-class objective. Over feasible encoding solutions $f_i(\mathbf{y})\in\mathbb{R}$8, the constrained problem is

$f_i(\mathbf{y})\in\mathbb{R}$9

with Lagrangian relaxation

$$p(\mathbf{y})=\exp\left\{\sum_i \lambda_i f_i(\mathbf{y})\right\}/Z, \qquad E(\mathbf{y})=-\sum_i \lambda_i f_i(\mathbf{y}),$$^^^^5search_query5^^^^

A central practical contribution is the encoder-side parameter $$p(\mathbf{y})=\exp\left\{\sum_i \lambda_i f_i(\mathbf{y})\right\}/Z, \qquad E(\mathbf{y})=-\sum_i \lambda_i f_i(\mathbf{y}),$$^^^^5all:\5^^^^, which continuously shifts operation from pure RDO $$p(\mathbf{y})=\exp\left\{\sum_i \lambda_i f_i(\mathbf{y})\right\}/Z, \qquad E(\mathbf{y})=-\sum_i \lambda_i f_i(\mathbf{y}),$$^^^^5 OR ti:\5^^^^ toward pure decoding-energy optimization $$p(\mathbf{y})=\exp\left\{\sum_i \lambda_i f_i(\mathbf{y})\right\}/Z, \qquad E(\mathbf{y})=-\sum_i \lambda_i f_i(\mathbf{y}),$$^^^^5 OR ti:\5^^^^. The paper integrates this objective into a modified HM-^^^^5all:\5 OR ti:\5^^^^.^^^^5search_query5^^^^ HEVC encoder using a ^^^^5 OR ti:\5^^^^7-feature bitstream model trained on FFmpeg measurements, and validates the two-multiplier QP relation

$$p(\mathbf{y})=\exp\left\{\sum_i \lambda_i f_i(\mathbf{y})\right\}/Z, \qquad E(\mathbf{y})=-\sum_i \lambda_i f_i(\mathbf{y}),$$^^^^5 OR ti:\5^^^^

Measured on a Pandaboard with FFmpeg ^^^^5 OR ti:\5^^^^.8, libde^^^^5 OR ti:\5^^^^65 ^^^^5search_query5^^^^.7, and HM-^^^^5all:\5 OR ti:\5^^^^.^^^^5search_query5^^^^, the method yields up to about $$p(\mathbf{y})=\exp\left\{\sum_i \lambda_i f_i(\mathbf{y})\right\}/Z, \qquad E(\mathbf{y})=-\sum_i \lambda_i f_i(\mathbf{y}),$$5 measured decoder energy reduction at equal objective quality, with bitrate increase of similar order; the paper reports, for example, class-averaged FFmpeg results at $$p(\mathbf{y})=\exp\left\{\sum_i \lambda_i f_i(\mathbf{y})\right\}/Z, \qquad E(\mathbf{y})=-\sum_i \lambda_i f_i(\mathbf{y}),$$6 of about $$p(\mathbf{y})=\exp\left\{\sum_i \lambda_i f_i(\mathbf{y})\right\}/Z, \qquad E(\mathbf{y})=-\sum_i \lambda_i f_i(\mathbf{y}),$$7–$$p(\mathbf{y})=\exp\left\{\sum_i \lambda_i f_i(\mathbf{y})\right\}/Z, \qquad E(\mathbf{y})=-\sum_i \lambda_i f_i(\mathbf{y}),$$8 BDDE with only $$p(\mathbf{y})=\exp\left\{\sum_i \lambda_i f_i(\mathbf{y})\right\}/Z, \qquad E(\mathbf{y})=-\sum_i \lambda_i f_i(\mathbf{y}),$$9–$\lambda_i\ge 0$^^^^5search_query5^^^^ BDR increase, and at $\lambda_i\ge 0$^^^^5all:\5^^^^ about $\lambda_i\ge 0$^^^^5 OR ti:\5^^^^–λi≥0\lambda_i\ge 0^^^^5 OR ti:\5^^^^ BDDE with $\lambda_i\ge 0$^^^^5 OR ti:\5^^^^–λi≥0\lambda_i\ge 05 BDR penalties (&&&^^^^5 OR ti:\5^^^^&&&).

Such optimization depends on accurate energy estimation. A closely related line of work models video decoding energy directly from bitstream features using

$\lambda_i\ge 0$6

For HEVC, H.^^^^5 OR ti:\5max_results5 OR ti:\5^^^^, H.^^^^5 OR ti:\5max_results5 OR ti:\5^^^^, and VP9, fewer than ^^^^5 OR ti:\5search_query5^^^^ features suffice: $\lambda_i\ge 0$7 for H.^^^^5 OR ti:\5max_results5 OR ti:\5^^^^, $\lambda_i\ge 0$8 for H.^^^^5 OR ti:\5max_results5 OR ti:\5^^^^, and $\lambda_i\ge 0$9 for HEVC and VP9. Using ^^^^5all:\5search_query5^^^^-fold cross-validation and external measurements with a ZES Zimmer LMG95 on a Pandaboard, mean relative estimation errors on FFmpeg are $\tilde{\mathbf{y}}_t\in\mathbb{R}^V$^^^^5search_query5^^^^ for HEVC, $\tilde{\mathbf{y}}_t\in\mathbb{R}^V$^^^^5all:\5^^^^ for H.^^^^5 OR ti:\5max_results5 OR ti:\5^^^^, $\tilde{\mathbf{y}}_t\in\mathbb{R}^V$^^^^5 OR ti:\5^^^^ for H.^^^^5 OR ti:\5max_results5 OR ti:\5^^^^, and $\tilde{\mathbf{y}}_t\in\mathbb{R}^V$^^^^5 OR ti:\5^^^^ for VP9; on alternative implementations the method reaches $\tilde{\mathbf{y}}_t\in\mathbb{R}^V$^^^^5 OR ti:\5^^^^ for HEVC on libde^^^^5 OR ti:\5^^^^65, $\tilde{\mathbf{y}}_t\in\mathbb{R}^V$5 for H.^^^^5 OR ti:\5max_results5 OR ti:\5^^^^ on TMN-^^^^5 OR ti:\5^^^^.^^^^5search_query5^^^^, and $\tilde{\mathbf{y}}_t\in\mathbb{R}^V$6 for a hardware-accelerated H.^^^^5 OR ti:\5max_results5 OR ti:\5^^^^ decoder. The paper uses these results to support rate-distortion-energy analysis before playback rather than to define a decoder-side probabilistic energy (&&&^^^^5all:\5 OR ti:\5^^^^&&&).

For VVC, the same modeling philosophy is extended with richer feature sets. The paper on VVC decoding-energy modeling emphasizes that VVC random-access decoding energy increases by over $\tilde{\mathbf{y}}_t\in\mathbb{R}^V$7 on average relative to HEVC and proposes two feature-based models, FVS with 67 features and FV with ^^^^5 OR ti:\5 OR ti:\5search_query5^^^^ features, both learned by trust-region-reflective least squares from VTM-7.^^^^5search_query5^^^^ measurements on an Intel i7-87^^^^5search_query5search_query5^^^^ using RAPL. With ^^^^5all:\5search_query5^^^^-fold cross-validation, FV achieves $\tilde{\mathbf{y}}_t\in\mathbb{R}^V$8 mean relative estimation error on the merged dataset, which the paper frames as sufficiently accurate for subsequent DERDO-style optimization (&&&^^^^5all:\5all:\5^^^^&&&).

A more deployment-oriented VVC study moves from modeling to practical coding-tool profiles in VVenC ^^^^5all:\5^^^^.^^^^5 OR ti:\5^^^^.^^^^5all:\5^^^^ and VVdeC ^^^^5all:\5^^^^.^^^^5 OR ti:\5^^^^.^^^^5search_query5^^^^. Starting from an aggressive Energy Efficient profile and then selectively restoring tools such as restricted ALF/CCALF, deeper partitioning, affine/PROF, and LMChroma, it defines two recommended profiles. The bitrate-efficient profile v^^^^5 OR ti:\55^^^^68 achieves JVET CTC averages of $\tilde{\mathbf{y}}_t\in\mathbb{R}^V$9 and $$\tilde{\mathbf{y}}^{(n+1)}\leftarrow \tilde{\mathbf{y}}^{(n)}-\eta \nabla_{\tilde{\mathbf{y}}}E(\tilde{\mathbf{y}}^{(n)})+\epsilon^{(n)}, \qquad \epsilon^{(n)}\sim \mathcal N(0,\sigma^{(n)}).$$^^^^5search_query5^^^^, matching the abstract’s statement of over $$\tilde{\mathbf{y}}^{(n+1)}\leftarrow \tilde{\mathbf{y}}^{(n)}-\eta \nabla_{\tilde{\mathbf{y}}}E(\tilde{\mathbf{y}}^{(n)})+\epsilon^{(n)}, \qquad \epsilon^{(n)}\sim \mathcal N(0,\sigma^{(n)}).$$^^^^5all:\5^^^^ energy-efficiency improvement with bitrate increase below $$\tilde{\mathbf{y}}^{(n+1)}\leftarrow \tilde{\mathbf{y}}^{(n)}-\eta \nabla_{\tilde{\mathbf{y}}}E(\tilde{\mathbf{y}}^{(n)})+\epsilon^{(n)}, \qquad \epsilon^{(n)}\sim \mathcal N(0,\sigma^{(n)}).$$^^^^5 OR ti:\5^^^^. The more aggressive profile v58 achieves $$\tilde{\mathbf{y}}^{(n+1)}\leftarrow \tilde{\mathbf{y}}^{(n)}-\eta \nabla_{\tilde{\mathbf{y}}}E(\tilde{\mathbf{y}}^{(n)})+\epsilon^{(n)}, \qquad \epsilon^{(n)}\sim \mathcal N(0,\sigma^{(n)}).$$^^^^5 OR ti:\5^^^^ and $$\tilde{\mathbf{y}}^{(n+1)}\leftarrow \tilde{\mathbf{y}}^{(n)}-\eta \nabla_{\tilde{\mathbf{y}}}E(\tilde{\mathbf{y}}^{(n)})+\epsilon^{(n)}, \qquad \epsilon^{(n)}\sim \mathcal N(0,\sigma^{(n)}).$$^^^^5 OR ti:\5^^^^, corresponding to $$\tilde{\mathbf{y}}^{(n+1)}\leftarrow \tilde{\mathbf{y}}^{(n)}-\eta \nabla_{\tilde{\mathbf{y}}}E(\tilde{\mathbf{y}}^{(n)})+\epsilon^{(n)}, \qquad \epsilon^{(n)}\sim \mathcal N(0,\sigma^{(n)}).$$5 energy savings at bitrate increases below $$\tilde{\mathbf{y}}^{(n+1)}\leftarrow \tilde{\mathbf{y}}^{(n)}-\eta \nabla_{\tilde{\mathbf{y}}}E(\tilde{\mathbf{y}}^{(n)})+\epsilon^{(n)}, \qquad \epsilon^{(n)}\sim \mathcal N(0,\sigma^{(n)}).$$6. Here again, the “energy-based” component is chiefly encoder-side control of decoder-expensive syntax and tools rather than a decoder-side inference rule (&&&^^^^5all:\5 OR ti:\5^^^^&&&).

5. Physical energy of decoding strategies and decoder circuits

A systems-oriented interpretation appears in work on GPU energy consumption during LLM inference. This literature is explicit that it is not about energy-based models, but about the physical energy implications of decoding choices. A comparative study on Qwen^^^^5 OR ti:\5^^^^.5-7B-Instruct evaluates ^^^^5all:\5 OR ti:\5^^^^ strategies—greedy, beam search, diverse beam search, contrastive search, DoLa, assisted decoding, temperature sampling, top-$$\tilde{\mathbf{y}}^{(n+1)}\leftarrow \tilde{\mathbf{y}}^{(n)}-\eta \nabla_{\tilde{\mathbf{y}}}E(\tilde{\mathbf{y}}^{(n)})+\epsilon^{(n)}, \qquad \epsilon^{(n)}\sim \mathcal N(0,\sigma^{(n)}).$$7, top-$$\tilde{\mathbf{y}}^{(n+1)}\leftarrow \tilde{\mathbf{y}}^{(n)}-\eta \nabla_{\tilde{\mathbf{y}}}E(\tilde{\mathbf{y}}^{(n)})+\epsilon^{(n)}, \qquad \epsilon^{(n)}\sim \mathcal N(0,\sigma^{(n)}).$$8, epsilon, typical, and min-$$\tilde{\mathbf{y}}^{(n+1)}\leftarrow \tilde{\mathbf{y}}^{(n)}-\eta \nabla_{\tilde{\mathbf{y}}}E(\tilde{\mathbf{y}}^{(n)})+\epsilon^{(n)}, \qquad \epsilon^{(n)}\sim \mathcal N(0,\sigma^{(n)}).$$9—over WMT^^^^5all:\5^^^^6 translation, CodeXGLUE code summarization, and GSM8K, measuring GPU energy with PRESERVED_PLACEHOLDER_^^^^5all:\5search_query5search_query5^^^^ from PRESERVED_PLACEHOLDER_^^^^5all:\5search_query5all:\5^^^^ s nvidia-smi samples. It reports that decoding choice often changes energy much more than it changes task quality, that beam and DBS typically improve metrics at substantial energy cost, that contrastive search can be quality-optimal but very energy-expensive, and that assisted decoding often yields the best efficiency ratio PRESERVED_PLACEHOLDER_^^^^5all:\5search_query5 OR ti:\5^^^^. On GermanPRESERVED_PLACEHOLDER_^^^^5all:\5search_query5 OR ti:\5^^^^English, for example, beam search reaches BLEU PRESERVED_PLACEHOLDER_^^^^5all:\5search_query5 OR ti:\5^^^^ at PRESERVED_PLACEHOLDER_^^^^5all:\5search_query55^^^^ Wh, while assisted decoding reaches BLEU PRESERVED_PLACEHOLDER_^^^^5all:\5search_query5^^^^6 at PRESERVED_PLACEHOLDER_^^^^5all:\5search_query5^^^^7 Wh and the best ER PRESERVED_PLACEHOLDER_^^^^5all:\5search_query5^^^^8; on GSM8K, beam reaches PRESERVED_PLACEHOLDER_^^^^5all:\5search_query5^^^^9 exact match at PRESERVED_PLACEHOLDER_^^^^5all:\5all:\5search_query5^^^^ Wh, whereas assisted decoding reaches PRESERVED_PLACEHOLDER_^^^^5all:\5all:\5all:\5^^^^ at PRESERVED_PLACEHOLDER_^^^^5all:\5all:\5 OR ti:\5^^^^ Wh and the best ER PRESERVED_PLACEHOLDER_^^^^5all:\5all:\5 OR ti:\5^^^^ (&&&^^^^5 OR ti:\5^^^^&&&).

Communication and coding theory use the term even more literally. In Wireless Body Area Sensor Networks, iterative LDPC decoding is analyzed from the viewpoint that decoder energy can exceed transmit energy on short links. The paper models decoder energy as increasing linearly with the number of computational nodes and iterations, lower bounded by

PRESERVED_PLACEHOLDER_^^^^5all:\5all:\5 OR ti:\5^^^^

and proposes Adaptive Iterative Decoding, an early-stopping rule that halts once a BER target of PRESERVED_PLACEHOLDER_^^^^5all:\5all:\55^^^^ is reached. At PRESERVED_PLACEHOLDER_^^^^5all:\5all:\5^^^^6 dB, the required iteration counts are PRESERVED_PLACEHOLDER_^^^^5all:\5all:\5^^^^7 for PRESERVED_PLACEHOLDER_^^^^5all:\5all:\5^^^^8 and PRESERVED_PLACEHOLDER_^^^^5all:\5all:\5^^^^9 for PRESERVED_PLACEHOLDER_^^^^5all:\5 OR ti:\5search_query5^^^^; compared with a 5^^^^5search_query5^^^^-iteration baseline, the paper reports total energy reduction of PRESERVED_PLACEHOLDER_^^^^5all:\5 OR ti:\5all:\5^^^^–PRESERVED_PLACEHOLDER_^^^^5all:\5 OR ti:\5 OR ti:\5^^^^ and gives an example in which energy drops from about PRESERVED_PLACEHOLDER_^^^^5all:\5 OR ti:\5 OR ti:\5^^^^ J to about PRESERVED_PLACEHOLDER_^^^^5all:\5 OR ti:\5 OR ti:\5^^^^ J (Rehman et al., 2013).

A different communication-theoretic usage appears in bit-interleaved coded energy-based modulation with iterative decoding. There, “energy-based” refers to modulation symbols whose information is carried in energy levels under non-coherent reception, and the decoding problem is solved with an iterative BICM-ID-style receiver. The central non-coherent likelihood is

PRESERVED_PLACEHOLDER_^^^^5all:\5 OR ti:\55^^^^

and the paper derives FF and EFF pairwise-error bounds, shows that nearest neighbors differ from the coherent BICM-ID case, and proves that the mapping from bits to energy levels influences diversity order and coding gain (&&&^^^^5 OR ti:\5 OR ti:\5^^^^&&&).

At the most abstract end, VLSI theory studies the physical energy of decoder circuits through Thompson’s model, where

PRESERVED_PLACEHOLDER_^^^^5all:\5 OR ti:\5^^^^6

For families of circuits decoding over a binary erasure channel, the paper proves that, as blocklength grows, either block error probability becomes asymptotically lower bounded by PRESERVED_PLACEHOLDER_^^^^5all:\5 OR ti:\5^^^^7 or total decoding energy scales at least as PRESERVED_PLACEHOLDER_^^^^5all:\5 OR ti:\5^^^^8, implying energy per decoded bit PRESERVED_PLACEHOLDER_^^^^5all:\5 OR ti:\5^^^^9. For serial computation with a constant number of output pins, the lower bound strengthens to PRESERVED_PLACEHOLDER_^^^^5all:\5 OR ti:\5search_query5^^^^; in a more general setting with varying output pins, it becomes PRESERVED_PLACEHOLDER_^^^^5all:\5 OR ti:\5all:\5^^^^. A further implication is that the average energy per decoded bit must approach infinity for any sequence of codes that approaches capacity (Blake et al., 2014).

6. Trade-offs, misconceptions, and comparative interpretation

The surveyed literature establishes that “energy” in decoding is not a single object. It may be a global score over whole text sequences, a reward-tilted posterior energy, a per-layer logit reliability score, a predicted decoder processing cost extracted from bitstream features, the actual GPU energy used by an inference policy, the iteration-dependent energy of a message-passing decoder, or the area-time energy of a VLSI circuit (&&&^^^^5search_query5^^^^&&&, &&&^^^^5 OR ti:\5^^^^&&&, &&&^^^^5 OR ti:\5^^^^&&&, &&&^^^^5 OR ti:\5^^^^&&&, Blake et al., 2014). A persistent misconception is therefore to equate all energy-based decoding with energy-based models; the codec and systems literature uses the same phrase for physically measured or estimated energy without introducing an EBM over outputs.

A second recurring pattern is that energy-aware decoding nearly always exposes a trade-off rather than a uniformly dominant operating point. In COLD, stronger task constraints can lower grammaticality, and top-PRESERVED_PLACEHOLDER_^^^^5all:\5 OR ti:\5 OR ti:\5^^^^ discretization mediates grammar against right/overall coherence (&&&^^^^5search_query5^^^^&&&). In reward-guided EBD, the prior–reward balance is controlled by PRESERVED_PLACEHOLDER_^^^^5all:\5 OR ti:\5 OR ti:\5^^^^, and the method remains only an approximate sampler because it runs a short MH chain (&&&^^^^5all:\5^^^^&&&). In LVLMs, energy-guided layer selection reduces yes-ratio bias and improves calibration, but CHAIRPRESERVED_PLACEHOLDER_^^^^5all:\5 OR ti:\5 OR ti:\5^^^^ can worsen even when CHAIRPRESERVED_PLACEHOLDER_^^^^5all:\5 OR ti:\55^^^^ improves (&&&^^^^5 OR ti:\5^^^^&&&). In HEVC and VVC, lower decoder energy is exchanged against bitrate and sometimes encoding time (&&&^^^^5 OR ti:\5^^^^&&&, &&&^^^^5all:\5 OR ti:\5^^^^&&&). In energy-conscious LLM serving, beam-like methods often buy modest quality gains at disproportionate energy cost, while assisted decoding and simple stochastic truncation rules offer better quality-per-energy trade-offs (&&&^^^^5 OR ti:\5^^^^&&&). In short-range communication, aggressive transmit-power minimization can backfire because it raises decoding iterations and hence decoding energy (Rehman et al., 2013). In circuit theory, approaching capacity forces diverging energy per decoded bit (Blake et al., 2014).

A plausible synthesis is that the literature has converged on a shared design principle rather than a single formalism: decoding should be treated as an optimization or inference stage whose objective need not be identical to local next-token likelihood or local rate-distortion cost. What differs across domains is the status of the energy term—probabilistic, heuristic, predictive, or physical. That distinction determines both the mathematical tools used, such as Langevin dynamics, Metropolis–Hastings, log-sum-exp layer scoring, or Lagrangian rate-energy-distortion optimization, and the failure modes that dominate in practice, such as discretization error, reward dependence, calibration drift, bitrate penalty, or hardware energy overhead (&&&^^^^5search_query5^^^^&&&, &&&^^^^5all:\5^^^^&&&, &&&^^^^5 OR ti:\5^^^^&&&, &&&^^^^5 OR ti:\5^^^^&&&, &&&^^^^5 OR ti:\5^^^^&&&).