---
title: 'GRIDEX: Grid-Based Deepfake Forensic Explanations'
url: https://www.emergentmind.com/topics/gridex
type: topic
---

# GRIDEX: Grid-Based Deepfake Forensic Explanations

Searching arXiv for the specified paper to ground the article and citation.
GRIDEX is a two-stage, grid-grounded forensic explanation pipeline for deepfake spectrogram analysis that is designed to both localize the most diagnostic regions in a deepfake spectrogram and generate structured, acoustically grounded explanations for each region [2606.18738]. It addresses a forensic gap identified by the authors: modern classification models can achieve high accuracy in deepfake detection, but they do not produce evidences such as indicating where spoof cues appear in the spectrogram and what they imply acoustically. In response, GRIDEX overlays a fixed \(G\times G\) grid on an input spectrogram \(\mathbf S\), uses a vision-language model to select the top-\(K\) most anomalous cells, and then produces, for each selected cell, a tuple that links a region identifier to temporal, spectral, and phonetic context plus a free-form evidence statement [2606.18738].

## 1. Forensic motivation and conceptual scope

The motivating problem is defined in explicitly forensic terms. Manual analysis of full spectrograms is described as resource-intensive, and evidential support is therefore expected to narrow attention to the most diagnostic regions rather than require exhaustive inspection of the entire image [2606.18738]. Existing explainability methods are characterized as having limited capabilities in connecting contextual attributes to localized evidence, which makes explanations harder to verify.

Within that setting, GRIDEX is intended to bridge global deepfake detection and fine-grained forensic analysis by producing verifiable, structured evidence localized to spectrogram regions [2606.18738]. The paper presents the method as a pipeline with two coupled objectives: first, identification of the strongest spoof-related artifacts; second, explanation of those artifacts in acoustically meaningful terms.

The authors describe GRIDEX, to their knowledge, as the first framework to generate structured forensic explanations using regional grounding for deepfake spectrograms [2606.18738]. This framing is important because the output is not a scalar prediction or an unstructured caption, but a set of region-level explanations anchored to a fixed spatial partition of the spectrogram.

## 2. Formal problem formulation and grid grounding

The formal input is a magnitude spectrogram \(\mathbf S\in\mathbb R^{T\times F}\). The stated goal of deepfake anomaly detection is twofold: to decide which \(K\) spectrogram subregions \(r\subset\{1,\dots,T\}\times\{1,\dots,F\}\) exhibit the strongest spoof-related artifacts, and to explain each region's anomaly in acoustically meaningful terms [2606.18738].

Supervised localization is derived from bona fide-spoof parallels by constructing a binarized artifact mask through smoothed STFT differences:

$$
D(t,f)=\frac{\bigl|G(M_s)(t,f)-G(M_b)(t,f)\bigr|}{G(M_b)(t,f)+\epsilon},\qquad
\mathrm{Mask}(t,f)=\mathbf1_{D(t,f)>\tau},\;\tau=\mathrm{Quantile}_{0.95}(D).
$$

Each candidate region is then scored by summing mask values over its support:

$$
A(r;\mathbf S)=\sum_{(t,f)\in r}\mathrm{Mask}(t,f).
$$

GRIDEX partitions \(\mathbf S\) into uniform cells \(\mathcal R=\{r_1,\dots,r_{G^2}\}\), with \(G=4\), and selects the top-\(K\) cells by sorting these scores, with \(K=3\):

$$
\hat{\mathcal C}=[\hat c_1,\dots,\hat c_K]
=\arg\mathop{\mathrm{TopK}}_{r\in\mathcal R}\;A(r;\mathbf S).
$$

Because the cells are non-overlapping, no non-maximum suppression or clustering is needed [2606.18738]. During training, the predicted top-\(K\) cells are supervised by the ground-truth top-\(K\) derived from the artifact mask.

This fixed-grid formulation is one of the paper's central design choices. Region annotation was considered with both grid \((4\times 4)\) cells and SLIC superpixels, but the grid was chosen because it yields higher coverage and stability [2606.18738]. A plausible implication is that the authors prioritize consistency and verifiability of region references over a more adaptive segmentation scheme.

## 3. Structured explanation schema

For each selected cell \(\hat c_i\), GRIDEX outputs a 5-tuple \((C_i,T_i,F_i,P_i,E_i)\) [2606.18738]. The fields are defined as follows:

- \(C_i\): cell ID.
- \(T_i\in\{\text{speech},\text{non-speech}\}\): temporal activity, with speech assigned if overlap with forced-aligned phones exceeds \(0.02\) s.
- \(F_i\in\{\text{low},\text{mid},\text{high}\}\): frequency band, based on mean pixel row.
- \(P_i\in\{\text{vowel},\text{consonant},\text{unvoiced}\}\): phonetic category, obtained from Montreal Forced Aligner.
- \(E_i\): a short free-form evidence text.

The paper gives an example of the evidence field: “This region shows smoothed harmonic structure causing muffled vowel timbre.” Because the categorical fields are drawn from a closed vocabulary, the authors argue that explanations are verifiable against the spectrogram region [2606.18738].

This schema combines localization with contextualization. Temporal, spectral, and phonetic labels constrain interpretation to attributes that can be checked against the selected cell, while the free-form evidence statement provides a concise verbal characterization of the anomaly. The paper's emphasis is therefore not on unrestricted natural-language generation, but on a structured explanation format intended to support forensic verification.

## 4. Model architecture and two-stage learning

The explanation generation model uses Qwen2.5-VL-3B-Instruct as its backbone, together with parameter-efficient fine-tuning through two LoRA adapters, \(A_1\) for Query 1 and \(A_2\) for Query 2 [2606.18738]. Query 1 takes a spectrogram image with grid overlay and outputs a JSON list of three region IDs. Query 2 takes the same image together with the transcript and the selected IDs and outputs three structured tuples.

The learning paradigm has two stages. In supervised fine-tuning, Stage 1 trains \(A_1\) on ground-truth top-3 lists, and Stage 2 trains \(A_2\) on ground-truth structured tuples; weight decay and LoRA regularization are reported as in Table A.1 [2606.18738]. The supervised loss for stage \(k\in\{1,2\}\) is

$$
\mathcal L_{\mathrm{SFT}^{(k)}}(\theta)
= -\sum_{t\in\mathcal A_k}\log p_\theta(y_t\mid \mathbf S,\text{prompt},y_{<t}).
$$

After supervised fine-tuning, GRIDEX applies Group Relative Policy Optimization (GRPO). During RL, the policy gradient update follows

$$
\nabla_\theta J(\theta)\approx \mathbb E[\nabla_\theta\log p_\theta(\tau)\,R(\tau)],
$$

where \(R\) is stage-specific [2606.18738].

For localization, the GRPO-1 reward combines hit rate, ranking quality, and format validity:

$$
H=\frac{|\hat{\mathcal C}\cap\mathcal C_{\mathrm{gt}}|}{3},\qquad
D=\mathrm{nDCG}(\hat{\mathcal C},\mathcal C_{\mathrm{gt}}),\qquad
F=\mathbf1[\text{valid list format}],
$$

$$
R^{(1)} = 1.0\,H + 0.3\,D + 0.1\,F.
$$

For explanation generation, GRPO-2 uses a tuple-level reward involving textual similarity, categorical field accuracy, contextual consistency, and schema validity:

$$
R_i = \mathrm{ROUGE\text{-}L}(E_i,\hat E_i),\qquad
A_i=\tfrac13\bigl[\mathbf1(\hat T_i=T_i)+\dots\bigr],
$$

$$
C_i=\tfrac13[\mathbf1(\hat T_i=\tilde T_i)+\dots],\qquad
F_i=\mathbf1[\text{valid schema}],
$$

$$
R^{(2)}=\frac13\sum_{i=1}^3\Bigl(m_i(R_i+0.5\,A_i)+0.1\,C_i+0.1\,F_i\Bigr),
$$

where \(m_i=1\) if and only if \(\hat C_i\) is correct [2606.18738].

The staged design is central to the method. The paper's discussion indicates that it improves both region retrieval and explanation grounding relative to zero-shot VLM baselines, while also exposing an important dependency: errors in Query 1 propagate directly into Query 2.

## 5. Dataset construction, supervision, and evaluation protocol

Experiments are conducted on the VocV4 dataset, which contains 10 320 train utterances and 10 192 test utterances, with each utterance re-synthesized by four neural vocoders and with equal genuine versus spoof examples [2606.18738]. Spectrograms are STFT magnitudes, and difference maps are smoothed by a separable Gaussian \((3\times 11)\).

The explanation texts \(E_i\) are generated by a Qwen3-VL-30B and Qwen3-235B pipeline with manual correction [2606.18738]. This indicates that free-form evidence supervision is not obtained directly from raw annotations but through a model-assisted authoring process followed by manual refinement.

The evaluation protocol separates localization, structured-field prediction, grounding quality, and text similarity. The paper reports the following metrics:

| Category | Metrics |
|---|---|
| Localization | R@3, nDCG, mAP |
| Structured fields | \(\mathrm{FieldAcc}=\tfrac{\mathrm{Acc}_T+\mathrm{Acc}_F+\mathrm{Acc}_P}{3}\) |
| Explanation grounding | \(\mathrm{CovAvg}=\tfrac{\mathrm{Cov}_T+\mathrm{Cov}_F+\mathrm{Cov}_P}{3}\) |
| Text similarity | ROUGE-L, BERTScore F1 |

This metric design reflects the paper's claim that explanation quality is not reducible to text overlap alone. In particular, the distinction between \(\mathrm{FieldAcc}\) and \(\mathrm{CovAvg}\) separates exact prediction of categorical fields from grounding coverage relative to the selected regions.

The paper also provides a pseudocode outline. Given spectrogram \(S\) and transcript \(T\), the pipeline partitions \(S\) into \(G\times G\) cells, applies Query1 to obtain \(\hat C=[c_1,c_2,c_3]\), and then, for each selected cell, applies Query2 to produce \((C_i,T_i,F_i,P_i,E_i)\), returning both localization and explanations [2606.18738].

## 6. Empirical results, ablations, and limitations

On Query 1 localization, GRIDEX reports \( \mathrm{R@3}=0.386\), \( \mathrm{nDCG}=0.411\), and \( \mathrm{mAP}=0.333\) in the end-to-end setting [2606.18738]. The best VLM baseline listed in the paper, InternVL3-78B, reports approximately \( \mathrm{R@3}=0.241\), \( \mathrm{nDCG}=0.244\), and \( \mathrm{mAP}=0.211\). On Query 2 end-to-end structured explanations, GRIDEX reports \(\mathrm{FieldAcc}=0.333\), \(\mathrm{CovAvg}=0.884\), \(\mathrm{ROUGE\text{-}L}=0.084\), and \(\mathrm{BERTF1}=0.413\), whereas Qwen3-VL-8B end-to-end reports \(\mathrm{FieldAcc}=0.149\), \(\mathrm{CovAvg}=0.643\), \(\mathrm{ROUGE\text{-}L}=0.016\), and \(\mathrm{BERTF1}=0.187\) [2606.18738].

The staged optimization ablations isolate the contribution of GRPO after supervised fine-tuning. For localization, SFT-1 to GRPO-1 increases R@3 from \(0.309\) to \(0.386\) and nDCG from \(0.333\) to \(0.411\). For explanation generation, SFT-2 to GRPO-2 increases \(\mathrm{FieldAcc}\) from \(0.313\) to \(0.522\) and \(\mathrm{CovAvg}\) from \(0.077\) to \(0.886\) [2606.18738]. These ablations support the paper's claim that the staged SFT + GRPO training substantially improves region retrieval and explanation grounding.

The limitations identified by the authors are specific. Query 1 can introduce error propagation into Query 2, and there is a “hotspot” bias toward a few frequent regions [2606.18738]. The paper also reports lower accuracy on phonetic field extraction. Future directions proposed in the discussion include more diverse region proposals, tighter feedback loops between localization and explanation, cross-dataset generalization, and richer acoustic fields beyond the temporal-spectral-phonetic schema.

A common misconception would be to treat GRIDEX as a generic saliency method for deepfake detection. The paper instead defines it as a structured forensic explanation framework with regional grounding, fixed-cell localization, and tuple-based outputs tied to temporal, spectral, and phonetic attributes [2606.18738]. A plausible implication is that its primary contribution lies in evidential organization and verifiability rather than in replacing the underlying deepfake detector with a purely explanatory model.

Source: https://www.emergentmind.com/topics/gridex