---
title: Attention-Debiased Pruning (AdaTP)
url: https://www.emergentmind.com/topics/attention-debiased-pruning-adatp
type: topic
---

# Attention-Debiased Pruning (AdaTP)

Attention-Debiased Pruning (AdaTP) comprises a family of post-training pruning techniques targeting attention-based overparameterization and bias artifacts in large language and multimodal models. These methods correct for quantifiable attention biases during inference, yielding substantial reductions in FLOPs and memory requirements while maintaining high task fidelity—particularly in challenging settings such as long-context video or fine-grained localization. AdaTP has been realized in both token-pruning algorithms for visual and video LLMs and attention head-pruning for bias mitigation in language models, with each instantiation tailored to address the specific structure of attention-induced redundancy and bias.

## 1. Motivation and Problem Setting

Modern multimodal and video large language models (LLMs) encode visual or video inputs into long token sequences, incurring prohibitive computational overhead at inference time. Conventional token pruning pipelines, which select tokens for retention based on raw attention scores, reveal systematic biases:

- **Positional and border bias**: Raw attention scores are dominated by artifacts that favor specific positions (e.g., borders or the ends of sequences) independent of semantic relevance [2512.19443, 2505.20100].
- **Local redundancy**: Attention is often over-concentrated on the same spatial locations (patches) across frames or images, reducing diversity in the retained token set [2505.20100].
- **Spatial and semantic redundancy**: Importance-based methods ignore structural redundancy, preserving clusters of highly similar or spatially adjacent tokens [2512.19443].

Furthermore, in language-only LLMs, undesirable social biases (e.g., gender and race) can be perpetuated by certain attention heads. Prior methods that prune attention heads or neurons post hoc for fairness lack principled bias quantification and balancing with model utility [2503.15815].

AdaTP directly addresses these issues by quantifying and removing attention biases, either in the selection of informative tokens (vision, video) or in the pruning of attention heads (language), yielding efficient models that retain both utility and fairness.

## 2. Debiasing Methodologies

### 2.1 Attention Score Debiasing for Visual and Video LLMs

In image and video LLMs, AdaTP computes token importance using attention maps from the model's token–token self-attention modules. The process includes:

- **Bias estimation**: A position-dependent prior $\mathcal{A}_{\mathrm{bias}}\in\mathbb{R}^N$ is generated by averaging attention weights across 1,000 random images under a neutral prompt [2512.19443]. In video LLMs, global and local bias metrics are explicitly defined and visualized [2505.20100].
- **Debiasing transformation**: At inference, the raw attention for token $i$ is divided by the corresponding prior and stabilized via a small $\varepsilon$:
  $$
  \mathcal{A}_{\rm rel}(i) = \frac{\mathcal{A}_{\rm ori}(i)}{\mathcal{A}_{\rm bias}(i)+\varepsilon}
  $$
  The resulting debiased attention score, $\mathcal{I}(i) = \mathcal{A}_{\rm rel}(i)$, is used for token ranking.
- **Global and local modules**: In video LLMs, AdaTP implements distinct debiasing modules. The global module allocates higher retention in text-relevant segments (based on cosine similarity between frame- and prompt-features), and the local module deduplicates tokens at the same patch position across frames (Algorithm 1 in [2505.20100]).

### 2.2 Hybrid Graph and Structural Diversity

To address structural redundancy, AdaTP constructs a hybrid undirected graph $\mathcal{G}=(V,E)$ with $|V|=N$ tokens:

- **Semantic similarity**: Edges encode cosine similarity among token features, normalized linearly across the batch.
- **Spatial proximity**: An 8-connected grid encodes adjacency among spatial patches.
- **Graph fusion**: A weighted sum $S_{\rm fused} = \alpha \widehat{S}_{\rm sem} + (1-\alpha) S_{\rm spat}$, followed by thresholding, yields the final adjacency $S$ [2512.19443].

### 2.3 Attention Head Pruning for Fairness in LLMs

In the context of LLM fairness, “Attention-Debiased Pruning” denotes the identification and pruning of attention heads that disproportionately contribute to bias:

- **Surrogate models**: Small neural networks, $\theta_{\rm bias}$ and $\theta_{\rm ppl}$, are trained to predict bias and utility (perplexity) given an attention head pruning mask [2503.15815].
- **Multi-objective optimization**: Simulated annealing on the Boolean hypercube of head-masks seeks a trade-off minimizing a weighted sum of predicted bias and perplexity increases, with temperature scheduling and neighbor sampling guaranteeing coverage.
- **Post-hoc pruning**: The optimal mask is applied to deactivate heads; the procedure is entirely post-training and requires no model finetuning.

## 3. Pruning Algorithms and Architectural Schemes

### 3.1 Token Selection: Pivot + Maximal Independent Set

AdaTP’s token selection proceeds in two stages:

1. **Pivot selection**: Select a fixed ratio (e.g., $r_p=0.7$) of the highest-importance tokens as “pivots.” After each selection, both the pivot and its neighbors (per $S$) are removed from eligibility.
2. **MIS selection**: The remaining tokens are iteratively chosen to maximize importance under the constraint that no two retained tokens are adjacent in $S$ (greedy MIS). This dual-stage procedure preserves both highly informative and structurally diverse tokens, ensuring spatial and semantic distribution.

### 3.2 AdaTP Pipeline for Video LLMs

In video models, AdaTP operates across layers:

- Progressive reduction: From the second up to $N-12$-th layer ($N$ total), the fraction of tokens is reduced according to a schedule (down to $12\%$ at deepest layer). Key parameters include segmentation thresholds ($\tau_s$ for frame similarity, $\tau_t$ for text relevance) and retention boosts ($\alpha_{\mathrm{boost}}, \gamma_{\mathrm{cap}}$).
- Segment-based retention: Significant video segments (text-relevant) retain a higher fraction of tokens ($r_1$), others retain $r_2$.
- Local deduplication: Within segments, retained tokens are deduplicated at each spatial patch position to eliminate local redundancy.

### 3.3 Pruning Attention Heads with Fairness Constraints

For language models, AdaTP leverages two surrogates to rapidly evaluate the effect of head-pruning masks on bias and perplexity. Simulated annealing searches for masks that minimize combined cost under fixed pruning bounds. Accepted masks are those that meet or beat prior cost, or probabilistically according to the annealing schedule.

## 4. Computational Complexity and Empirical Results

### Complexity Analysis

- **Graph construction**: $O(N^2d)$ for pairwise similarities and adjacency, mitigated by sparsity and batching [2512.19443].
- **Token selection**: Pivot sort $O(N\log N)$, MIS stage up to $O(nN)$ overall (dominated by sparsity).
- **Self-attention FLOPs**: Reduced from $\propto (N+M)^2$ to $\propto (n+M)^2$, with $M$ text tokens. For instance, retaining $n=11.1\%$ of original tokens reduces FLOPs by $88.9\%$ [2512.19443].
- **KV cache usage**: Scaled down in proportion to pruned tokens.

### Empirical Trade-Offs

| Scenario                 | Tok %  | Performance % | FLOPs ↓        |
|--------------------------|--------|---------------|----------------|
| LLaVA-1.5-7B, general    | 33.3   | 99.9          | –74.2          |
| LLaVA-1.5-7B, general    | 22.2   | 99.2          | –80.6          |
| LLaVA-1.5-7B, general    | 11.1   | 97.3          | –88.9          |
| InternVL-2.5-8B, loc.    | 50     | 98.4          | —              |
| InternVL-2.5-8B, loc.    | 25     | 94.7          | —              |
| InternVL-2.5-8B, loc.    | 10     | 85.7          | —              |
| LLaVA-OneVision-7B, vid. | 27.3   | $\geq$ vanilla| –72.7          |

AdaTP typically sustains $>97\%$ performance on general tasks down to $11\%$ token retention and maintains $85.7\%$ accuracy on challenging localization with $90\%$ token reduction [2512.19443, 2505.20100].

### Fairness Pruning in LLMs

AdaTP achieves up to $40.8\%$ reduction in measured gender bias with only modest increases in perplexity (e.g., $11.695 \rightarrow 13.17$ on GPT-J-6B) [2503.15815]. Surrogate models provide a speedup of $2.26 \times 10^6$ over direct evaluation.

## 5. Ablations, Insights, and Comparative Analysis

### Component Ablations

- **Debiasing only**: Corrects for positional and border bias, outperforming raw-attention-only pruning, especially at high pruning ratios.
- **Structural diversity**: Adding MIS-based selection over the hybrid graph yields 5–10 point improvements in localization (and 1–2 in general), reducing semantic and spatial redundancy [2512.19443].
- **Spatial adjacency**: Critical for localization; removing spatial edges reduces grounding accuracy by 3–5 points.

In video LLMs, ablations show additive improvements from segmentation, global debiasing, and local deduplication [2505.20100].

### Comparison with Prior Work

AdaTP consistently outperforms prior naive pruning pipelines:

- FastV, VisionZip, and Dycoke employ basic attention-based or segmentation pruning but fail to address or even exacerbate attention bias, especially global endpoint focus and local patch redundancy [2505.20100].
- On both efficiency and accuracy, AdaTP achieves superior average performance at comparable or lower FLOPs [2512.19443, 2505.20100].
- For attention head pruning, AdaTP's surrogate-annealing search achieves better bias–utility trade-offs than FASP and yields cross-bias reductions in multiple demographic metrics [2503.15815].

## 6. Limitations and Future Directions

Known limitations of current AdaTP instantiations include:

- **Surrogate limitations**: For head pruning, surrogate approximation errors ($\leq 0.03$ MSE) and significant offline training cost (1,900 GPU-hours) [2503.15815].
- **Hyperparameter sensitivity**: Multiple thresholds and ratio parameters require tuning, though robustness is reported across wide ranges.
- **Scalability and model size**: Empirical validation is currently lacking on very large-scale (>7B) Video LLMs [2505.20100].
- **Extension to broader tasks**: Applicability to robustness, privacy, or more diverse bias categories is an open question.

Proposed extensions include learnable debiasing weights, active-learning-driven surrogate construction, adaptive pruning schedules, and integration with dynamic inference mechanisms such as early-exit or on-device video assistants.

## 7. Conclusion and Significance

Attention-Debiased Pruning (AdaTP) introduces a rigorous framework for correcting attention-induced biases in both the spatial/temporal and parameter domains of large models. By combining calibrated attention debiasing, hybrid graph-based structural pruning, and fairness-constrained head pruning, AdaTP achieves substantial reductions in computational expense and memory usage while preserving (and sometimes exceeding) original model performance across multiple benchmarks. The technique enables efficient inference for large-scale multimodal and video LLMs and supports responsible deployment in fairness-sensitive applications, with demonstrated, state-of-the-art performance across general understanding, fine-grained localization, and fairness metrics [2512.19443, 2505.20100, 2503.15815].

Source: https://www.emergentmind.com/topics/attention-debiased-pruning-adatp