---
title: Tool Benefit Score in Multimodal Models
url: https://www.emergentmind.com/topics/tool-benefit-score-tbs
type: topic
---

# Tool Benefit Score in Multimodal Models

The Tool Benefit Score (TBS) is a per-instance metric employed to quantify the net value of tool use—specifically, vision-tool interactions—in multimodal large language models (MLLMs) engaged in complex visual reasoning tasks. It is formally defined for each problem instance as the difference in expected accuracy between a reference model allowed vision-tool calls during chain-of-thought (CoT) reasoning and the same model restricted to textual reasoning alone. TBS serves as a foundational component in the training and operation of AdaTooler-V, where it both diagnoses when tool invocations help or hinder performance and modulates reinforcement learning objectives to optimize tool-use adaptively [2512.16918].

## 1. Formal Definition and Computation

For each query $q_i$, the Tool Benefit Score $\Delta S_i$ is defined as:
$$
\Delta S_i = S^{+}(q_i) - S^{-}(q_i)
$$
where
- $S^{+}(q_i)$ is the average accuracy of the reference model (Qwen2.5-VL-72B-Instruct) on $q_i$ with interleaved vision tool invocations,
- $S^{-}(q_i)$ is the corresponding accuracy with vision tools disabled, i.e., pure text-based CoT.

Empirically,
$$
S^{+}(q_i)=\frac{1}{8}\sum_{r=1}^{8}\mathbf{1}\{\text{correct}_r^{+}\},\quad
S^{-}(q_i)=\frac{1}{8}\sum_{r=1}^{8}\mathbf{1}\{\text{correct}_r^{-}\}
$$
where $\mathbf{1}\{\cdot\}$ is an indicator of correctness for the $r$-th run. $\Delta S_i$ thus resides in $[-1, 1]$, with no further clipping or normalization. TBS is precomputed for each RL training sample via 8 runs in both tool-enabled and tool-disabled regimes to minimize sampling noise.

## 2. Theoretical Motivation and Significance

TBS directly addresses the tendency of previous MLLMs to invoke vision tools indiscriminately, which can result in:
- Increased inference costs,
- Overly complex or suboptimal reasoning chains,
- A diversion from salient visual inputs.

$\Delta S_i$ acts as a problem-dependent indicator: $\Delta S_i > 0$ signals that vision tool use yields net gains while $\Delta S_i < 0$ indicates harm from such invocations. Unlike static or global tool-use policies, TBS supports per-instance assessment, enabling reinforcement learners to reward tool usage only when historically associated with accuracy improvements and penalize it when detrimental. This approach directly counteracts "blind" tool-use patterns and aligns the reward structure with task-specific needs [2512.16918].

## 3. Integration into AT-GRPO Reinforcement Learning

Within AdaTooler-V’s RL framework, the AT-GRPO algorithm incorporates TBS in its reward function. For trajectory $i$, the reward is composed as:
$$
R_i = R_i^o + \alpha R_i^t
$$
where
- $R_i^o$ is the base reward (correctness, formatting),
- $R_i^t$ is a tool-use reward,
$$
R_i^t = \Delta S_i \exp\left(-\gamma \left(\frac{n_{\text{tool},i}}{n_{\max}}\right)^2\right)
$$
$n_{\text{tool},i}$ is the number of tool calls, $n_{\max}$ is the allowed maximum (context-budgeted), and $\gamma$ (set to $2$) governs decay sensitivity. $\alpha$ trades off tool and base reward, with ablation confirming optimum performance at $\alpha = 0.6$ for key benchmarks.

Within minibatches, returns are normalized:
$$
A_i=\frac{R_i-\mu_R}{\sigma_R}
$$
and policy updates follow clipped GRPO with KL penalty. This integration ensures that tool-use is modulated not only by its marginal benefit but also by the efficiency with respect to tool budget.

## 4. Hyperparameter Choices and Tuning

The principal hyperparameters for TBS-guided RL are:
- $\gamma = 2$ for Gaussian decay,
- $\alpha$ explored in $\{0.2, 0.4, 0.6, 0.8\}$, showing peak performance at $0.6$,
- $n_{\max}$ typically set between 4–6, determined by context length or task constraints.

Performance was robust to $n_{\max}$ provided it exceeded usual tool demand. The TBS mechanism’s efficacy persisted for a range of $\alpha$ values, with stable gains for $\alpha \in [0.4, 0.8]$.

## 5. Empirical Outcomes and Analysis

In empirical evaluation:
- SFT+AT-GRPO (with TBS) outperformed SFT+GRPO and vanilla GRPO, yielding improvements of +2.2 pp on V*, +2.4 pp average, and +4 pp over standard GRPO.
- Complete tool-use ablation degraded accuracy on V* from 89.8% to 84.4% and on VSI-Bench from 46.7% to 39.9%, confirming the necessity of selective tool invocation.
- Training dynamics (Figure 4(b)) exhibited a reduction in response lengths, indicating that the model adaptively suppressed tool use when $\Delta S_i < 0$.

This suggests TBS is instrumental both for accuracy maximization and inference cost reduction through avoidance of wasteful tool calls.

## 6. Qualitative Examples of TBS Guidance

Concrete examples illustrate TBS’s modulatory effect:
- **High-resolution image tasks** (V*): Large positive $\Delta S$ ($\approx$ +0.2–0.4) led to multiplicative tool invocation, as AdaTooler-V exploited cropping/zooming to recover fine details missed by baselines.
- **Multi-image spatial puzzles**: Negative $\Delta S$ (≈–0.1) punished tool use, reducing invocations to zero, improving efficiency with no loss—sometimes a net gain—in accuracy.
- **Video causal reasoning** (Video-Holmes): Moderately positive $\Delta S$ ($\approx$ +0.15) encouraged strategic tool use early in CoT, bolstering accuracy by facilitating frame-level analysis.

These case studies indicate that TBS-driven policies adapt tool frequency and timing to the actual utility displayed in historical completions.

## 7. Significance and Broader Implications

The Tool Benefit Score paradigm presents a scalable, generalizable mechanism for per-query tool-use selection in multimodal reasoning. By weaving $\Delta S$ into AT-GRPO’s reward, AdaTooler-V achieves a dual optimization of reasoning quality and inference efficiency, sidestepping both underuse and overuse of vision tools. *A plausible implication is that such adaptive reward scaling could be extended to other MLLM tool-use scenarios beyond vision (e.g., audio, structured data), provided domain-specific analogues of TBS are devised.*

TBS thus enables a principled, data-driven approach to selective tool invocation, providing both theoretical foundation and empirical validation for more efficient, higher-performing multimodal language models [2512.16918].

Source: https://www.emergentmind.com/topics/tool-benefit-score-tbs