Papers
Topics
Authors
Recent
Search
2000 character limit reached

FORT-Searcher: Shortcut-Resistant Search Agent

Updated 4 July 2026
  • FORT-Searcher is a deep search agent that uses shortcut-resistant data synthesis to ensure answers remain inaccessible until sufficient evidence is gathered.
  • It employs the FORT pipeline, which constructs complex evidence graphs and formulates verifiable questions that prevent easy shortcut exploitation.
  • Empirical results show that its methodology delays answer exposure and improves performance compared to other open-source search agents.

Searching arXiv for FORT-Searcher and closely related search-agent papers to ground the article. Searching arXiv for the specific paper and related deep search agent work. FORT-Searcher is a deep search agent and, more fundamentally, the name associated with a shortcut-aware data synthesis program for training such agents. It is introduced together with FORT, a “Framework of Shortcut-Resistant Training-Data Synthesis,” to address a specific failure mode in search-agent training: structurally complex questions can still be easy in practice if a model can reach the answer through a shortcut route. The central claim is that realized search difficulty is governed not only by graph size or hop count, but by whether the answer remains unavailable until sufficient evidence has been acquired through search. On this basis, FORT defines shortcut-aware difficulty, operationalizes four shortcut risks, synthesizes training data that suppresses them, and uses the resulting trajectories to train FORT-Searcher with supervised fine-tuning only (Deng et al., 10 Jun 2026).

1. Definition and problem setting

FORT-Searcher belongs to the class of deep search agents: LLM-based, tool-empowered systems that interact with external environments, gather evidence over multiple turns, and synthesize scattered information before answering. The work defines the training problem in terms of verifiable questions whose answers remain unavailable until sufficient evidence has been acquired through search, so that the resulting trajectories reward multi-turn query formulation, evidence discovery, evaluation, and integration rather than shallow retrieval (Deng et al., 10 Jun 2026).

A central distinction is drawn between intended or structural difficulty and realized difficulty. The paper argues that increasing structural complexity—such as adding more hops or widening an evidence graph—does not guarantee that a search process will remain hard in practice. A question may still collapse through what the work calls a “cheaper identifying route,” or through solver prior knowledge. This motivates a shortcut-aware formulation of difficulty in which the effective challenge is determined by the cheapest route that identifies the unique gold answer under the retrieval interface, rather than by surface graph properties alone (Deng et al., 10 Jun 2026).

The task is formalized as a multi-constraint agentic retrieval problem

q=(X,Cq,Σ),q=(\mathcal{X},\mathcal{C}_q,\Sigma),

where X\mathcal{X} is the answer space, Cq\mathcal{C}_q is the set of constraint clues expressed by the question, and Σ\Sigma is the retrieval interface. For any subset PCq\mathcal{P}\subseteq\mathcal{C}_q, the remaining candidate pool is

Ans(P)={xX:ciPci(x)=1}.\mathrm{Ans}(\mathcal{P}) = \left\{ x\in\mathcal{X}: \bigwedge_{c_i\in\mathcal{P}} c_i(x)=1 \right\}.

A well-posed question satisfies Ans(Cq)={y}\mathrm{Ans}(\mathcal{C}_q)=\{y^\star\}, where yy^\star is the gold answer (Deng et al., 10 Jun 2026).

This framing positions FORT-Searcher within a broader shift in search-agent research from maximizing apparent task complexity to controlling realized search cost. A plausible implication is that data synthesis quality, rather than model size alone, becomes a first-order determinant of search-agent behavior.

2. Shortcut-aware difficulty framework

The shortcut-aware framework centers on the difference between the cost a solver must pay if it has no prior knowledge and cannot guess unsupported answers, and the lower cost a concrete solver may realize in practice. A search trajectory is written as τ=(θ1,,θτ)\tau=(\theta_1,\dots,\theta_{|\tau|}), where τ|\tau| is the number of retrieval actions. The pure-posterior cost is defined as

X\mathcal{X}0

For an identifying subset X\mathcal{X}1 with X\mathcal{X}2, the shortest valid evidence-acquisition route cost is

X\mathcal{X}3

The structural lower bound is then

X\mathcal{X}4

The realized successful-trajectory cost of a concrete solver X\mathcal{X}5 is

X\mathcal{X}6

with solver-side cost reduction

X\mathcal{X}7

so that

X\mathcal{X}8

This separates route-level shortcut structure from solver-level exploitation of prior knowledge (Deng et al., 10 Jun 2026).

Three structural factors shape the cheapest identifying route. Subset selectivity is

X\mathcal{X}9

so small Cq\mathcal{C}_q0 for a small subset can identify the answer early. Evidence dispersion is

Cq\mathcal{C}_q1

so co-coverage by a single page or snippet lowers the effective route cost. Dependency depth is

Cq\mathcal{C}_q2

which captures the longest serial dependency chain and is reduced by exposed intermediate constants (Deng et al., 10 Jun 2026).

The paper states the proposition

Cq\mathcal{C}_q3

hence

Cq\mathcal{C}_q4

It also gives a collapse corollary: if some identifying subset can be verified by a single initially executable query, then Cq\mathcal{C}_q5 (Deng et al., 10 Jun 2026).

The framework operationalizes four shortcut risks.

Shortcut risk Mechanism Effect on difficulty
Single-clue selectivity One clue or small clue subset is overly identifying Shrinks exploration
Evidence co-coverage One item verifies multiple intended constraints Lowers evidence-acquisition cost
Exposed constants Intermediate names, dates, or numbers appear on the question surface Shortens dependency chains
Prior-knowledge binding Model names the answer before retrieval anchors it Reduces realized cost below structural cost

To diagnose realized effects at scale, the paper introduces trajectory signatures. Realized solving cost is

Cq\mathcal{C}_q6

answer hit time uses

Cq\mathcal{C}_q7

and dataset average

Cq\mathcal{C}_q8

The observable proxy for prior binding is the prior-shortcut rate

Cq\mathcal{C}_q9

Later Σ\Sigma0 indicates longer pre-answer search, while large gaps between Σ\Sigma1 and Σ\Sigma2 indicate post-hit verification or detours (Deng et al., 10 Jun 2026).

3. FORT synthesis pipeline

FORT constructs shortcut-resistant training data in four stages: graph initialization, evidence graph construction, question formulation, and adversarial refinement. The synthesis workspace is an internal evidence graph whose nodes are entities and whose edges are verified facts with sources and dependencies. The stated objective is to preserve route-level difficulty while reducing solver-level shortcuts (Deng et al., 10 Jun 2026).

In graph initialization, the root entity Σ\Sigma3 is selected from Wikidata, with preference for long-tail entities, including entities without English Wikipedia pages, to reduce prior-knowledge binding. The system also uses cycle-based seeds: it pre-mines a cycle library from Wikidata, builds a pair index, enumerates small cycles, removes duplicates and unsuitable hub-based or redundant cycles, and stores an inverted index Σ\Sigma4 such that Σ\Sigma5 lists retained cycles containing entity Σ\Sigma6. If Σ\Sigma7, one cycle is used as the initial subgraph Σ\Sigma8; otherwise the seed is a single-node graph (Deng et al., 10 Jun 2026).

Evidence graph construction targets evidence co-coverage and single-clue selectivity. Starting from Σ\Sigma9, expansion proceeds under a depth limit PCq\mathcal{P}\subseteq\mathcal{C}_q0 and a node-addition budget PCq\mathcal{P}\subseteq\mathcal{C}_q1, expanding deepest nodes first to preserve serial dependencies. Facts are collected from heterogeneous sources, including Wikidata, web pages, structured databases, and Google Scholar or Maps. The system performs multi-source enrichment, prefers distributing root-node facts across sources, and avoids verifying multiple selected facts on the same page (Deng et al., 10 Jun 2026).

The paper’s evidence graph construction algorithm is:

X\mathcal{X}32

Derived facts are used to reduce exact-match shortcuts and include coincidence bridging, count aggregation, numerical relation, and meta-fact extraction. Fact verification filters contradictions and entity-consistency failures such as similar names, ambiguous abbreviations, temporal or geographic drift, and series–edition mismatch. Fact selection then prefers generic facts that are reliable but non-representative in isolation, so that only combinations of clues identify the answer (Deng et al., 10 Jun 2026).

Question formulation then chooses an answer node PCq\mathcal{P}\subseteq\mathcal{C}_q2 and a subgraph PCq\mathcal{P}\subseteq\mathcal{C}_q3. Intermediate names are withheld and rendered as descriptions such as “the artist,” “the institution,” or “the work,” so downstream queries are not executable initially. Exact values are fuzzed into truthful but less directly searchable constraints through category generalization, range relaxation, meta-attribute description, arithmetic encoding, and contrastive exclusion. The formulation is explicitly required to remain verifiable and resolvable through evidence, avoiding ambiguity and over-fuzzing (Deng et al., 10 Jun 2026).

4. Adversarial refinement and shortcut suppression

Adversarial refinement calibrates realized difficulty in actual search. A strong search-agent adversary is run on each draft question, trajectory signatures are measured, and the question is repaired if it is shortcut-prone, ambiguous, or over-fuzzed. The acceptance criteria require that the adversary answer correctly, use at least a minimum desired solving cost threshold, exhibit sufficiently late answer hit time, and show no prior binding, meaning the model must not name the answer before evidence (Deng et al., 10 Jun 2026).

Repair actions depend on failure mode. If a draft is solved too quickly or exposes the answer early, the system replaces co-covered evidence, removes overly selective facts, and withholds or fuzzes exposed constants. If it is prior-bound, the root entity is replaced with a long-tail alternative or the evidence path is strengthened. If it is unsolved within budget, interpreted as over-hard or underspecified, the system narrows fuzzed clues, removes ambiguity, or restores necessary constraints (Deng et al., 10 Jun 2026).

The paper gives two case studies. In one shortcut repair, broadening “shot down by the Soviet Union” to “shot down by a certain country during the Cold War,” and relaxing a runtime digit-sum constraint from “sum to 10” to “sum to a multiple of 5,” removed a cross-domain triangulation shortcut. In one narrowing repair for over-fuzzed clues, “a certain European capital” was replaced with “the capital of a federal republic in Central Europe,” and “a certain year” with “mid-20th century,” to restore solvability while maintaining obfuscation (Deng et al., 10 Jun 2026).

This stage is central to the paper’s claim that shortcut resistance cannot be guaranteed by static graph design alone. The work treats actual search trajectories, not only graph templates, as the criterion for difficulty. This suggests that the FORT pipeline is best understood not as a pure synthesis engine, but as an overview-and-calibration loop.

5. FORT-Searcher agent and training procedure

FORT-Searcher is trained on FORT-generated trajectories with supervised fine-tuning only. The backbone is Qwen3-30B-A3B-Thinking-2507, with approximately 3B active parameters at inference and a 256K context window. Within a rollout, all tool-call results are retained so that accumulated evidence can be reused. If the model reaches a predefined turn limit without producing a final answer, the interaction history is cleared and the agent restarts from the original question. The rollout limits are 300 for BrowseComp and BrowseComp-ZH, and 200 for xbench-DeepSearch-2505, xbench-DeepSearch-2510, and Seal-0 (Deng et al., 10 Jun 2026).

The training recipe is standard supervised token-level learning rather than a custom reinforcement objective. The reported optimization setup uses bf16 precision; Adam with PCq\mathcal{P}\subseteq\mathcal{C}_q4, PCq\mathcal{P}\subseteq\mathcal{C}_q5, PCq\mathcal{P}\subseteq\mathcal{C}_q6, weight decay PCq\mathcal{P}\subseteq\mathcal{C}_q7, and gradient clipping PCq\mathcal{P}\subseteq\mathcal{C}_q8; a cosine schedule with peak learning rate PCq\mathcal{P}\subseteq\mathcal{C}_q9, minimum learning rate Ans(P)={xX:ciPci(x)=1}.\mathrm{Ans}(\mathcal{P}) = \left\{ x\in\mathcal{X}: \bigwedge_{c_i\in\mathcal{P}} c_i(x)=1 \right\}.0, and Ans(P)={xX:ciPci(x)=1}.\mathrm{Ans}(\mathcal{P}) = \left\{ x\in\mathcal{X}: \bigwedge_{c_i\in\mathcal{P}} c_i(x)=1 \right\}.1 warmup iterations; tensor parallelism Ans(P)={xX:ciPci(x)=1}.\mathrm{Ans}(\mathcal{P}) = \left\{ x\in\mathcal{X}: \bigwedge_{c_i\in\mathcal{P}} c_i(x)=1 \right\}.2; pipeline parallelism Ans(P)={xX:ciPci(x)=1}.\mathrm{Ans}(\mathcal{P}) = \left\{ x\in\mathcal{X}: \bigwedge_{c_i\in\mathcal{P}} c_i(x)=1 \right\}.3; context parallelism Ans(P)={xX:ciPci(x)=1}.\mathrm{Ans}(\mathcal{P}) = \left\{ x\in\mathcal{X}: \bigwedge_{c_i\in\mathcal{P}} c_i(x)=1 \right\}.4; expert parallelism Ans(P)={xX:ciPci(x)=1}.\mathrm{Ans}(\mathcal{P}) = \left\{ x\in\mathcal{X}: \bigwedge_{c_i\in\mathcal{P}} c_i(x)=1 \right\}.5 for the MoE architecture; sequence parallelism; activation recomputation; and a distributed optimizer. Hyperparameters are Ans(P)={xX:ciPci(x)=1}.\mathrm{Ans}(\mathcal{P}) = \left\{ x\in\mathcal{X}: \bigwedge_{c_i\in\mathcal{P}} c_i(x)=1 \right\}.6 epochs, global batch size Ans(P)={xX:ciPci(x)=1}.\mathrm{Ans}(\mathcal{P}) = \left\{ x\in\mathcal{X}: \bigwedge_{c_i\in\mathcal{P}} c_i(x)=1 \right\}.7, and maximum sequence length Ans(P)={xX:ciPci(x)=1}.\mathrm{Ans}(\mathcal{P}) = \left\{ x\in\mathcal{X}: \bigwedge_{c_i\in\mathcal{P}} c_i(x)=1 \right\}.8 tokens (Deng et al., 10 Jun 2026).

In comparative context, this training philosophy differs from recent multimodal or web search agents that rely on SFT-then-RL pipelines, such as VSearcher, which adopts an SFT-then-RL procedure with GRPO in real web environments (Zhang et al., 3 Mar 2026), and from openly released SFT-only search systems such as OpenSeeker, which emphasizes fact-grounded QA synthesis and denoised trajectory synthesis over Ans(P)={xX:ciPci(x)=1}.\mathrm{Ans}(\mathcal{P}) = \left\{ x\in\mathcal{X}: \bigwedge_{c_i\in\mathcal{P}} c_i(x)=1 \right\}.9k synthesized samples (Du et al., 16 Mar 2026). FORT-Searcher’s distinguishing claim is narrower and more specific: the decisive factor is shortcut-resistant synthesis rather than broader scale or reinforcement learning (Deng et al., 10 Jun 2026).

6. Empirical performance, diagnostics, and position in the literature

FORT-Searcher is evaluated on BrowseComp, BrowseComp-ZH, xbench-DeepSearch-2505, xbench-DeepSearch-2510, and Seal-0, with Hugging Face domains blocked during testing. Its reported scores are BrowseComp Ans(Cq)={y}\mathrm{Ans}(\mathcal{C}_q)=\{y^\star\}0, BrowseComp-ZH Ans(Cq)={y}\mathrm{Ans}(\mathcal{C}_q)=\{y^\star\}1, xbench-05 Ans(Cq)={y}\mathrm{Ans}(\mathcal{C}_q)=\{y^\star\}2, xbench-10 Ans(Cq)={y}\mathrm{Ans}(\mathcal{C}_q)=\{y^\star\}3, Seal-0 Ans(Cq)={y}\mathrm{Ans}(\mathcal{C}_q)=\{y^\star\}4, and overall Ans(Cq)={y}\mathrm{Ans}(\mathcal{C}_q)=\{y^\star\}5, which the paper describes as the best overall performance among comparable-size open-source search agents (Deng et al., 10 Jun 2026).

Agent BrowseComp BrowseComp-ZH xbench-05 xbench-10 Seal-0 Overall
FORT-Searcher 72.2 75.0 80.8 57.2 46.0 66.2
MiroThinker-1.7-mini 67.9 72.3 77.2 57.2 48.2 64.6
Qwen3.5-35B-A3B 61.0 69.5 77.4 50.3 41.4 59.9
OpenSeekerV2 46.0 58.1 78.0 43.4 41.4 53.4
Tongyi DeepResearch 43.4 46.7 75.0 47.5 45.8 51.7

The context-reset mechanism materially affects performance. With versus without context reset, the paper reports BrowseComp Ans(Cq)={y}\mathrm{Ans}(\mathcal{C}_q)=\{y^\star\}6 vs. Ans(Cq)={y}\mathrm{Ans}(\mathcal{C}_q)=\{y^\star\}7, BrowseComp-ZH Ans(Cq)={y}\mathrm{Ans}(\mathcal{C}_q)=\{y^\star\}8 vs. Ans(Cq)={y}\mathrm{Ans}(\mathcal{C}_q)=\{y^\star\}9, xbench-05 yy^\star0 vs. yy^\star1, xbench-10 yy^\star2 vs. yy^\star3, and Seal-0 yy^\star4 vs. yy^\star5 (Deng et al., 10 Jun 2026). This suggests that restart-based exploration of alternative routes is important when long trajectories accumulate unproductive context.

The more distinctive evidence concerns dataset difficulty. On 200 sampled questions per dataset using the same adversary and budget, FORT yields yy^\star6, yy^\star7, and yy^\star8. By contrast, OpenSeeker yields yy^\star9, τ=(θ1,,θτ)\tau=(\theta_1,\dots,\theta_{|\tau|})0, and τ=(θ1,,θτ)\tau=(\theta_1,\dots,\theta_{|\tau|})1; REDSearcher yields τ=(θ1,,θτ)\tau=(\theta_1,\dots,\theta_{|\tau|})2, τ=(θ1,,θτ)\tau=(\theta_1,\dots,\theta_{|\tau|})3, and τ=(θ1,,θτ)\tau=(\theta_1,\dots,\theta_{|\tau|})4; DeepResearch-9K yields τ=(θ1,,θτ)\tau=(\theta_1,\dots,\theta_{|\tau|})5, τ=(θ1,,θτ)\tau=(\theta_1,\dots,\theta_{|\tau|})6, and τ=(θ1,,θτ)\tau=(\theta_1,\dots,\theta_{|\tau|})7; DeepDive yields τ=(θ1,,θτ)\tau=(\theta_1,\dots,\theta_{|\tau|})8, τ=(θ1,,θτ)\tau=(\theta_1,\dots,\theta_{|\tau|})9, and τ|\tau|0; InfoSeek yields τ|\tau|1, τ|\tau|2, and τ|\tau|3 (Deng et al., 10 Jun 2026). The paper interprets this as evidence that FORT delays answer exposure and induces longer pre-answer search rather than merely longer post-hit detours.

A controlled training-data analysis strengthens that interpretation. Four 12K-example training settings are compared. Open-source data at τ|\tau|4 gives τ|\tau|5, τ|\tau|6, BrowseComp τ|\tau|7, and BrowseComp-ZH τ|\tau|8, whereas FORT at the same approximate solving cost gives τ|\tau|9, X\mathcal{X}00, BrowseComp X\mathcal{X}01, and BrowseComp-ZH X\mathcal{X}02 (Deng et al., 10 Jun 2026). This is the paper’s main empirical support for the claim that longer trajectories alone are insufficient; what matters is delaying answer exposure and reducing prior binding.

The cumulative shortcut-resistance ablation on 2K synthesized questions shows that removing any component makes questions easier. The full system yields accuracy X\mathcal{X}03, X\mathcal{X}04, X\mathcal{X}05, and X\mathcal{X}06. Removing fuzzing changes these to X\mathcal{X}07, X\mathcal{X}08, X\mathcal{X}09, and X\mathcal{X}10, representing the largest difficulty drop among the ablations. Removing generic-fact selection yields X\mathcal{X}11, X\mathcal{X}12, X\mathcal{X}13, and X\mathcal{X}14; removing source diversity yields X\mathcal{X}15, X\mathcal{X}16, X\mathcal{X}17, and X\mathcal{X}18; removing derived-fact construction yields X\mathcal{X}19, X\mathcal{X}20, X\mathcal{X}21, and X\mathcal{X}22; removing long-tail entity selection yields X\mathcal{X}23, X\mathcal{X}24, X\mathcal{X}25, and X\mathcal{X}26; and removing cycle construction yields X\mathcal{X}27, X\mathcal{X}28, X\mathcal{X}29, and X\mathcal{X}30 (Deng et al., 10 Jun 2026).

Within the broader literature, FORT-Searcher is positioned against methods that scale question generation by graph expansion, topology control, or web-graph reverse engineering, such as OpenSeeker (Du et al., 16 Mar 2026), and against agentic systems emphasizing multimodal RL and tool-use policies, such as VSearcher (Zhang et al., 3 Mar 2026) and MX\mathcal{X}31Searcher (Yu et al., 14 Jan 2026). Its specific contribution is not a new planner or reward function, but a theory-and-synthesis account of shortcut-resistant search difficulty. A plausible implication is that FORT-Searcher’s main legacy may be methodological: it provides a vocabulary and a set of measurable proxies for asking whether a search benchmark is genuinely search-heavy, rather than merely structurally elaborate.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to FORT-Searcher.