FORT-Searcher: Shortcut-Resistant Search Agent
- FORT-Searcher is a deep search agent that uses shortcut-resistant data synthesis to ensure answers remain inaccessible until sufficient evidence is gathered.
- It employs the FORT pipeline, which constructs complex evidence graphs and formulates verifiable questions that prevent easy shortcut exploitation.
- Empirical results show that its methodology delays answer exposure and improves performance compared to other open-source search agents.
Searching arXiv for FORT-Searcher and closely related search-agent papers to ground the article. Searching arXiv for the specific paper and related deep search agent work. FORT-Searcher is a deep search agent and, more fundamentally, the name associated with a shortcut-aware data synthesis program for training such agents. It is introduced together with FORT, a “Framework of Shortcut-Resistant Training-Data Synthesis,” to address a specific failure mode in search-agent training: structurally complex questions can still be easy in practice if a model can reach the answer through a shortcut route. The central claim is that realized search difficulty is governed not only by graph size or hop count, but by whether the answer remains unavailable until sufficient evidence has been acquired through search. On this basis, FORT defines shortcut-aware difficulty, operationalizes four shortcut risks, synthesizes training data that suppresses them, and uses the resulting trajectories to train FORT-Searcher with supervised fine-tuning only (Deng et al., 10 Jun 2026).
1. Definition and problem setting
FORT-Searcher belongs to the class of deep search agents: LLM-based, tool-empowered systems that interact with external environments, gather evidence over multiple turns, and synthesize scattered information before answering. The work defines the training problem in terms of verifiable questions whose answers remain unavailable until sufficient evidence has been acquired through search, so that the resulting trajectories reward multi-turn query formulation, evidence discovery, evaluation, and integration rather than shallow retrieval (Deng et al., 10 Jun 2026).
A central distinction is drawn between intended or structural difficulty and realized difficulty. The paper argues that increasing structural complexity—such as adding more hops or widening an evidence graph—does not guarantee that a search process will remain hard in practice. A question may still collapse through what the work calls a “cheaper identifying route,” or through solver prior knowledge. This motivates a shortcut-aware formulation of difficulty in which the effective challenge is determined by the cheapest route that identifies the unique gold answer under the retrieval interface, rather than by surface graph properties alone (Deng et al., 10 Jun 2026).
The task is formalized as a multi-constraint agentic retrieval problem
where is the answer space, is the set of constraint clues expressed by the question, and is the retrieval interface. For any subset , the remaining candidate pool is
A well-posed question satisfies , where is the gold answer (Deng et al., 10 Jun 2026).
This framing positions FORT-Searcher within a broader shift in search-agent research from maximizing apparent task complexity to controlling realized search cost. A plausible implication is that data synthesis quality, rather than model size alone, becomes a first-order determinant of search-agent behavior.
2. Shortcut-aware difficulty framework
The shortcut-aware framework centers on the difference between the cost a solver must pay if it has no prior knowledge and cannot guess unsupported answers, and the lower cost a concrete solver may realize in practice. A search trajectory is written as , where is the number of retrieval actions. The pure-posterior cost is defined as
0
For an identifying subset 1 with 2, the shortest valid evidence-acquisition route cost is
3
The structural lower bound is then
4
The realized successful-trajectory cost of a concrete solver 5 is
6
with solver-side cost reduction
7
so that
8
This separates route-level shortcut structure from solver-level exploitation of prior knowledge (Deng et al., 10 Jun 2026).
Three structural factors shape the cheapest identifying route. Subset selectivity is
9
so small 0 for a small subset can identify the answer early. Evidence dispersion is
1
so co-coverage by a single page or snippet lowers the effective route cost. Dependency depth is
2
which captures the longest serial dependency chain and is reduced by exposed intermediate constants (Deng et al., 10 Jun 2026).
The paper states the proposition
3
hence
4
It also gives a collapse corollary: if some identifying subset can be verified by a single initially executable query, then 5 (Deng et al., 10 Jun 2026).
The framework operationalizes four shortcut risks.
| Shortcut risk | Mechanism | Effect on difficulty |
|---|---|---|
| Single-clue selectivity | One clue or small clue subset is overly identifying | Shrinks exploration |
| Evidence co-coverage | One item verifies multiple intended constraints | Lowers evidence-acquisition cost |
| Exposed constants | Intermediate names, dates, or numbers appear on the question surface | Shortens dependency chains |
| Prior-knowledge binding | Model names the answer before retrieval anchors it | Reduces realized cost below structural cost |
To diagnose realized effects at scale, the paper introduces trajectory signatures. Realized solving cost is
6
answer hit time uses
7
and dataset average
8
The observable proxy for prior binding is the prior-shortcut rate
9
Later 0 indicates longer pre-answer search, while large gaps between 1 and 2 indicate post-hit verification or detours (Deng et al., 10 Jun 2026).
3. FORT synthesis pipeline
FORT constructs shortcut-resistant training data in four stages: graph initialization, evidence graph construction, question formulation, and adversarial refinement. The synthesis workspace is an internal evidence graph whose nodes are entities and whose edges are verified facts with sources and dependencies. The stated objective is to preserve route-level difficulty while reducing solver-level shortcuts (Deng et al., 10 Jun 2026).
In graph initialization, the root entity 3 is selected from Wikidata, with preference for long-tail entities, including entities without English Wikipedia pages, to reduce prior-knowledge binding. The system also uses cycle-based seeds: it pre-mines a cycle library from Wikidata, builds a pair index, enumerates small cycles, removes duplicates and unsuitable hub-based or redundant cycles, and stores an inverted index 4 such that 5 lists retained cycles containing entity 6. If 7, one cycle is used as the initial subgraph 8; otherwise the seed is a single-node graph (Deng et al., 10 Jun 2026).
Evidence graph construction targets evidence co-coverage and single-clue selectivity. Starting from 9, expansion proceeds under a depth limit 0 and a node-addition budget 1, expanding deepest nodes first to preserve serial dependencies. Facts are collected from heterogeneous sources, including Wikidata, web pages, structured databases, and Google Scholar or Maps. The system performs multi-source enrichment, prefers distributing root-node facts across sources, and avoids verifying multiple selected facts on the same page (Deng et al., 10 Jun 2026).
The paper’s evidence graph construction algorithm is:
32
Derived facts are used to reduce exact-match shortcuts and include coincidence bridging, count aggregation, numerical relation, and meta-fact extraction. Fact verification filters contradictions and entity-consistency failures such as similar names, ambiguous abbreviations, temporal or geographic drift, and series–edition mismatch. Fact selection then prefers generic facts that are reliable but non-representative in isolation, so that only combinations of clues identify the answer (Deng et al., 10 Jun 2026).
Question formulation then chooses an answer node 2 and a subgraph 3. Intermediate names are withheld and rendered as descriptions such as “the artist,” “the institution,” or “the work,” so downstream queries are not executable initially. Exact values are fuzzed into truthful but less directly searchable constraints through category generalization, range relaxation, meta-attribute description, arithmetic encoding, and contrastive exclusion. The formulation is explicitly required to remain verifiable and resolvable through evidence, avoiding ambiguity and over-fuzzing (Deng et al., 10 Jun 2026).
4. Adversarial refinement and shortcut suppression
Adversarial refinement calibrates realized difficulty in actual search. A strong search-agent adversary is run on each draft question, trajectory signatures are measured, and the question is repaired if it is shortcut-prone, ambiguous, or over-fuzzed. The acceptance criteria require that the adversary answer correctly, use at least a minimum desired solving cost threshold, exhibit sufficiently late answer hit time, and show no prior binding, meaning the model must not name the answer before evidence (Deng et al., 10 Jun 2026).
Repair actions depend on failure mode. If a draft is solved too quickly or exposes the answer early, the system replaces co-covered evidence, removes overly selective facts, and withholds or fuzzes exposed constants. If it is prior-bound, the root entity is replaced with a long-tail alternative or the evidence path is strengthened. If it is unsolved within budget, interpreted as over-hard or underspecified, the system narrows fuzzed clues, removes ambiguity, or restores necessary constraints (Deng et al., 10 Jun 2026).
The paper gives two case studies. In one shortcut repair, broadening “shot down by the Soviet Union” to “shot down by a certain country during the Cold War,” and relaxing a runtime digit-sum constraint from “sum to 10” to “sum to a multiple of 5,” removed a cross-domain triangulation shortcut. In one narrowing repair for over-fuzzed clues, “a certain European capital” was replaced with “the capital of a federal republic in Central Europe,” and “a certain year” with “mid-20th century,” to restore solvability while maintaining obfuscation (Deng et al., 10 Jun 2026).
This stage is central to the paper’s claim that shortcut resistance cannot be guaranteed by static graph design alone. The work treats actual search trajectories, not only graph templates, as the criterion for difficulty. This suggests that the FORT pipeline is best understood not as a pure synthesis engine, but as an overview-and-calibration loop.
5. FORT-Searcher agent and training procedure
FORT-Searcher is trained on FORT-generated trajectories with supervised fine-tuning only. The backbone is Qwen3-30B-A3B-Thinking-2507, with approximately 3B active parameters at inference and a 256K context window. Within a rollout, all tool-call results are retained so that accumulated evidence can be reused. If the model reaches a predefined turn limit without producing a final answer, the interaction history is cleared and the agent restarts from the original question. The rollout limits are 300 for BrowseComp and BrowseComp-ZH, and 200 for xbench-DeepSearch-2505, xbench-DeepSearch-2510, and Seal-0 (Deng et al., 10 Jun 2026).
The training recipe is standard supervised token-level learning rather than a custom reinforcement objective. The reported optimization setup uses bf16 precision; Adam with 4, 5, 6, weight decay 7, and gradient clipping 8; a cosine schedule with peak learning rate 9, minimum learning rate 0, and 1 warmup iterations; tensor parallelism 2; pipeline parallelism 3; context parallelism 4; expert parallelism 5 for the MoE architecture; sequence parallelism; activation recomputation; and a distributed optimizer. Hyperparameters are 6 epochs, global batch size 7, and maximum sequence length 8 tokens (Deng et al., 10 Jun 2026).
In comparative context, this training philosophy differs from recent multimodal or web search agents that rely on SFT-then-RL pipelines, such as VSearcher, which adopts an SFT-then-RL procedure with GRPO in real web environments (Zhang et al., 3 Mar 2026), and from openly released SFT-only search systems such as OpenSeeker, which emphasizes fact-grounded QA synthesis and denoised trajectory synthesis over 9k synthesized samples (Du et al., 16 Mar 2026). FORT-Searcher’s distinguishing claim is narrower and more specific: the decisive factor is shortcut-resistant synthesis rather than broader scale or reinforcement learning (Deng et al., 10 Jun 2026).
6. Empirical performance, diagnostics, and position in the literature
FORT-Searcher is evaluated on BrowseComp, BrowseComp-ZH, xbench-DeepSearch-2505, xbench-DeepSearch-2510, and Seal-0, with Hugging Face domains blocked during testing. Its reported scores are BrowseComp 0, BrowseComp-ZH 1, xbench-05 2, xbench-10 3, Seal-0 4, and overall 5, which the paper describes as the best overall performance among comparable-size open-source search agents (Deng et al., 10 Jun 2026).
| Agent | BrowseComp | BrowseComp-ZH | xbench-05 | xbench-10 | Seal-0 | Overall |
|---|---|---|---|---|---|---|
| FORT-Searcher | 72.2 | 75.0 | 80.8 | 57.2 | 46.0 | 66.2 |
| MiroThinker-1.7-mini | 67.9 | 72.3 | 77.2 | 57.2 | 48.2 | 64.6 |
| Qwen3.5-35B-A3B | 61.0 | 69.5 | 77.4 | 50.3 | 41.4 | 59.9 |
| OpenSeekerV2 | 46.0 | 58.1 | 78.0 | 43.4 | 41.4 | 53.4 |
| Tongyi DeepResearch | 43.4 | 46.7 | 75.0 | 47.5 | 45.8 | 51.7 |
The context-reset mechanism materially affects performance. With versus without context reset, the paper reports BrowseComp 6 vs. 7, BrowseComp-ZH 8 vs. 9, xbench-05 0 vs. 1, xbench-10 2 vs. 3, and Seal-0 4 vs. 5 (Deng et al., 10 Jun 2026). This suggests that restart-based exploration of alternative routes is important when long trajectories accumulate unproductive context.
The more distinctive evidence concerns dataset difficulty. On 200 sampled questions per dataset using the same adversary and budget, FORT yields 6, 7, and 8. By contrast, OpenSeeker yields 9, 0, and 1; REDSearcher yields 2, 3, and 4; DeepResearch-9K yields 5, 6, and 7; DeepDive yields 8, 9, and 0; InfoSeek yields 1, 2, and 3 (Deng et al., 10 Jun 2026). The paper interprets this as evidence that FORT delays answer exposure and induces longer pre-answer search rather than merely longer post-hit detours.
A controlled training-data analysis strengthens that interpretation. Four 12K-example training settings are compared. Open-source data at 4 gives 5, 6, BrowseComp 7, and BrowseComp-ZH 8, whereas FORT at the same approximate solving cost gives 9, 00, BrowseComp 01, and BrowseComp-ZH 02 (Deng et al., 10 Jun 2026). This is the paper’s main empirical support for the claim that longer trajectories alone are insufficient; what matters is delaying answer exposure and reducing prior binding.
The cumulative shortcut-resistance ablation on 2K synthesized questions shows that removing any component makes questions easier. The full system yields accuracy 03, 04, 05, and 06. Removing fuzzing changes these to 07, 08, 09, and 10, representing the largest difficulty drop among the ablations. Removing generic-fact selection yields 11, 12, 13, and 14; removing source diversity yields 15, 16, 17, and 18; removing derived-fact construction yields 19, 20, 21, and 22; removing long-tail entity selection yields 23, 24, 25, and 26; and removing cycle construction yields 27, 28, 29, and 30 (Deng et al., 10 Jun 2026).
Within the broader literature, FORT-Searcher is positioned against methods that scale question generation by graph expansion, topology control, or web-graph reverse engineering, such as OpenSeeker (Du et al., 16 Mar 2026), and against agentic systems emphasizing multimodal RL and tool-use policies, such as VSearcher (Zhang et al., 3 Mar 2026) and M31Searcher (Yu et al., 14 Jan 2026). Its specific contribution is not a new planner or reward function, but a theory-and-synthesis account of shortcut-resistant search difficulty. A plausible implication is that FORT-Searcher’s main legacy may be methodological: it provides a vocabulary and a set of measurable proxies for asking whether a search benchmark is genuinely search-heavy, rather than merely structurally elaborate.