---
title: 'LM-Searcher: LLM-Based Search Systems'
url: https://www.emergentmind.com/topics/lm-searcher
type: topic
---

# LM-Searcher: LLM-Based Search Systems

Searching arXiv for recent papers related to “LM-Searcher” and LLM-based search agents.
LM-Searcher denotes a class of language-model-centered search systems in which a large language model does not merely answer after retrieval, but participates in query interpretation, search planning, tool invocation, evidence extraction, memory management, and final synthesis. In the recent literature, the expression is used in two related senses. Broadly, it refers to LLM-based deep information-seeking systems, collaborative search agents, multimodal browsing agents, and other search-oriented controllers over external environments. Narrowly, “LM-Searcher” is also the exact title of a 2025 paper on cross-domain neural architecture search with LLMs via unified numerical encoding, where the “search” target is neural architectures rather than web evidence [2505.16834][2402.06360][2509.05657]. This suggests that “LM-Searcher” is best treated as a family resemblance term rather than a single canonical architecture.

## 1. Terminology and conceptual scope

In the deep-search literature, the basic problem is not ordinary one-shot retrieval. Questions often cannot be answered from parametric memory alone or from a single retrieved passage; instead, the model must decompose the request, decide what to search next, retrieve iteratively, summarize noisy evidence, and stop at an appropriate point. “SimpleDeepSearcher” explicitly frames this as deep information seeking and contrasts it with vanilla RAG, which often issues one retrieval query—usually the original question—and conditions generation on the returned passages [2505.16834].

Other systems extend the same search-centered idea into distinct settings. “CoSearchAgent” places the search loop inside Slack multi-party conversations, where the query may be implicit in the preceding dialogue and may require contextual rewriting before search [2402.06360]. “O\(^2\)-Searcher” treats open-domain open-ended QA as a search-control problem in which the model alternates between reasoning, search, and answer production, rather than merely generating a final answer from a fixed context [2505.16582]. “Flash-Searcher” generalizes the search-agent frame further by recasting execution as a directed acyclic graph of subtasks, allowing concurrent search and browsing branches instead of a single serialized chain [2509.25301].

At the same time, the exact title “LM-Searcher” is used by a distinct line of work in neural architecture search. There the target is not web-grounded information seeking but architecture optimization across CNNs, LoRA configurations, transformers, and audio DAGs using a universal numerical representation called NCode and an instruction-tuned LLM that selects high-performing candidates from a pool [2509.05657]. The shared theme is that an LLM is used as a search policy over an external structured space; the searched object, however, differs substantially.

## 2. Canonical control loops and architectural patterns

A recurring pattern is an interleaved reasoning–action–observation loop. In “SimpleDeepSearcher,” the search-with-think framework is organized around “reasoning-searching-summarizing-generating.” Given a prompt \(p\), the model emits reasoning \(r\), a search query \(q\) delimited by special tokens \(t_s\) and \(t_e\), receives summarized document observations \(d\), and ultimately produces answer \(a\). The reconstructed training trajectory is
\[
x=\bigl(p,\; r_1,\; t_s q_1 t_e,\; d_1,\; r_2,\; t_s q_2 t_e,\; d_2,\; \ldots,\; r_T,\; a\bigr),
\]
which makes the search policy part of the generated sequence rather than an external fixed pipeline [2505.16834].

In collaborative conversational search, the loop begins earlier, at query interpretation. “CoSearchAgent” formalizes contextual rewriting as
\[
q_{rewrite}=F_{rewrite}(U,q),
\]
where \(U\) is the multi-user dialogue context and \(q\) is the current user request. If ambiguity persists, clarification is generated via
\[
q_{clarify}=F_{clarify}(U,q_{rewrite}),
\]
after which search results are transformed into query-conditioned references and used for grounded answer generation
\[
a = F_{rag}(q_{rewrite}, REF).
\]
The important architectural point is that conversational context becomes part of the search state, not merely preamble text [2402.06360].

Several papers make the controller more explicit. “RE-Searcher” inserts a goal-oriented loop in which each search step contains a declared search goal, a query tied to that goal, and an explicit reflection judgment of whether the retrieved evidence satisfies that goal. “APEX-Searcher” separates planning from execution: a planner first emits a sequence of sub-questions \(S=\{s_1,s_2,\ldots,s_n\}\), potentially with references such as `#1`, and an executor then performs iterative retrieval for each sub-question [2509.26048][2603.13853]. “Flash-Searcher” pushes the idea further by defining a decomposition
\[
\mathcal{D}(T)=G_{\text{plan}}=(V,E),
\]
where \(V\) are subtasks and \(E\) are dependencies, so independent branches can be executed concurrently [2509.25301].

These variants differ in controller shape—linear ReAct loop, goal-reflection loop, planner–executor hierarchy, or DAG scheduler—but they share the same design move: search is treated as a policy over external actions, not as a single retrieval prelude to answer generation.

## 3. Training paradigms and supervision signals

One major divide in the literature concerns whether search capability is learned mainly from high-quality supervised trajectories or from reinforcement learning over interactive search. “SimpleDeepSearcher” is the clearest statement of the supervised position: it argues that the main bottleneck is the quality and realism of search trajectories rather than optimizer sophistication, and reports that supervised fine-tuning on only **871 curated examples** outperforms RL-based baselines on five benchmarks [2505.16834]. “OpenSeeker” makes a related claim at larger scale: using simple SFT on **11.7k synthesized samples**, it reaches strong performance on BrowseComp, BrowseComp-ZH, xbench-DeepSearch, and WideSearch, while explicitly presenting data openness as the crucial missing resource for the open community [2603.15594].

By contrast, several systems retain RL as the central training mechanism. “MemSearcher” uses end-to-end RL with multi-context GRPO, where a trajectory is composed of turn-level conversations under changing memory states, and the same trajectory-level advantage is propagated to all turn-level interactions. It is trained on the same data as Search-R1 and reports average relative gains of about \(+11\%\) on Qwen2.5-3B-Instruct and \(+12\%\) on Qwen2.5-7B-Instruct [2511.02805]. “O\(^2\)-Searcher” adopts GRPO as well, but introduces different reward structures for closed-ended and open-ended QA; the open-ended reward combines format, diversity, and factual alignment terms rather than relying on exact match alone [2505.16582]. “Deliberative Searcher” adds a constrained RL formulation in which correctness is optimized under a soft reliability constraint, with self-reported confidence \(c(s_t)\in\{1,\dots,10\}\) and a Lagrangian update over a reliability target [2507.16727].

A third line adapts training to new model families. “DLLM-Searcher” treats diffusion LLMs as potentially attractive search-agent backbones because of parallel decoding, but argues that existing dLLMs have weak reasoning and poor tool-call formatting. It therefore uses a two-stage post-training pipeline of Agentic SFT and Agentic VRPO, together with Agentic Noising and Agentic ELBO, to train only on agent-generated regions while preventing tool-response leakage inside diffusion blocks [2602.07035].

Across these works, one common implementation detail is tool-response masking. “SimpleDeepSearcher,” “MemSearcher,” “LMM-Searcher,” and “DLLM-Searcher” all state, in different forms, that externally retrieved content or tool-response tokens are masked in the loss so the model learns search and reasoning behavior rather than simply imitating environment text [2505.16834][2511.02805][2604.12890][2602.07035]. A plausible implication is that LM-Searcher training increasingly treats external observations as state rather than as output targets.

## 4. State management, environments, and memory

A second major design axis concerns what counts as the agent’s state and how that state is kept manageable. “SimpleDeepSearcher” criticizes RL methods trained only in artificial environments with static corpora and explicitly synthesizes trajectories in a real web environment using a commercial search API, raw HTML extraction, multiple reasoning paths per query, and aggressive curation of input diversity and output quality [2505.16834]. “CoSearchAgent” also uses live web search, but in a lightweight conversational wrapper: it captures the preceding 20 Slack utterances, retrieves around 10 results through SerpApi, truncates each fetched page to the first 5000 tokens, and replaces ordinary search snippets with LLM-extracted references [2402.06360].

The context-length problem becomes central in long-horizon settings. “MemSearcher” identifies the trade-off between full-history ReAct context, which preserves information integrity but grows noisily, and current-turn-only context, which is efficient but lossy. It replaces the full transcript with a bounded natural-language memory \(m_{i-1}\), so that the per-turn context becomes
\[
c_i=(q,m_{i-1}),
\]
with a maximum memory size of **1,024 tokens** and an **8K** context window [2511.02805]. “LMM-Searcher” extends the same concern to multimodal browsing: images are stored externally and represented in context only by lightweight textual identifiers \(u\), with a mapping
\[
f:\mathcal{I}\rightarrow\mathcal{U}.
\]
Visual content is loaded on demand through `fetch_image`, which turns multimodal search into a coarse-to-fine active-perception process rather than eager insertion of all images into the prompt [2604.12890].

Environment design also changes what the model learns. “O\(^2\)-Searcher” uses a locally simulated environment that combines a cached open-ended web corpus and a Wikipedia index, arguing that RL on the live web is too slow and unstable for training [2505.16582]. “Flash-Searcher” instead keeps the live-web character of the task but changes the execution substrate: the environment is navigated through a dynamically refined DAG, and multiple tool calls may be executed in parallel if the readiness predicate \(\varphi(v_i,G_t,s_t)=1\) [2509.25301].

These systems converge on a shared systems lesson: state design is not a peripheral engineering detail. Whether the agent carries raw transcript, summarized memory, UID references to visual files, or a DAG of pending subtasks materially changes both computational cost and reasoning behavior.

## 5. Evaluation regimes and empirical patterns

Evaluation is highly heterogeneous. The literature uses F1, Exact Match, LLM-as-Judge scores such as LasJ or \(ACC_L\), string-contained answer accuracy \(ACC_R\), retrieval metrics such as Recall@K and MRR, open-ended metrics such as LFS, and task-specific scores such as SPL, PE, BLEU, PER, IoU, and normalized Borda score. This suggests that “LM-Searcher” is not yet a benchmark-unified field; systems are often optimized for different search substrates and answer types.

| System | Setting | Representative reported result |
|---|---|---|
| SimpleDeepSearcher [2505.16834] | Web-grounded deep search | SFT on **871 curated samples** outperforms RL-based baselines on five benchmarks |
| MemSearcher [2511.02805] | RL search with compact memory | Average relative gains of about **+11%** on 3B and **+12%** on 7B |
| O\(^2\)-Searcher [2505.16582] | Open-ended and closed-ended QA | **0.2236** average F1 on O\(^2\)-QA local setting; **0.391** average on closed-ended QA with a 3B model |
| DLLM-Searcher [2602.07035] | Diffusion-LM search agents | Average \(ACC_R = 57.0\), \(ACC_L = 56.6\); P-ReAct gives about **15%** acceleration |
| RE-Searcher [2509.26048] | Goal-oriented robust search | **0.449** average EM on Qwen2.5-7B; lower degradation under query perturbations |
| Flash-Searcher [2509.25301] | DAG-based parallel web execution | **67.7%** on BrowseComp and **83%** on xbench-DeepSearch, with up to **35%** fewer steps |
| OpenSeeker [2603.15594] | Fully open SFT search agent | **29.5** on BrowseComp, **48.4** on BrowseComp-ZH, **74.0** on xbench, **59.4** item F1 on WideSearch |

Several empirical themes recur. First, high-quality supervised trajectory data can be surprisingly sample-efficient: the **871** examples of “SimpleDeepSearcher” and the **11.7k** examples of “OpenSeeker” are both presented as evidence that realistic, curated trajectories can rival or exceed more elaborate RL pipelines [2505.16834][2603.15594]. Second, robustness metrics matter. “RE-Searcher” explicitly measures instability through “always right” and “random right” categories and studies perturbations created by deleting, adding, or replacing a word in a search query, reporting that explicit search-goal articulation and self-reflection improve resilience to noisy retrieval [2509.26048]. Third, speed and parallelism are becoming first-class objectives. “Flash-Searcher” reports fewer outer execution steps by increasing tool calls per step, while “DLLM-Searcher” attacks latency by overlapping tool execution with continued diffusion-style decoding [2509.25301][2602.07035].

## 6. Domain-specific and modality-specific variants

The LM-Searcher pattern appears in a wide range of specialized domains. In collaborative search, “CoSearchAgent” is a Slack-native LLM plugin that rewrites context-dependent requests, asks a clarifying question when needed, retrieves web results, extracts query-relevant references from pages, and returns cited answers to all users in the conversation [2402.06360]. In agriculture, “Language-Guided Object Search in Agricultural Environments” uses GPT-4o mini to score object-to-object semantic priors \(p(x_t\mid x_s)\), converts those priors into waypoint scores
\[
s(w_i)=\sum p(x_t\mid x_{s_i}),
\]
and plans search paths for a Boston Dynamics Spot robot, reporting **0.80** success rate and **0.67** SPL in real-world trials [2503.01068].

In finance, “FinSearch” turns the search problem into graph-structured execution over financial APIs. It decomposes a question into a DAG \(G(V_i,E_{ij})\), assigns each node to Yahoo Finance, NewsAPI, or GoogleSearch, rewrites downstream sub-queries based on intermediate results, and weights evidence by temporal proximity through
\[
x_{\text{weight},i}=
\begin{cases}
\frac{24}{|t-x_{\text{t},i}|}, & |t-x_{\text{t},i}|<72\\
0, & |t-x_{\text{t},i}|\ge 72
\end{cases}.
\]
On FinSearchBench-24, it reports **76.20%** with GPT-4o and substantial gains over Perplexity Pro [2502.15684].

Formal mathematics yields yet another specialization. “Lean Finder” is a dense retrieval system for Lean and mathlib that maps natural-language user queries, informalized statements, proof states, and noisy formal fragments into a shared embedding space with Lean declarations, and aligns the retriever using feedback and retrieval-adapted DPO. It reports over **30%** relative improvement on informalized statements and a real-user Top-3 preference rate of **81.6%** [2510.15940].

Finally, the exact-title paper “LM-Searcher” defines search over neural architectures rather than documents. It encodes architectures as numerical strings called NCode, reformulates NAS as candidate selection
\[
a^*=\underset{a\in C}{\arg\max}\;P(a),
\]
and instruction-tunes LLaMA-3.1-8B on **228k** optimization trajectories constructed by pruning-based subspace sampling [2509.05657]. This narrow usage preserves the core search-agent motif—an LLM chooses among external structured alternatives—but divorces it from retrieval over text or the web.

## 7. Recurrent bottlenecks, controversies, and open directions

Several contested design questions organize the field. One concerns data versus optimizer. “SimpleDeepSearcher” argues that better trajectories can beat better trainers, while “OpenSeeker” presents open training data as the decisive missing variable for reproducing frontier search agents [2505.16834][2603.15594]. Another concerns realism versus controllability. Systems trained in static local corpora avoid live-web cost and instability, but papers such as “SimpleDeepSearcher” criticize distributional mismatch, whereas “MemSearcher” explicitly notes that its evaluation remains tied to a local Wikipedia-based environment even though real-web generalization is only partially tested [2505.16834][2511.02805].

A second controversy concerns trustworthiness. “Deliberative Searcher” argues that retrieval and multi-step reasoning are insufficient if the model remains miscalibrated, and introduces a reliability reward based on alignment between correctness and self-reported confidence [2507.16727]. “Know Where to Go” pushes the issue down to the source level, treating existence, accessibility, consistency, validity, and evidence precision as core retrieval properties rather than afterthoughts [2310.12443]. This suggests that LM-Searcher research is shifting from “can it retrieve?” toward “can it know when retrieved evidence is enough, and can it justify what it trusts?”

A third bottleneck is fragility under environmental complexity. “RE-Searcher” quantifies how tiny query perturbations can send an agent into different retrieval basins, producing unstable search trajectories [2509.26048]. “Flash-Searcher” treats serial execution itself as a major source of inefficiency, replacing long linear tool-use chains with DAG-based parallelism [2509.25301]. “MemSearcher” argues that the transcript-as-state convention creates context explosion, while “LMM-Searcher” shows that multimodal versions of the same problem require external file-based visual memory [2511.02805][2604.12890].

The resulting picture is not one of convergence on a single LM-Searcher blueprint. Rather, the literature repeatedly returns to a small set of bottlenecks—trajectory realism, search robustness, calibration, context management, latency, and data openness—and proposes different architectural remedies depending on the search domain. This suggests that the modern LM-Searcher is less a finished model class than an evolving systems paradigm for coupling LLM reasoning with external search spaces.

Source: https://www.emergentmind.com/topics/lm-searcher