---
title: 'Growth-Aware Search: A Design Perspective'
url: https://www.emergentmind.com/topics/growth-aware-search
type: topic
---

# Growth-Aware Search: A Design Perspective

Searching arXiv for the cited papers to ground the article in the referenced literature.
Growth-aware search denotes a set of search and retrieval methodologies that explicitly model how a system, its memory, its action policy, its content supply, its infrastructure, or its search space evolves over time. In current arXiv literature, the term appears in several technically distinct forms: reasoning-aligned memory growth in agentic search, self-aware regulation of over-search, growth-oriented query and item retrieval, search architecture design under projected web growth, carbon-frugal configuration search, and neural architecture search based on network growth [2604.17265, 2605.29796, 2602.02961, 2605.17994, 1307.1179, 2602.15423, 2403.02667]. Taken together, these works suggest that growth-aware search is best understood as a design stance rather than a single formalism: the search process is made explicitly responsive to growth dynamics that would otherwise be treated as externalities.

## 1. Scope and conceptual variants

The current literature associates growth-aware search with several different growth objects. In agentic QA, the central problem is the growth of system memory and search trajectories. In platform search and recommendation, the focus is growth in acquisition, demand, and long-term ecosystem value. At infrastructure level, the concern is the future growth of the searchable web and the resulting redesign of search architectures. In sustainable IR, growth-awareness is redirected toward controlling carbon and latency as neural systems scale. In NAS, the search space itself is traversed through network growth rather than monolithic global optimization [2604.17265, 2605.29796, 2602.02961, 2605.17994, 1307.1179, 2602.15423, 2403.02667].

| Growth object | Mechanism | Representative work |
|---|---|---|
| Memory in agentic search | Reasoning-aligned memory growth and retracing | MemSearch-o1 |
| Search actions | Search boundary modeling and boundary-aware reward | SAAS |
| Query demand and acquisition | VLM-generated queries, trend-mining agents, collection pages | Pinterest GEO |
| New-item ecosystem value | ItemLTV, MultiGR, MoPO | GrowthGR |
| Web-scale infrastructure | Snapshot plus updates; broadcast all changes | Future Web Growth |
| Carbon and latency | Semantic-guided diffusion tuning | GaiaFlow |
| Architecture search space | Gradual block-wise deepening and SuperNet pruning | G-EvoNAS |

This diversity matters because the phrase “growth-aware” does not identify a single optimization target. It identifies a common intervention point: the search system is modified so that growth is not merely tolerated, but operationalized in the control loop. A plausible implication is that comparisons across these works are more meaningful at the level of design principle than at the level of direct algorithmic equivalence.

## 2. Reasoning-aligned memory growth in agentic search

In agentic search, MemSearch-o1 addresses the “memory dilution problem” that arises when iterative think-search loops accumulate long system memories through stream-style concatenation. Its core shift is from linear accumulation to “reasoning-aligned memory growth and retracing.” The framework first performs **Memory Seed Token Selection**, decomposing the current query into memory seeds grouped by semantic role—**Subjects**, **Actions**, **Degree Modifiers**, and **Temporal Markers**—with a spaCy POS-tagger used for automated extraction. It then performs **Dynamic Growth of Fine-Grained Memory Fragments** by retrieving top-$K$ documents and extracting concise fragments aligned to each seed. After multiple rounds, all fragments are scored by a contribution function that combines original-query relevance and bridge potential, then reorganized into a globally connected memory path by greedy search. Answer generation uses only this compact path rather than the full diluted system memory [2604.17265].

The central refinement mechanism is the contribution function
$$
C_{Rel} = \text{Sim}(\text{Emb}(\boldsymbol{m}_i), \text{Emb}(\boldsymbol{q}_o)),
$$
with overall contribution
$$
C(\boldsymbol{m}_i;\boldsymbol{q}_o) = \alpha \cdot C_{Rel} + \beta \cdot C_{BP},
$$
and fragment selection
$$
\mathcal{M}_q = \left\{ \boldsymbol{m}_i \in \mathbb{R}^d \mid  C(\boldsymbol{m}_i; \boldsymbol{q}_o) > \tau_r \right\}.
$$
The resulting path objective favors both high-contribution fragments and semantic continuity between adjacent fragments. This formalization makes memory growth selective, query-decomposed, and path-structured rather than append-only.

Empirically, the framework is reported to outperform **RAG** and baselines including **Amber**, **A-Mem**, **MemoryBank**, and **Search-o1** on **8 authoritative QA datasets**. The reported gains are especially large on multi-hop tasks, including **+21.9 F1 on HotpotQA**, **+16.5 F1 on 2WikiMQA**, and **+17.4 F1 on MuSiQue with DeepSeek V3.1 backbone**. The system is also described as maintaining strong performance as context length and search rounds grow, reducing token consumption by **\(\sim 20\%\)**, lowering inference time, and exhibiting **\(O(ND)\)** rather than **\(O(N^2 D)\)** inference efficiency. The paper further reports that the method is effective with **3B+ parameter models**. These claims position growth-aware memory management not as compression alone, but as a structured evidence-construction procedure.

## 3. Self-aware control of search expansion

A different form of growth-aware search appears in SAAS, which treats uncontrolled growth of search actions as **over-search**. The stated failure mode is that agentic systems “blindly trigger searches when internal knowledge suffices” and “fail to terminate search even when adequate evidence has been collected.” SAAS introduces **search boundary modeling**, **boundary-aware reward**, and **stage-wise optimization**. For each question \(q\), under the current policy \(\pi_\theta\), the framework samples a **search-disabled group** \(G_d(q)\) and a **search-enabled group** \(G_e(q)\), then classifies the question as **NoSearch**, **NeedSearch**, or **Undetermined** according to the number of correct answers in the two groups and a threshold \(\delta\) [2605.29796].

The boundary classification is
$$
\mathcal{S}(q) =
\begin{cases}
\text{NoSearch} & \text{if } n_d(q) \geq \delta \\
\text{NeedSearch} & \text{if } n_d(q) = 0,\, n_e(q) > 0 \\
\text{Undetermined} & \text{otherwise}.
\end{cases}
$$
Rewarding is then conditioned on that boundary. For **NoSearch**, all search actions are penalized as
$$
R_i^{\text{search}} = -\alpha N_i.
$$
For **NeedSearch**, only excess searches beyond the minimum among successful trajectories are penalized:
$$
R_i^{\text{search}} = -\alpha \max(0, N_i - N_{\min}).
$$
This penalty is activated only if the answer is correct, and training is staged so that **Stage I** uses only accuracy rewards while **Stage II** activates search-regularizing penalties.

The reported evaluation uses **ACC**, **SC**, **QOR**, and **SOR** on **seven open-domain QA datasets**. On **Qwen2.5-7B-Instruct**, the average results are reported as **48.7% ACC** and **0.97 SC** for SAAS, compared with **49.8% / 2.19** for HiPRAG, **47.6% / 1.69** for StepSearch, and **45.7% / 1.56** for RFT. For over-search, SAAS reports **6.3% SOR** and **45.9% QOR**, compared with **19.5% / 100%** for HiPRAG, **24.3% / 99.9%** for StepSearch, and **14.8% / 52.5%** for RFT. The efficiency analysis further reports a **67%** reduction in search count, from **2.94 to 0.97**, relative to outcome-based RL (**GRPO**), with “only a small dip in accuracy (**50.2%→48.7%**)”. This establishes a central corrective to a common misconception: growth-aware search is not equivalent to more search, but may require active suppression of unnecessary and redundant search expansion.

## 4. Growth-aware retrieval for acquisition and ecosystem value

In production retrieval systems, growth-aware search is applied to acquisition growth and ecosystem health rather than to memory or action control. Pinterest GEO reframes optimization around **Generative Engine Optimization (GEO)** and “reverse search design”: instead of generating image captions that describe what content is, the system fine-tunes **Qwen2-VL-7B-Instruct** with **LoRA** to predict what users would actually search for. The generated queries are divided into **Description queries (30%)**, **Style/detail queries (30%)**, and **Use-case (intent) queries (40%)**. Training data are retained by a rule over **impressions**, **CTR**, and **position**, and are supplemented with **~200K GPT-4V-labeled synthetic pairs**. AI agents mine external trend signals using tools including `fetch_trends(region, timespan)`, `semantic_filter(trend, threshold)`, `content_lookup(query)`, and `expand_query(trend, taxonomy)`; the resulting queries drive semantically coherent **Collection Pages** retrieved through **Manas** HNSW infrastructure and multimodal models including **PinCLIP** and **SearchSAGE** [2602.02961].

The reported metrics are explicitly growth-oriented. For query generation, the paper reports **ROUGE-1 F1** of **0.63** for Description and **0.34** for Use-case, with **\(>93\%\)** semantic LLM evaluation on relevance, specificity, diversity, and coverage. Human ratings report **+19% relevance over ANN baseline** and **+88% use-case accuracy**. Traffic lift is reported as **+18% organic traffic** relative to ANN. For collection pages, **PinCLIP** reports **0.881** offline intent matching, while **SearchSAGE** reports **0.127** signup rate and **1.66** clickthrough rate. Production A/B tests report **1.18×** user sessions and **9.2×** GEO traffic multiplier for the **VLM-enabled** system, with deployment at **billions of images** and **tens of millions of collections**, **94× lower inference cost** than commercial VLM APIs, and **20% organic traffic growth** contributing to **multi-million MAU growth**. In this setting, growth-aware search is explicitly aligned with organic acquisition and generative retrieval visibility.

GrowthGR applies an analogous logic to e-commerce search, but its growth object is **new item growth** and **overall ecosystem value**. The framework combines an **Item Long-term Transaction Value Prediction (ItemLTV)** module with a **Multi-Value-Aware Generative Retrieval (MultiGR)** module trained by **Multi-Value-Aware Policy Optimization (MoPO)**. The treatment variable is a user click \(W_i = 1\), the potential outcomes are future average daily orders, and uplift is modeled as
$$
\tau(X_i) = E[\log(Y_i(1)+1) - \log(Y_i(0)+1) \mid X_i].
$$
ItemLTV uses a two-tower architecture separating **base growth** and **uplift prediction**, while MultiGR builds on **semantic-ID-based generative retrieval architecture**, **RQ-VAE quantization**, **trie-based masking**, and **beam search**. The paper frames the problem as counteracting the **“Matthew effect”** by explicitly balancing short-term GMV with long-term growth potential [2605.17994].

The reported deployment on **Taobao's production platform** yields a **5.3% lift in new item GMV**, a **0.3% gain in overall search GMV**, a **1.5% lift** in **Page View Ratio (PVR) to New Items**, and **+20% improvement** in **TI@30**. Offline, ItemLTV reduces **MSE from 1.348 to 1.329** and improves **NDCG from 0.842 to 0.853**; for retrieval, **GrowthGR Two-Stage** reports **Long-term Recall@1000: 0.9261** versus **0.8772** for **DR**, and **Long-term NDCG: 0.4801** versus **0.4119**. The platform analysis states that GrowthGR improved GMV in **over 70% of top categories**. This literature treats growth-aware search as multi-value alignment: retrieval is optimized not only for immediate exposure and conversion, but also for the long-term transaction trajectory of underexposed items.

## 5. Search architectures under scale growth and sustainability constraints

A more infrastructural sense of growth-aware search appears in work on projected web growth. “Future Web Growth and its Consequences for Web Search Architectures” estimates that by **2050** the indexable web may contain about **0.5 trillion pages**, with **37 PB** of text content and an index size of about **4 PB** under a conservative **11%** ratio. The paper further projects **hard drive capacity** beyond **300 EB** per device by 2050 and identifies crossover points at which the **entire web index fits on HDD (~2020)**, **entire text content fits on HDD (~2025–2030)**, **index fits on SD card (~2035)**, and **content fits on SD card (~2039–2043)**. On that basis, it proposes new architectures in which the user device stores a pre-loaded **snapshot** or **“back-file”** of the web and queries only the difference between the snapshot date and the current time, or alternatively a **broadcast all changes** model in which no data center is needed [1307.1179].

The two architectural models are technically distinct. In **Snapshot Plus Updates (“Backfile + Diff”)**, the local device searches the snapshot and the data center serves date-sharded updates. In **Broadcast All Changes (Star Network)**, all changes to all files are broadcast to all users, allowing each device to maintain an always-up-to-date local copy. The stated implications include **offline search**, reduced centralization, more privacy, and a diminished role for real-time data-center search. This work uses projected growth of corpus size and storage capacity as the primary design variable.

GaiaFlow addresses a different scaling pressure: the growth of environmental cost in neural retrieval. It formulates **carbon-frugal search** through **semantic-guided diffusion tuning**, **retrieval-guided Langevin dynamics**, **hardware-independent performance modeling**, **adaptive early exit protocols**, and **precision-aware quantized inference**. The latent search process follows
$$
z_{t+1} = z_t - \gamma_1 \nabla_z U(D(z_t)) + \gamma_2 \nabla_z V(q,z_t) + \sqrt{2\gamma_3}\,\xi_t,
$$
where the “green potential” is
$$
U(\hat{\omega}) = \alpha\,\text{Carbon}(\hat{\omega}) + \beta\,\text{Latency}(\hat{\omega}) + \gamma\,\text{Effectiveness}(\hat{\omega}).
$$
Carbon and latency are modeled from **Mop** and **Flop** counts, and the paper reports **online calibration (EW-RLS)**, **PUE correction**, and transfer “across CPU architectures” [2602.15423].

On **MS-MARCO (9.9M passages, 6980 queries)**, GaiaFlow reports **Recall@1000: 0.859**, **Latency: 9ms (Intel), 10ms (AMD)**, **Operation Count: 4 million**, and **Carbon: 2.18 mg**. The paper states that this is within **0.1%** of the best possible recall, with carbon reduced by **≈27% compared to BM25** and **\(\gg 75\%\)** versus **SPLADE**. Removing semantic attraction is reported to leave recall unchanged but incur **+10% latency**, **+9.5% operations/carbon**, and **+15% sampling steps**. Cross-platform latency prediction is reported with **\(R^2 > 0.986\)** and **<0.45ms** error. This work extends growth-aware search into sustainable IR: growth is not only a matter of larger corpora or longer trajectories, but also of constraining the carbon and latency externalities of increasingly sophisticated rankers.

## 6. Network growth as a search strategy

In NAS, growth-aware search denotes a search procedure that grows the candidate model itself. G-EvoNAS starts from a shallow network and “gradually deepens different Blocks.” At each stage, only one additional block is searched and evolved, with the already optimized blocks propagated forward. The SuperNet is partitioned as
$$
\mathcal{S} = \mathcal{S}_1 \circ \mathcal{S}_2 \circ ... \circ \mathcal{S}_B,
$$
and after each growth stage the SuperNet is pruned according to elite individuals:
$$
\mathcal{S}_{1:i}^* = \bigcup_{j=1}^{P_{num}} \mathcal{N}_j.
$$
The search uses **uniform crossover**, **connection mutation**, **operation mutation**, and **pNSGA-III** for multi-objective environmental selection over **validation accuracy** and **model size** [2403.02667].

The stated motivation is that current NAS often narrows the search space by repeatedly stacking partial architectures or relying on manually designed benchmark modules. G-EvoNAS instead searches the global space efficiently by transforming the search into a growth process. SuperNet pruning reduces **weight coupling** and improves ranking accuracy, with **Kendall rank correlation** reported at **0.87** after pruning, compared to **0.38** for **One-Shot NAS**. The reported **Dropout rate** formalizes the shrinkage of the SuperNet search space at each depth.

The empirical results are framed primarily in efficiency. On **CIFAR10**, G-EvoNAS reports **97.52** top-1 with **3.2M** parameters at **0.2 GPU days**; on **CIFAR100**, **83.38** top-1; on **ImageNet**, **75.5** top-1 and **92.5** top-5 with **4.6M** parameters, also at **0.2 GPU days**. The paper states that G-EvoNAS can find a neural architecture “comparable to state-of-the-art designs in 0.2 GPU days.” Here, growth-aware search is neither memory growth nor action regulation, but a staged expansion of the model search space itself.

## 7. Recurring principles, misconceptions, and tensions

Across these works, several factual regularities recur. MemSearch-o1 replaces stream-style concatenation with structured fragment growth and path-based reasoning. SAAS penalizes unnecessary and redundant search rather than rewarding unbounded exploration. Pinterest GEO uses VLM-generated queries and trend-mining agents to target acquisition growth. GrowthGR balances short-term transactional value with long-term item growth to counteract the Matthew effect. The web-architecture work derives search design from projected corpus and hardware growth. GaiaFlow formalizes the trade-off between effectiveness and environmental preservation. G-EvoNAS grows the candidate architecture gradually to reduce global search complexity [2604.17265, 2605.29796, 2602.02961, 2605.17994, 1307.1179, 2602.15423, 2403.02667].

These commonalities clarify several misconceptions. First, growth-aware search is not synonymous with larger context or more aggressive search: MemSearch-o1 and SAAS both intervene precisely because uncontrolled growth degrades reasoning or efficiency. Second, it is not reducible to classical relevance optimization: GrowthGR and Pinterest GEO optimize explicitly for long-term ecosystem and acquisition signals, not only immediate matching. Third, it is not solely a systems-scaling problem: GaiaFlow shows that the relevant growth variable may be carbon cost, while G-EvoNAS shows that it may be the staged expansion of the hypothesis space. Fourth, growth-awareness does not necessarily imply more centralization; the projected web-architecture models explicitly move computation toward the client device.

A plausible implication is that future work on growth-aware search will be defined less by domain and more by control structure. The literature already contains examples of token-level memory growth, rollout-conditioned search boundaries, trend-conditioned demand discovery, counterfactual long-term value estimation, operation-count-based carbon modeling, and block-wise architectural expansion. What unifies them is the decision to place growth inside the search objective, the search state, or the search architecture itself.

Source: https://www.emergentmind.com/topics/growth-aware-search