--- title: Agent-Native Mid-Training Paradigm url: https://www.emergentmind.com/topics/agent-native-mid-training-paradigm type: topic --- # Agent-Native Mid-Training Paradigm Agent-Native Mid-Training Paradigm refers to a spectrum of training algorithms and data regimes for instilling agentic behaviors—such as planning, tool-use, reflection, or multi-agent coordination—directly within model or agent parameters, at an intermediate stage between pretraining and downstream post-training. Unlike pipeline-based systems, where agentic capabilities are modularized and orchestrated by external scripts or policies, agent-native mid-training emphasizes the internalization and direct optimization of agent workflows, feedback loops, and interactive environment signals, either within fixed model weights or via structured adaptive context. This paradigm encompasses a wide array of methodologies: trajectory-centric next-token modeling on agentic data, in-place reinforcement learning from agent execution, meta tool learning and self-reflection without weight updates, multi-agent mid-training with interaction-centric objectives, and function-library adaptation with model weights frozen. Across domains—software engineering, STEM, multimodal reasoning, tool-based research, and multi-agent environments—agent-native mid-training marks a methodological pivot towards agents that learn, adapt, and specialize through authentic, dynamic experience rather than static demonstrations or scripted scaffolds. ## 1. Defining Agent-Native Mid-Training: Foundations and Motivation Agent-native mid-training (ANMT) is the intermediate training regime that bridges large-scale unsupervised pretraining and data-intensive supervised or reinforcement learning (RL) post-training. Its key distinction is the use of agent-native data: supervision that encodes the full action-observation-feedback sequences native to autonomous agents operating in authentic environments. In formal terms, given a policy $\pi_\theta$, observations $\mathrm{Obs}$, and an agent-native trajectory corpus $\mathcal{D}_{\text{MT}}$, the objective is: \[ \mathcal{L}_{\rm MT}(\theta) = -\sum_{(x,y) \in \mathcal{D}_{\rm MT}} \sum_{t=1}^{|y|} \log p_\theta(y_t|x_{, , , etc.), branching at critical action or failure points [2512.24618]. ## 3. Training Algorithms and Optimization Objectives The ANMT paradigm encompasses varying learning modalities and objectives, including: - **Trajectory-centric next-token modeling:** Standard cross-entropy loss on assistant- or agent-output tokens in agentic trajectories, often with segment masking to focus learning on agent behaviors [2512.24618, 2601.18418]. - **Reinforcement learning from native execution (Agent Lightning):** Treats agent executions as Markov Decision Processes (MDPs), logging tuples $(s_t, a_t, r_t)$ at runtime and applying hierarchical RL (e.g., GRPO) on transitions without altering agent orchestration logic [2508.03680]. \[ \mathcal{L}(\theta) = -\,\mathbb{E}_{x\sim\mathcal{X}}\,\mathbb{E}_{(s_t, a_t)\sim\tau} \left[\,\sum_{j=1}^{N_t}\log\pi_\theta(y_{t,j}\mid s_t,y_{t,