Teacher-Guided Sampling

• Teacher-guided sampling is a method where a teacher, ranging from human experts to pretrained models, intentionally selects data to enhance learning outcomes.
• Techniques include Bayesian teaching, selective masking in vision models, and student-centric sampling in sequence and RL tasks, each optimizing data utility.
• The approach balances teacher intervention with student autonomy, using filtering, ranking, and latent-space exploration to improve performance without over-reliance.

Searching arXiv for recent and directly relevant papers on teacher-guided sampling and closely related formulations. Teacher-guided sampling denotes a class of learning procedures in which a teacher—such as a human instructor, a pretrained model, a verifier-endorsed policy, or a pedagogical data generator—affects which samples, tokens, trajectories, patches, or answers are presented to the learner. Unlike i.i.d. sampling, these methods treat data as intentionally selected, filtered, ranked, mixed, or corrected for informativeness, reliability, or compatibility with the current student. In the literature, the phrase spans Bayesian teaching, pedagogical learning, exposure-bias mitigation in sequence models, distillation data construction, verifier-filtered on-policy reinforcement learning, attention-guided masked image modeling, and reasoning-aware robot fine-tuning (Ouyang et al., 2017, Jr et al., 2016, Mihaylova et al., 2019, Xu et al., 8 Jun 2026).

1. Conceptual foundations and formal interpretations

The earliest formulations of the idea do not begin with neural distillation, but with a change in the data-generating assumption. “Pedagogical learning” explicitly rejects the view that training examples are merely i.i.d. samples from an uninformative source. Instead, the learner assumes that examples were chosen intentionally by a helpful teacher, and therefore contain additional information about the target concept (Ouyang et al., 2017). In a behavioral study on teaching regular expressions, teachers produced corpora with strong clustering structure under edit distance threshold 2, with the number of clusters per corpus about 3.27 and $p < 0.0001$; the resulting pedagogical learner $L_1$ could substantially outperform the non-pedagogical learner $L_0$, with reported cases of $L_0$ accuracy around 0.25 and $L_1$ accuracy around 0.8 (Ouyang et al., 2017).

Bayesian teaching makes this intuition explicit by defining a teaching distribution over data $x$ for a target hypothesis $\lambda$:

$$p_T(x \mid \lambda) = \frac{\pi_L(\lambda \mid x)}{\int_x \pi_L(\lambda \mid x)\,dx} \propto \frac{\mathcal{\ell}_L(x \mid \lambda)}{m_L(x)}.$$

The teacher therefore prefers data that are likely under the intended hypothesis and unlikely under competing hypotheses, since the denominator penalizes evidence that many hypotheses could explain (Jr et al., 2016). In topic-model teaching, this formalism was combined with sequential importance sampling and pseudo-marginal Metropolis-Hastings to approximate otherwise intractable teaching probabilities, and the resulting teaching documents differed markedly from random samples while improving topic recovery especially when only a small number of documents was available (Jr et al., 2016).

A related geometric line of work studies teaching a manifold through teacher-selected points or demonstrations. In the point-based setting, a unit circle $S^1$ can be taught with 3 appropriately spaced points, whereas the paper gives a construction suggesting that a torus $T^2$ can require 51 points, and proves that for a closed orientable surface $L_1$0 the minimal teaching number is bounded by $L_1$1 (Wang et al., 2019). When demonstrations are allowed, however, the learner can interpret structured sequences such as $L_1$2 as loops, and the minimal teaching number for a closed orientable surface of genus $L_1$3 is bounded by $L_1$4 sequences, each of at most 4 points (Wang et al., 2019). This establishes a central theme that reappears in later neural work: teacher guidance is not only about choosing better samples, but also about choosing a more informative communication protocol.

Setting	Teacher role	Representative papers
Pedagogical inference	Select informative examples	(Ouyang et al., 2017)
Bayesian teaching	Sample data to maximize learner posterior	(Jr et al., 2016)
Manifold teaching	Provide points or demonstrations	(Wang et al., 2019)
Sequence modeling	Mix, replace, or filter prefixes/tokens	(Mihaylova et al., 2019, Xu et al., 2024)
Distillation and RL	Rank answers or inject verified rollouts	(Hu et al., 26 May 2026, Xu et al., 8 Jun 2026)
Vision and robotics	Guide masking or reasoning supervision	(Jiang et al., 2023, Vo et al., 25 May 2025)

2. Sequence construction, exposure bias, and distillation data design

In autoregressive sequence generation, teacher-guided sampling often arises as a response to exposure bias. “Scheduled Sampling for Transformers” adapts scheduled sampling to the Transformer by introducing a two-decoder-pass strategy with the same decoder parameters used twice: a first pass under teacher forcing to obtain predictions, a mixing step that constructs a new reference sequence, and a second pass conditioned on the mixed sequence, whose outputs are used for the cross-entropy loss (Mihaylova et al., 2019). The teacher-forcing probability follows a linear decay schedule

$L_1$5

and the model can mix teacher and model predictions through argmax token embedding, top-$L_1$6 embedding mix, softmax mix, Gumbel Softmax mix, or sparsemax mix. The best test result reported is JA–EN with Gumbel Softmax mix $L_1$7 at 20.87 BLEU, slightly above the baseline test score of 19.46, whereas argmax-only replacement is much weaker, with DE–EN test 20.57 and JA–EN test 15.13 (Mihaylova et al., 2019).

A second sequence-level mechanism appears in “Speculative Knowledge Distillation,” where the student proposes tokens and the teacher replaces poorly ranked ones according to a simple top-$L_1$8 rule:

$L_1$9

If the student proposal is not in the teacher’s top-$L_0$0, the token is resampled from the teacher distribution (Xu et al., 2024). The paper uses $L_0$1 in the main experiments, reports that a broad range $L_0$2 works well, and interprets small $L_0$3 as more supervised-KD-like and large $L_0$4 as more on-policy-KD-like (Xu et al., 2024). This construction is teacher-guided sampling in a literal sense: the sampled training sequence is partially student-generated, but teacher-filtered to keep prefixes within regions the teacher considers plausible.

Teacher guidance can also operate one level higher, over entire candidate outputs. In “Sampling and Filtering of Neural Machine Translation Distillation Data,” the teacher produces 12 beam-search hypotheses per source sentence, and those hypotheses are then scored against the human reference using BLEU, ChrF, TER, SP, or decoder score (Zouhar, 2021). The paper studies top-$L_0$5 selection $L_0$6, skewed upsampling $L_0$7, thresholding $L_0$8, deduplication, and combined sampling. The central empirical result is that upsampling high-quality teacher hypotheses and mixing them with the original corpus works best, with

$L_0$9

highlighted as the best-performing configuration, giving about $L_0$0 BLEU over the common baseline $L_0$1 (Zouhar, 2021). Here the teacher guides not the decoding path directly, but the construction and weighting of the student’s training set.

3. Student-centric and latent-space forms of teacher-guided distillation

A major development in later work is the shift from teacher-centric supervision to student-aware sampling. “The Strongest Teacher Is Not Always the Best Teacher” studies the case where each question $L_0$2 has multiple verified correct teacher answers $L_0$3, and shows in a controlled comparison that higher teacher accuracy does not consistently imply higher student accuracy (Hu et al., 26 May 2026). The proposed Student-Centric Answer Sampling (SCAS) ranks candidate answers by a forward-only proxy for student-centric learning cost. For answer and question token sets $L_0$4 and $L_0$5, the paper defines

$L_0$6

and then scores answers via

$L_0$7

with lower $L_0$8 meaning more learnable for the current student (Hu et al., 26 May 2026). Rather than always selecting the output of the strongest teacher, SCAS samples from the lowest-cost group after sorting candidate answers by this score.

Another form of teacher-guided sampling appears in Teacher Guided Training (TGT), where the teacher is not only a labeler but also a generator that defines a low-dimensional latent manifold. The target synthetic example is formulated as

$L_0$9

so the synthetic point should maximize student–teacher disagreement while remaining on or near the data manifold (Zaheer et al., 2022). The paper proposes zero-order exploration by isotropic latent perturbation,

$L_1$0

and first-order exploration by gradient ascent in latent space,

$L_1$1

The theoretical motivation is a reduction in complexity from the ambient input dimension $L_1$2 to the latent dimension $L_1$3, and empirically TGT improves accuracy across image classification, text classification, and retrieval, with low-data ImageNet experiments behaving like a $L_1$4 increase in effective sample size relative to normal training (Zaheer et al., 2022).

“Teacher-Guided Student Self-Knowledge Distillation Using Diffusion Model” moves the guidance mechanism into feature space. DSKD does not directly align teacher and student features; instead it trains a diffusion model on teacher features, starts reverse diffusion from the student feature, and guides each denoising step with the teacher classifier (Wang et al., 2 Feb 2026). The classifier-guided sampling step is

$L_1$5

so the teacher contributes a class-discriminative gradient field rather than a feature target (Wang et al., 2 Feb 2026). The denoised student feature is then treated as a virtual teacher signal, and the paper reports improvements over prior KD methods on CIFAR-100, ImageNet, Swin Transformer transfer, and ADE20K segmentation (Wang et al., 2 Feb 2026).

4. On-policy reinforcement learning and verifier-filtered teacher rollouts

In reinforcement learning, teacher-guided sampling frequently addresses poor early exploration. “SG-OPD: Sign-Gated On-Policy Distillation via Sign-Consistency Gating and Phased Teacher Sampling” identifies a cold-start failure mode of standard on-policy distillation: early student rollouts may lie far from the teacher’s support, making reverse-KL supervision noisy and unhelpful (Xu et al., 8 Jun 2026). The proposed Phased Teacher Sampling (PTS) splits each minibatch $L_1$6 into student and teacher subsets, with teacher proportion

$L_1$7

Teacher rollouts are sampled from $L_1$8, evaluated by a binary verifier $L_1$9, and only teacher trajectories with $x$0 are retained (Xu et al., 8 Jun 2026). These verified rollouts define the auxiliary teacher-anchor loss

$x$1

and the teacher contribution is annealed by a three-phase cosine schedule $x$2 until training becomes fully on-policy again (Xu et al., 8 Jun 2026). In the ablation reported in the paper, baseline without PTS and without sign gate is 27.55 AVG, PTS only reaches 28.59 AVG, sign gate only reaches 28.78 AVG, and both together reach 29.53 AVG (Xu et al., 8 Jun 2026).

A more direct action-selection intervention appears in the CybORG study on autonomous cyber operations. All experiments use PPO, the teacher is a pretrained RL agent trained for 100 episodes, and four teacher-guided techniques are evaluated: reward shaping, action masking, auxiliary loss, and feature space modification (Tholl et al., 20 Aug 2025). The clearest sampling mechanism is action masking:

$x$3

with

$x$4

This is a soft mask: non-recommended actions are downweighted, not always eliminated, and teacher influence is reduced by increasing $x$5 toward 1 (Tholl et al., 20 Aug 2025). The auxiliary-loss variant instead modifies the PPO actor objective through

$x$6

thereby directly increasing the probability of teacher-like actions (Tholl et al., 20 Aug 2025). The paper reports that action masking gives the best initial reward, about 50, while auxiliary loss reaches the teacher’s performance by around episode 20, compared with around episode 110 for the baseline PPO; however, no method dramatically outperforms the baseline in final reward (Tholl et al., 20 Aug 2025).

These RL cases illustrate a specific regime of teacher-guided sampling: the teacher does not merely label a static dataset, but transiently alters the learner’s rollout distribution or policy update so that early experience is more useful.

5. Vision, multimodal reasoning, and robotics variants

In vision pretraining, teacher-guided sampling often takes the form of selective masking. SMARTFormer augments Swin Transformer with a semantic attention block after stage 3 so that the model can produce a global attention distribution despite the absence of a native $x$7 token (Jiang et al., 2023). The attention vector is used to rank patches, and with default settings $x$8 and $x$9, the top $\lambda$0 high-attending patches are masked while a small number of high-attending tokens remain as hint tokens (Jiang et al., 2023). The teacher is a momentum-updated network,

$\lambda$1

with momentum following a cosine schedule from 0.996 to 1, and the teacher is intentionally corrupted by patch dropout with ratio $\lambda$2 (Jiang et al., 2023). The full pretraining objective combines AMIP, AMPD, and AITD,

$\lambda$3

with $\lambda$4 (Jiang et al., 2023). After pretraining, the student alone is retained, and the paper reports lesion classification accuracy of 0.895 on 1000 nodules and LC treatment response prediction accuracy of 0.74 (Jiang et al., 2023).

In robotics, the phrase “teacher-guided” can refer not to action sampling but to reasoning supervision. ReFineVLA starts from a pretrained VLA backbone, instantiated as SpatialVLA, and augments the original dataset

$\lambda$5

with teacher-generated rationales to obtain

$\lambda$6

For each observation-action pair $\lambda$7, the teacher model Gemini generates a detailed multimodal reasoning annotation $\lambda$8, explicitly elucidating the rationale behind the chosen action given the visual and linguistic context (Vo et al., 25 May 2025). The paper is explicit that there is no top-$\lambda$9 rationale sampling, no confidence-based filtering, no trajectory selection heuristic, and no rejection of low-quality rationales described; all available trajectories are annotated and used (Vo et al., 25 May 2025). Training jointly optimizes action prediction and reasoning generation while freezing most pretrained parameters, and the reported best frozen depth is the first 24 transformer layers, resulting in an 8.2% improvement of task success rate (Vo et al., 25 May 2025). On SimplerEnv, ReFineVLA achieves 47.7% average success rate on WidowX tasks, 71.8% average success in visual matching for Google Robot, and 61.2% average success in variant aggregation, with corresponding improvements over SpatialVLA of 5.0%, 1.7%, and 8.6% (Vo et al., 25 May 2025).

A common misconception is therefore that teacher-guided sampling always means sampling trajectories or actions from a teacher policy. ReFineVLA is a direct counterexample: the teacher guides learning by annotation generation rather than by rollout sampling (Vo et al., 25 May 2025).

6. Design trade-offs, failure modes, and recurring controversies

Across the literature, teacher guidance is rarely beneficial when applied as an unfiltered or overly rigid intervention. In Transformer scheduled sampling, hard argmax replacement performs much worse than mixed-embedding variants, and backpropagating through the first decoder pass causes substantial degradation; the paper attributes this to training degrading too early and suggests that differentiable scheduled sampling likely needs a slower decay schedule with more initial teacher forcing (Mihaylova et al., 2019). It also reports that faster-decaying schedules such as exponential or inverse sigmoid were observed to degrade performance too quickly (Mihaylova et al., 2019).

A similar pattern appears in on-policy distillation. SG-OPD does not trust teacher rollouts blindly: only verifier-correct trajectories are retained, and the paper states that removing the correctness filter causes performance to fall back to the OPD baseline (Xu et al., 8 Jun 2026). Too much teacher injection also hurts; shorter or longer phase windows underperform the default, overly long teacher injection can contaminate the asymptotic on-policy distribution, and increasing the teacher sampling ratio too much does not help (Xu et al., 8 Jun 2026). The broader implication is that the teacher is most useful as a temporary bridge during cold start, not as a permanent surrogate for the learner’s own rollout distribution.

The CybORG study reaches a related conclusion from a different angle. Action masking and auxiliary loss improve early learning and convergence speed, whereas reward shaping and feature space modification show no noticeable improvement over baseline (Tholl et al., 20 Aug 2025). The teacher feature sometimes has high local weight in the LIME analysis, but the teacher recommendation generally does not appear in the top 4 actions, which helps explain why feature injection did not improve performance (Tholl et al., 20 Aug 2025). Teacher-guided sampling is therefore not synonymous with any generic teacher signal; the guidance must couple tightly to the policy distribution or the sample-generation process.

Another recurrent controversy concerns teacher quality itself. SCAS demonstrates that even when multiple teachers are all correct, the strongest teacher is not always the best teacher for a given student (Hu et al., 26 May 2026). This result is reinforced by the paper’s teacher-pool union experiment, in which simply aggregating more answers from strong teachers still does not match student-aware selection, even when the union uses up to $$p_T(x \mid \lambda) = \frac{\pi_L(\lambda \mid x)}{\int_x \pi_L(\lambda \mid x)\,dx} \propto \frac{\mathcal{\ell}_L(x \mid \lambda)}{m_L(x)}.$$0 more answer-level data (Hu et al., 26 May 2026). A plausible implication is that teacher-guided sampling is often limited less by the absolute strength of the teacher than by how well the teacher’s outputs match the current student’s learning state.

Taken together, these results suggest that effective teacher-guided sampling usually has four properties: it is selective rather than indiscriminate, student-aware rather than purely teacher-centric, annealed rather than permanent, and often mediated by an additional trust signal such as verifier correctness, reference-based ranking, or compatibility with the learner’s latent manifold. This suggests a unifying view of the field: teacher guidance is strongest when it reshapes the learner’s sample distribution without replacing the learner’s own distributional regime entirely.