Scale and architecture generalization of trajectory geometry
Ascertain whether the same step‑indexed reasoning‑trajectory geometric organization found in Llama 3.1 8B variants persists at larger model scales and across architecturally distinct model families.
References
Although the consistency of trajectory-level phenomena across three substantially different post-training objectives suggests that these structures are not paradigm-specific, we have not verified whether the same geometric organization holds at larger scales or across architecturally distinct model families.
— LLM Reasoning as Trajectories: Step-Specific Representation Geometry and Correctness Signals
(2604.05655 - Sun et al., 7 Apr 2026) in Limitations, paragraph 2
The W-shape we observe in pre-SFT Î may be a Qwen3.5-specific phenomenon or a property of small-to-mid-scale dense LLMs in general; this paper cannot distinguish.
— Procedural-skill SFT across capacity tiers: A W-Shaped pre-SFT Trajectory and Regime-Asymmetric Mechanism on 0.8B-4B Qwen3.5 Models
(2605.11907 - Strozzi, 12 May 2026) in Section 3, “Threats to Validity and Limitations,” item 4