Generalization of the Safety-SFT Composition Curve Across Model Scales
Determine whether the non-monotonic relationship between the fraction of general data in the safety-SFT mix and over-refusal, including the observed 40–50% knee point, persists at other model scales.
References
it is unknown whether the same shape (or the same knee point) holds at another model scale.
— Manacá-1B-Instruct-2: Reproducible Safety Alignment for a Native Brazilian-Portuguese LLM. Negative DPO Results, a Controlled Composition Scan, and a Silent Failure Mode of the LLM Judge
(2610.20570 - Menezes et al., 14 Oct 2026) in Section 4.3, Explicit limitations of the composition scan