Extending the findings to additional translation controls
Determine whether the observed limitations of forgetting-mitigation methods during machine-translation fine-tuning extend to additional translation controls, specifically glossary constraints and gender-neutral translation.
References
Open questions are whether broader control-task data, for example synthetic examples covering more tasks and prompt variants, can preserve MT-IF without overfitting to the seen prompts, and whether the findings extend to further controls such as glossary constraints and gender-neutral translation.
— Fine-Tuning LLMs for Translation: General Forgetting Mitigation Does Not Preserve MT-Specific Instruction Following
(2609.28395 - Scholz et al., 23 Sep 2026) in Conclusion