Relationship Between Task Difficulty and Generalization Performance in LLMs
Determine the relationship between task difficulty and generalization performance in large language models, specifically assessing whether training on easier tasks leads to improved performance on harder tasks and whether training on harder tasks improves performance on easier tasks across evaluation benchmarks.
References
As shown in Table \ref{tab:difficulty_tension}, despite ongoing research in this area, the relationship between generalization performance and task difficulty remains an open question.
— Revisiting Generalization Across Difficulty Levels: It's Not So Easy
(2511.21692 - Kordi et al., 26 Nov 2025) in Section 1, Introduction
For RL itself, we cannot confirm it, due to the truncation we see for GRPO on OOD.
— Is it RL or Data? A Controlled Comparison of GRPO and Rejection-Sampling Fine-Tuning
(2610.25812 - Chaudhry, 19 Oct 2026) in Section 3.3, “Mixed-difficulty data helps RFT; for GRPO the evidence is inconclusive”