Determine the cause of Claude’s lower patch applicability on CQ2-CARE contexts

Determine why Claude Opus 5 patches apply less often on CQ2-CARE contexts than GPT-5.6 patches, including whether the difference is caused by patch-format behavior, unchanged-context length, or another model-specific factor.

Background

The appendix reports that Claude’s patches apply on 83.3% of CQ2-CARE contexts, compared with 98.0% for GPT-5.6. It also notes that Claude’s hunks carry slightly less unchanged context, with a median of five rather than six lines.

The paper explicitly states that the cause of this applicability difference has not been isolated, leaving unresolved which model or patch-generation behavior accounts for the gap.

References

Claude's patches on LLMLingua-2 contexts apply 80.7\% of the time (GPT-5.6: 70.7\%), while its patches apply less often in general (83.3\% on our contexts, against 98.0\% for GPT-5.6), so applicability separates the contexts less; its hunks carry slightly less unchanged context (median 5 vs. 6 lines), but we have not isolated the cause.

— Skip the Compressor: Coding Agents Fix More Issues When They Pick Whole Files  (2610.21073 - Yang et al., 15 Oct 2026) in Appendix, Section “Details of the Second-Model Run” (Appendix~\ref{app:claude})