Find Open Problems
Find Open Problems
Search for open problems in our database
Submit a Problem
Submit a new open problem to our database (not available yet)
Dice Question Streamline Icon: https://streamlinehq.com

Bias from issue completion order

Assess whether developers’ post-randomization choices of issue completion order induce systematic biases in measured implementation times across AI-allowed and AI-disallowed conditions, and quantify the magnitude of any such bias.

References

This could cause a bias in completion times. While we receive no qualitative reports from developers that they prioritize issues in this way, we do not have access to developers entire workflows, so we cannot fully rule out this effect.

— Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity (Becker et al., 12 Jul 2025) in Factor Analysis: Factors with an unclear effect on slowdown — Subsubsection “Bias from issue completion order”