Unclear role of task-level expertise in predicting time on task

Determine why self-reported expertise with Google’s data logging infrastructure and self-reported C++ language proficiency did not significantly predict time on task in the randomized controlled trial’s enterprise-grade coding task.

Background

The authors’ regression analyses included task-level covariates for domain expertise (data logging infrastructure) and language proficiency (C++), neither of which significantly predicted time on task.

They explicitly note that it is unclear why these task-level factors were not significant, suggesting follow-up research to examine potential explanations such as sample homogeneity.