Test generality of the gain across stimuli, participants, model families, and training seeds

Establish whether the observed decrease in Brain-MoE gain with increasing base accuracy persists across broader sets of stimuli, participants, model families, and training seeds.

Background

Brain-MoE gains decrease as base accuracy increases across the 15 evaluated model–benchmark cells. The authors state that broader variation in experimental stimuli, human participants, model families, and training randomness is needed to determine whether this relationship generalizes beyond the present study.

References

Two tests would resolve the main remaining uncertainties. Following one base along its training trajectory would estimate the capability-brain coupling without the shared axis of a seven-model panel. Adding stimuli, participants, model families and training seeds would test whether the decrease of gain with base accuracy holds more broadly.