Demographic-stratified evaluation of educational disparities
Determine whether course-specific Retrieval-Augmented Generation systems measurably reduce help-seeking and educational disparities for different learner groups, including students affected by anxiety, low confidence, gender, widening-participation status, mature-student status, disability, or neurodivergence.
References
This suggests a plausible, though as yet untested, pathway by which course-specific RAG systems could narrow rather than widen educational disparities for the groups this special issue is concerned with; establishing whether this pathway holds in practice is the central task of the demographic-stratified evaluation proposed in Section~\ref{sec:future_work}.
Future work should also examine whether Beacon supports different student groups equitably, including students with lower confidence, students with disabilities, neuro-divergent students, students from widening participation backgrounds, and students with different levels of prior programming experience.