Demographic-stratified evaluation of educational disparities

Determine whether course-specific Retrieval-Augmented Generation systems measurably reduce help-seeking and educational disparities for different learner groups, including students affected by anxiety, low confidence, gender, widening-participation status, mature-student status, disability, or neurodivergence.

Background

The study proposes that Beacon’s private, low-friction, course-aligned support may reduce anxiety- and confidence-related barriers to academic help-seeking. However, the evaluation did not collect demographic data linking system use or perceived benefit to specific learner characteristics. The authors therefore identify whether the proposed mechanism actually narrows educational disparities, and for whom it is most effective, as an unresolved empirical question requiring demographic-stratified evaluation.

References

This suggests a plausible, though as yet untested, pathway by which course-specific RAG systems could narrow rather than widen educational disparities for the groups this special issue is concerned with; establishing whether this pathway holds in practice is the central task of the demographic-stratified evaluation proposed in Section~\ref{sec:future_work}.

— Reducing Barriers to Academic Support: Evaluating a Course-Specific RAG System for Addressing Help-Seeking Disparities in Higher Education  (2609.21600 - Gray et al., 18 Sep 2026) in Section 5.4, RQ2 discussion; Section 6, Limitations; Section 7, Future Work

Future work should also examine whether Beacon supports different student groups equitably, including students with lower confidence, students with disabilities, neuro-divergent students, students from widening participation backgrounds, and students with different levels of prior programming experience.