Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
144 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

A Prescriptive Learning Analytics Framework: Beyond Predictive Modelling and onto Explainable AI with Prescriptive Analytics and ChatGPT (2208.14582v2)

Published 31 Aug 2022 in cs.LG, cs.AI, and cs.CY

Abstract: A significant body of recent research in the field of Learning Analytics has focused on leveraging machine learning approaches for predicting at-risk students in order to initiate timely interventions and thereby elevate retention and completion rates. The overarching feature of the majority of these research studies has been on the science of prediction only. The component of predictive analytics concerned with interpreting the internals of the models and explaining their predictions for individual cases to stakeholders has largely been neglected. Additionally, works that attempt to employ data-driven prescriptive analytics to automatically generate evidence-based remedial advice for at-risk learners are in their infancy. eXplainable AI is a field that has recently emerged providing cutting-edge tools which support transparent predictive analytics and techniques for generating tailored advice for at-risk students. This study proposes a novel framework that unifies both transparent machine learning as well as techniques for enabling prescriptive analytics, while integrating the latest advances in LLMs. This work practically demonstrates the proposed framework using predictive models for identifying at-risk learners of programme non-completion. The study then further demonstrates how predictive modelling can be augmented with prescriptive analytics on two case studies in order to generate human-readable prescriptive feedback for those who are at risk using ChatGPT.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (45)
  1. Customized rule-based model to identify at-risk students and propose rational remedial actions. Big Data and Cognitive Computing, 5(4):71, 2021a.
  2. A systematic literature review of student’performance prediction using machine learning techniques. Education Sciences, 11(9):552, 2021b.
  3. A predictive analytics infrastructure to support a trustworthy early warning system. Applied Sciences, 11(13):5781, 2021.
  4. Educational data mining to predict students’ academic performance: A survey study. Education and Information Technologies, pages 1–67, 2022.
  5. An automated survey designing tool for indirect assessment in outcome based education using data mining. In 2017 5th IEEE International Conference on MOOCs, Innovation and Technology in Education (MITE), pages 95–100. IEEE, 2017.
  6. Outcome based predictive analysis of automatic question paper using data mining. In 2017 2nd International Conference on Communication and Electronics Systems (ICCES), pages 629–634. IEEE, 2017.
  7. L. Breiman. Random forests. Machine learning, 45(1):5–32, 2001.
  8. Language models are few-shot learners. arXiv preprint arXiv:2005.14165, 2020.
  9. T. Cover and P. Hart. Nearest neighbor pattern classification. IEEE transactions on information theory, 13(1):21–27, 1967.
  10. An attainment tool for measuring course outcomes and program outcomes. International Journal for Advance Research and Development, 3(3):24–27, 2018.
  11. Predicting student dropout in self-paced mooc course using random forest model. Information, 12(11):476, 2021.
  12. Bert: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, volume 1, pages 4171–4186, 2018.
  13. P. Domingos. A few useful things to know about machine learning. Communications of the ACM, 55(10):78–87, 2012.
  14. Remedial actions recommendation via multi-label classification: A course learning improvement method. International Journal of Machine Learning and Computing, 8(6):583–588, 2018.
  15. Application of machine learning in higher education to assess student academic performance, at-risk, and attrition: A meta-analysis of literature. Education and Information Technologies, pages 1–33, 2021.
  16. Prescriptive analytics: a survey of emerging trends and technologies. The VLDB Journal, 28(4):575–595, 2019.
  17. A. Gramegna and P. Giudici. Shap and lime: An evaluation of discriminative power in credit risk. Frontiers in Artificial Intelligence, page 140, 2021.
  18. N. Gupta and A. Ghosal. Automation of Attainment Calculation in Outcome-Based Technical Education (OBTE), pages 113–135. Springer Singapore, Singapore, 2021. ISBN 978-981-15-8744-3. doi: 10.1007/978-981-15-8744-3_6. URL https://doi.org/10.1007/978-981-15-8744-3_6.
  19. Learning analytics: state of the art. International Journal on Interactive Design and Manufacturing (IJIDeM), pages 1–22, 2022.
  20. Practical early prediction of students’ performance using machine learning and explainable ai. Education and Information Technologies, pages 1–35, 2022.
  21. Course learning outcome performance improvement: A remedial action classification based approach. In 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA), pages 408–413. IEEE, 2016.
  22. Prescriptive analytics: Literature review and research challenges. International Journal of Information Management, 50:57–70, 2020.
  23. R. Liu and K. R. Koedinger. Going beyond better data prediction to create explanatory models of educational data. The Handbook of learning analytics, 1:69–76, 2017.
  24. A unified approach to interpreting model predictions. Advances in neural information processing systems, 30, 2017.
  25. Perspectives on the challenges of generalizability, transparency and ethics in predictive learning analytics. Computers and Education Open, 2:100060, 2021.
  26. Interpretable machine learning–a brief history, state-of-the-art and challenges. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases, pages 417–431. Springer, 2020.
  27. Explaining machine learning classifiers through diverse counterfactual explanations. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, pages 607–617, 2020.
  28. A. Namoun and A. Alshanqiti. Predicting student performance using data mining and learning analytics techniques: A systematic literature review. Applied Sciences, 11(1):237, 2020.
  29. Face: feasible and actionable counterfactual explanations. In Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society, pages 344–350, 2020.
  30. Catboost: unbiased boosting with categorical features, 2017.
  31. On developing generic models for predicting student outcomes in educational data mining. Big Data and Cognitive Computing, 6(1):6, 2022.
  32. P. Regulation. Regulation (eu) 2016/679 of the european parliament and of the council. Regulation (eu), 679:2016, 2016.
  33. Exploring critical factors of the perceived usefulness of a learning analytics dashboard for distance university students. International Journal of Educational Technology in Higher Education, 18(1):1–23, 2021.
  34. Anchors: High-precision model-agnostic explanations. In Proceedings of the AAAI conference on artificial intelligence, volume 32, 2018.
  35. Scikit-Learn. Scikit-learn: Machine learning in python, 2021. URL https://scikit-learn.org/stable/index.html.
  36. Student retention using educational data mining and predictive analytics: A systematic literature review. IEEE Access, 2022.
  37. L. Shapley. Quota solutions op n-person games1. Edited by Emil Artin and Marston Morse, page 343, 1953.
  38. Learning analytics dashboard: a tool for providing actionable insights to learners. International Journal of Educational Technology in Higher Education, 19(1):1–23, 2022.
  39. Student performance prediction in higher education: A comprehensive review. In AIP Conference Proceedings, volume 2470, page 050005. AIP Publishing LLC, 2022.
  40. Predict or describe? how learning analytics dashboard design influences motivation and statistics anxiety in an online statistics course. Educational Technology Research and Development, 69(3):1405–1431, 2021.
  41. Improving the expressiveness of black-box models for predicting student performance. Computers in Human Behavior, 72:621–631, 2017.
  42. Counterfactual explanations without opening the black box: Automated decisions and the gdpr. Harv. JL & Tech., 31:841, 2017.
  43. No free lunch theorems for optimization. IEEE transactions on evolutionary computation, 1(1):67–82, 1997.
  44. A review of learning analytics intervention in higher education (2011–2018). Journal of Computers in Education, 7(1):7–28, 2020.
  45. A survey on educational data mining methods used for predicting students’ performance. Engineering Reports, 4(5):e12482, 2022.
Citations (33)

Summary

We haven't generated a summary for this paper yet.