Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
167 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Symbolic Cognitive Diagnosis via Hybrid Optimization for Intelligent Education Systems (2401.10840v1)

Published 30 Dec 2023 in cs.CY, cs.AI, and cs.LG

Abstract: Cognitive diagnosis assessment is a fundamental and crucial task for student learning. It models the student-exercise interaction, and discovers the students' proficiency levels on each knowledge attribute. In real-world intelligent education systems, generalization and interpretability of cognitive diagnosis methods are of equal importance. However, most existing methods can hardly make the best of both worlds due to the complicated student-exercise interaction. To this end, this paper proposes a symbolic cognitive diagnosis~(SCD) framework to simultaneously enhance generalization and interpretability. The SCD framework incorporates the symbolic tree to explicably represent the complicated student-exercise interaction function, and utilizes gradient-based optimization methods to effectively learn the student and exercise parameters. Meanwhile, the accompanying challenge is that we need to tunnel the discrete symbolic representation and continuous parameter optimization. To address this challenge, we propose to hybridly optimize the representation and parameters in an alternating manner. To fulfill SCD, it alternately learns the symbolic tree by derivative-free genetic programming and learns the student and exercise parameters via gradient-based Adam. The extensive experimental results on various real-world datasets show the superiority of SCD on both generalization and interpretability. The ablation study verifies the efficacy of each ingredient in SCD, and the case study explicitly showcases how the interpretable ability of SCD works.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (40)
  1. Engaging with massive online courses. In Proceedings of the 23rd International World Wide Web Conference, pages 687–698, Seoul, Korea, 2014.
  2. Evolution strategies–a comprehensive introduction. Natural Computing, 1:3–52, 2002.
  3. Symbolic regression analysis. In Classification, Clustering, and Data Analysis: Recent Advances and Applications, pages 281–288. Springer, 2002.
  4. Intelligent Tutoring Systems: Evolutions in Design. Psychology Press, 2014.
  5. R Philip Chalmers. Mirt: A multidimensional item response theory package for the r environment. Journal of Statistical Software, 48:1–29, 2012.
  6. Jimmy De La Torre. An empirically based method of Q-matrix validation for the DINA model: Development and applications. Journal of Educational Measurement, 45(4):343–362, 2008.
  7. Jimmy De La Torre. The generalized dina model framework. Psychometrika, 76:179–199, 2011.
  8. Deap: A python framework for evolutionary algorithms. In Proceedings of the 14th Annual Conference Companion on Genetic and Evolutionary Computation, pages 85–92, philadelphia, PA, 2012.
  9. A review of cognitively diagnostic assessment and a summary of psychometric models. Handbook of Statistics, 26:979–1030, 2006.
  10. Techniques for interpretable machine learning. Communication of the ACM, 63(1):68–77, 2020.
  11. Item Response Theory. Psychology Press, 2013.
  12. Gerhard H Fischer. Derivations of the rasch model. In Rasch Models: Foundations, Recent Developments, and Applications, pages 15–38. Springer, 1995.
  13. Stephanie Forrest. Genetic algorithms: Principles of natural selection applied to computation. Science, 261(5123):872–878, 1993.
  14. Understanding the difficulty of training deep feedforward neural networks. In Proceedings of the 13rd International Conference on Artificial Intelligence and Statistics, pages 249–256, Sardinia, Italy, 2010.
  15. Multilayer feedforward networks are universal approximators. Neural Networks, 2(5):359–366, 1989.
  16. Face identification proficiency test designed using item response theory. CoRR, abs/2106.15323, 2021.
  17. End-to-end symbolic regression with transformers. In Advances in Neural Information Processing Systems 35, pages 10269–10281, New Orleans, LA, 2022.
  18. Explainable artificial intelligence in education. Computers and Education: Artificial Intelligence, 3:100074, 2022.
  19. Adam: A method for stochastic optimization. In Proceedings of the 3rd International Conference on Learning Representations, San Diego, CA, 2015.
  20. John R Koza. Genetic programming as a means for programming computers by natural selection. Statistics and Computing, 4:87–112, 1994.
  21. Fuzzy Cognitive Diagnosis for Modelling Examinee Performance. ACM Transactions on Intelligent Systems and Technology, 9(4):48:1–48:26, 2018.
  22. QCCDM: A Q-augmented causal cognitive diagnosis model for student learning. In Proceedings of the 26th European Conference on Artificial Intelligence, pages 1536–1543, Kraków, Poland, 2023.
  23. New development of cognitive diagnosis models. Frontiers of Computer Science, 17(1):171604, 2023.
  24. Qi Liu. Towards a new generation of cognitive diagnosis. In Proceedings of the 30th International Joint Conference on Artificial Intelligence, pages 4961–4964, Montreal, Canada, 2021.
  25. Frederic Lord. A theory of test scores. Psychometric Monographs, 1952.
  26. Explainable artificial intelligence by genetic programming: A survey. IEEE Transactions on Evolutionary Computation, 27(3):621–641, 2023.
  27. Definitions, methods, and applications in interpretable machine learning. Proceedings of the National Academy of Sciences, 116(44):22071–22080, 2019.
  28. Integration of artificial intelligence performance prediction and learning analytics to improve student learning in online engineering course. International Journal of Educational Technology in Higher Education, 20:1–23, 2023.
  29. Pytorch: An imperative style, high-performance deep learning library. In Advances in Neural Information Processing Systems 32, pages 8024–8035, British Columbia, Canada, 2019.
  30. A Field Guide to Genetic Programming. Springer, 2008.
  31. Prediction of dynamical systems by symbolic regression. Physical Review E, 94(1):012214, 2016.
  32. Mark D. Reckase. Multidimensional Item Response Theory Models. Springer, 2009.
  33. J. B. Sympson. A model for testing with multidimensional items. In Proceedings of the 1977 Computerized Adaptive Testing Conference, pages 82–98, Minneapolis, MN, 1978. University of Minnesota, Department of Psychology, Psychometrics Methods Program.
  34. Neural cognitive diagnosis for intelligent education systems. In Proceedings of the 34th AAAI Conference on Artificial Intelligence, pages 6153–6161, New York, NY, 2020.
  35. Diagnostic questions: The neurips 2020 education challenge. arXiv preprint arXiv:2007.12061, 2020.
  36. Neuralcd: A general framework for cognitive diagnosis. IEEE Transactions on Knowledge and Data Engineering, 35(8):8312–8327, 2022.
  37. Cognitive modelling for predicting examinee performance. In Proceedings of the 24th International Joint Conference on Artificial Intelligence, pages 1017–1024, Buenos Aires, Argentina, 2015.
  38. Course video recommendation with multimodal information in online learning platforms: A deep learning framework. British Journal of Educational Technology, 51(5):1734–1747, 2020.
  39. Ps-tree: A piecewise symbolic regression tree. Swarm and Evolutionary Computation, 71:101061, 2022.
  40. An evolutionary forest for regression. IEEE Transactions on Evolutionary Computation, 26(4):735–749, 2022.
Citations (5)

Summary

We haven't generated a summary for this paper yet.