Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
175 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Inductive Cognitive Diagnosis for Fast Student Learning in Web-Based Online Intelligent Education Systems (2404.11290v1)

Published 17 Apr 2024 in cs.AI

Abstract: Cognitive diagnosis aims to gauge students' mastery levels based on their response logs. Serving as a pivotal module in web-based online intelligent education systems (WOIESs), it plays an upstream and fundamental role in downstream tasks like learning item recommendation and computerized adaptive testing. WOIESs are open learning environment where numerous new students constantly register and complete exercises. In WOIESs, efficient cognitive diagnosis is crucial to fast feedback and accelerating student learning. However, the existing cognitive diagnosis methods always employ intrinsically transductive student-specific embeddings, which become slow and costly due to retraining when dealing with new students who are unseen during training. To this end, this paper proposes an inductive cognitive diagnosis model (ICDM) for fast new students' mastery levels inference in WOIESs. Specifically, in ICDM, we propose a novel student-centered graph (SCG). Rather than inferring mastery levels through updating student-specific embedding, we derive the inductive mastery levels as the aggregated outcomes of students' neighbors in SCG. Namely, SCG enables to shift the task from finding the most suitable student-specific embedding that fits the response logs to finding the most suitable representations for different node types in SCG, and the latter is more efficient since it no longer requires retraining. To obtain this representation, ICDM consists of a construction-aggregation-generation-transformation process to learn the final representation of students, exercises and concepts. Extensive experiments across real-world datasets show that, compared with the existing cognitive diagnosis methods that are always transductive, ICDM is much more faster while maintains the competitive inference performance for new students.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (37)
  1. How attentive are graph attention networks? In Proceedings of the 10th International Conference on Learning Representations, Virtual Event, 2022.
  2. Ednet: A large-scale hierarchical dataset in education. In Proceedings of 21st Artificial Intelligence in Education, pages 69–73, Ifrane, Morocco, 2020.
  3. Jimmy De La Torre. Dina model and parameter estimation: A didactic. Journal of Educational and Behavioral Statistics, 34(1):115–130, 2009.
  4. Lawrence T DeCarlo. On the analysis of fraction subtraction data: The dina model, classification, latent class sizes, and the q-matrix. Applied Psychological Measurement, 35(1):8–26, 2011.
  5. Addressing the assessment challenge with an online system that tutors as it assesses. User Modeling and User-adapted Interaction, 19(3):243–266, 2009.
  6. RCD: Relation map driven cognitive diagnosis for intelligent education systems. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 501–510, Virtual Event, 2021.
  7. Understanding the difficulty of training deep feedforward neural networks. In Proceedings of the 13th International Conference on Artificial Intelligence and Statistics, pages 249–256, Sardinia, Italy, 2010.
  8. Shelby J Haberman. Identifiability of parameters in item response models with unconstrained ability distributions. ETS Research Report Series, 2005(2):i–22, 2005.
  9. Inductive representation learning on large graphs. In Advances in Neural Information Processing Systems 30, pages 1024–1034, Long Beach, CA, 2017.
  10. Deep models of interactions across sets. In Proceedings of the 35th International Conference on Machine Learning, pages 1914–1923, Stockholm, Sweden, 2018.
  11. Lightgcn: Simplifying and powering graph convolution network for recommendation. In Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, pages 639–648, Virtual Event, 2020.
  12. Development of adaptive and intelligent web-based educational systems. In Proceedings of the 4th international conference on application of information and communication technologies, pages 1–5, Halifax Nova Scotia, Canada, 2010.
  13. Adam: A method for stochastic optimization. In Proceedings of the 3rd International Conference on Learning Representations, San Diego, California, 2015.
  14. HierCDF: A Bayesian network-based hierarchical cognitive diagnosis framework. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pages 904–913, Virtual Event, 2022.
  15. Exploiting cognitive structure for adaptive learning. In Ankur Teredesai, Vipin Kumar, Ying Li, Rómer Rosales, Evimaria Terzi, and George Karypis, editors, Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery, pages 627–635, Anchorage, AK, 2019.
  16. QCCDM: A q-augmented causal cognitive diagnosis model for student learning. In Proceedings of the 26th European Conference on Artificial Intelligence, pages 1536–1543, Kraków, Poland, 2023.
  17. Frederic Lord. A theory of test scores. Psychometric Monographs, 1952.
  18. Knowledge-sensed cognitive diagnosis for intelligent education platforms. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management, pages 1451–1460, Atlanta, GA, 2022.
  19. Pytorch: An imperative style, high-performance deep learning library. In Advances in Neural Information Processing Systems 32, pages 8024–8035, British Columbia, Canada, 2019.
  20. Inductive matrix completion using graph autoencoder. In Proceedings of the 30th ACM International Conference on Information and Knowledge Management, pages 1609–1618, Virtual Event, 2021.
  21. Symbolic cognitive diagnosis via hybrid optimization for intelligent education systems. In Proceedings of the 38th AAAI Conference on Artificial Intelligence, Vancouver, Canada, 2024.
  22. James B Sympson. A model for testing with multidimensional items. In Proceedings of the 1977 Computerized Adaptive Testing Conference, Minneapolis, MN, 1978.
  23. Kikumi K Tatsuoka. Analysis of errors in fraction addition and subtraction problems. final report. 1984.
  24. Incremental cognitive diagnosis for intelligent education. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pages 1760–1770, Washington, DC, 2022.
  25. Laurens Van der Maaten and Geoffrey Hinton. Visualizing data using t-sne. Journal of Machine Learning Research, 9(11), 2008.
  26. Graph attention networks. In Proceedings of the 6th International Conference on Learning Representations, British Columbia, Canada, 2018.
  27. Neural cognitive diagnosis for intelligent education systems. In Proceedings of the 34th AAAI Conference on Artificial Intelligence, New York, NY, 2020.
  28. Diagnostic questions: The neurips 2020 education challenge. arXiv preprint arXiv:2007.12061, 2020.
  29. Self-supervised heterogeneous graph neural network with co-contrastive learning. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pages 1726–1736, Virtual Event, 2021.
  30. Neuralcd: A general framework for cognitive diagnosis. IEEE Transactions on Knowledge and Data Engineering, 35(8), 2023.
  31. Simplifying graph convolutional networks. In Proceedings of the 36th International Conference on Machine Learning, pages 6861–6871, Long Beach, CA, 2019.
  32. Towards open-world recommendation: An inductive model-based collaborative filtering approach. In Proceedings of the 38th International Conference on Machine Learning, pages 11329–11339, Virtual Event, 2021.
  33. INMO: A model-agnostic and scalable module for inductive collaborative filtering. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 91–101, Madrid, Spain, 2022.
  34. Course video recommendation with multimodal information in online learning platforms: A deep learning framework. British Journal of Educational Technology, 51(5):1734–1747, 2020.
  35. Tracing knowledge instead of patterns: Stable knowledge tracing with diagnostic transformer. In Ying Ding, Jie Tang, Juan F. Sequeda, Lora Aroyo, Carlos Castillo, and Geert-Jan Houben, editors, Proceedings of the ACM Web Conference, pages 855–864, Austin,TX, 2023.
  36. Inductive matrix completion based on graph neural networks. In Proceedings of 8th International Conference on Learning Representations, Addis Ababa, Ethiopia, 2020.
  37. Fully adaptive framework: Neural computerized adaptive testing for online education. In Proceeddings of the 36th AAAI Conference on Artificial Intelligence, pages 4734–4742, Virtual Event, 2022.
Citations (12)

Summary

We haven't generated a summary for this paper yet.