Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
80 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
7 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

DyGKT: Dynamic Graph Learning for Knowledge Tracing (2407.20824v1)

Published 30 Jul 2024 in cs.LG

Abstract: Knowledge Tracing aims to assess student learning states by predicting their performance in answering questions. Different from the existing research which utilizes fixed-length learning sequence to obtain the student states and regards KT as a static problem, this work is motivated by three dynamical characteristics: 1) The scales of students answering records are constantly growing; 2) The semantics of time intervals between the records vary; 3) The relationships between students, questions and concepts are evolving. The three dynamical characteristics above contain the great potential to revolutionize the existing knowledge tracing methods. Along this line, we propose a Dynamic Graph-based Knowledge Tracing model, namely DyGKT. In particular, a continuous-time dynamic question-answering graph for knowledge tracing is constructed to deal with the infinitely growing answering behaviors, and it is worth mentioning that it is the first time dynamic graph learning technology is used in this field. Then, a dual time encoder is proposed to capture long-term and short-term semantics among the different time intervals. Finally, a multiset indicator is utilized to model the evolving relationships between students, questions, and concepts via the graph structural feature. Numerous experiments are conducted on five real-world datasets, and the results demonstrate the superiority of our model. All the used resources are publicly available at https://github.com/PengLinzhi/DyGKT.

PDF Abstract
Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Bookmark Chat Bubble Oval Streamline Icon: https://streamlinehq.com Chat (Pro)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (40)
  1. Evolutionary dynamics of higher-order interactions in social networks. Nature Human Behaviour 5, 5 (2021), 586–595.
  2. F-fade: Frequency factorization for anomaly detection in edge streams. In Proceedings of the 14th ACM International Conference on Web Search and Data Mining. 589–597.
  3. Jiahao Chen et al. 2023. Improving Interpretability of Deep Sequential Knowledge Tracing Models with Question-Centric Cognitive Representations. In Proceedings of the 37th AAAI Conference on Artificial Intelligence.
  4. Towards an appropriate query, key, and value computation for knowledge tracing. In Proceedings of the seventh ACM conference on learning@ scale. 341–344.
  5. Continuous-time sequential recommendation with temporal graph collaborative transformer. In Proceedings of the 30th ACM international conference on information & knowledge management. 433–442.
  6. Context-aware attentive knowledge tracing. In Proceedings of the 26th ACM SIGKDD international conference on knowledge discovery & data mining. 2330–2339.
  7. Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation 9, 8 (1997), 1735–1780.
  8. Eduhawkes: a neural hawkes process approach for online study behavior modeling. In Proceedings of the 2021 SIAM International Conference on Data Mining (SDM). SIAM, 567–575.
  9. Multi-view MOOC quality evaluation via information-aware graph representation learning. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 37. 8070–8077.
  10. Predicting dynamic embedding trajectory in temporal interaction networks. In Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining. 1269–1278.
  11. Amar Lalwani and Sweety Agrawal. 2019. What does time tell? Tracing the forgetting curve using deep knowledge tracing. In Artificial Intelligence in Education: 20th International Conference, AIED 2019, Chicago, IL, USA, June 25-29, 2019, Proceedings, Part II 20. Springer, 158–162.
  12. A critical review of recurrent neural networks for sequence learning. arXiv preprint arXiv:1506.00019 (2015).
  13. Enhancing deep knowledge tracing with auxiliary tasks. In Proceedings of the ACM Web Conference 2023. 4178–4187.
  14. simpleKT: a simple but tough-to-beat baseline for knowledge tracing. arXiv preprint arXiv:2302.06881 (2023).
  15. Tracing knowledge state with individual cognition and acquisition estimation. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 173–182.
  16. Reconciling cognitive modeling with knowledge forgetting: A continuous time-aware neural network approach. In Proceedings of the 31st International Joint Conference on Artificial Intelligence. 2174–2181.
  17. Key-value memory networks for directly reading documents. arXiv preprint arXiv:1606.03126 (2016).
  18. Augmenting knowledge tracing by considering forgetting behavior. In The world wide web conference. 3101–3107.
  19. Graph-based knowledge tracing: modeling student proficiency using graph neural network. In IEEE/WIC/ACM International Conference on Web Intelligence. 156–163.
  20. Shalini Pandey and George Karypis. 2019. A self-attentive model for knowledge tracing. arXiv preprint arXiv:1907.06837 (2019).
  21. Shalini Pandey and Jaideep Srivastava. 2020. RKT: relation-aware self-attention for knowledge tracing. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management. 1205–1214.
  22. Deep knowledge tracing. Advances in neural information processing systems 28 (2015).
  23. Anomaly detection in dynamic networks: a survey. Wiley Interdisciplinary Reviews: Computational Statistics 7, 3 (2015), 223–247.
  24. Temporal Graph Networks for Deep Learning on Dynamic Graphs. CoRR abs/2006.10637 (2020).
  25. Assessing Student’s Dynamic Knowledge State by Exploring the Question Difficulty Effect. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 427–437.
  26. Learning process-consistent knowledge tracing. In Proceedings of the 27th ACM SIGKDD conference on knowledge discovery & data mining. 1452–1460.
  27. Session-based social recommendation via dynamic graph attention networks. In Proceedings of the Twelfth ACM international conference on web search and data mining. 555–563.
  28. qdkt: Question-centric deep knowledge tracing. arXiv preprint arXiv:2005.12442 (2020).
  29. Sequence to sequence learning with neural networks. Advances in neural information processing systems 27 (2014).
  30. Dai H. Trivedi R. and Song L.. Wang Y. 2017. Know-evolve: Deep temporal reasoning for dynamic knowledge graphs. In International Conference on Machine Learning (ICML). 3462–3471.
  31. Bipartite dynamic representations for abuse detection. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. 3638–3648.
  32. Temporal cross-effects in knowledge tracing. In Proceedings of the 14th ACM International Conference on Web Search and Data Mining. 517–525.
  33. Going deeper with deep knowledge tracing. International Educational Data Mining Society (2016).
  34. Inductive Representation Learning on Temporal Graphs. arXiv preprint arXiv:2002.07962 (2020).
  35. GIKT: a graph-based interaction model for knowledge tracing. In Machine Learning and Knowledge Discovery in Databases: European Conference, ECML PKDD 2020, Ghent, Belgium, September 14–18, 2020, Proceedings, Part I. Springer, 299–315.
  36. Chun-Kit Yeung and Dit-Yan Yeung. 2018. Addressing two problems in deep knowledge tracing via prediction-consistent regularization. In Proceedings of the fifth annual ACM conference on learning at scale. 1–10.
  37. Modelling Evolutionary and Stationary User Preferences for Temporal Sets Prediction. arXiv preprint arXiv:2204.05490 (2022).
  38. Towards Better Dynamic Graph Learning: New Architecture and Unified Library. arXiv preprint arXiv:2303.13047 (2023).
  39. Element-guided Temporal Graph Representation Learning for Temporal Sets Prediction. In Proceedings of the ACM Web Conference 2022. 1902–1913.
  40. Dynamic key-value memory networks for knowledge tracing. In Proceedings of the 26th international conference on World Wide Web. 765–774.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (6)
  1. Ke Cheng (23 papers)
  2. Linzhi Peng (3 papers)
  3. Pengyang Wang (44 papers)
  4. Junchen Ye (9 papers)
  5. Leilei Sun (36 papers)
  6. Bowen Du (34 papers)
Citations (1)
View on Semantic Scholar
Github Logo Streamline Icon: https://streamlinehq.com

GitHub

  1. GitHub - PengLinzhi/DyGKT: Dynamic Graph for Adaptive Knowledge Tracing (7 stars)
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets