Curriculum Recommendations Using Transformer Base Model with InfoNCE Loss And Language Switching Method (2401.09699v1)
Abstract: The Curriculum Recommendations paradigm is dedicated to fostering learning equality within the ever-evolving realms of educational technology and curriculum development. In acknowledging the inherent obstacles posed by existing methodologies, such as content conflicts and disruptions from language translation, this paradigm aims to confront and overcome these challenges. Notably, it addresses content conflicts and disruptions introduced by language translation, hindrances that can impede the creation of an all-encompassing and personalized learning experience. The paradigm's objective is to cultivate an educational environment that not only embraces diversity but also customizes learning experiences to suit the distinct needs of each learner. To overcome these challenges, our approach builds upon notable contributions in curriculum development and personalized learning, introducing three key innovations. These include the integration of Transformer Base Model to enhance computational efficiency, the implementation of InfoNCE Loss for accurate content-topic matching, and the adoption of a language switching strategy to alleviate translation-related ambiguities. Together, these innovations aim to collectively tackle inherent challenges and contribute to forging a more equitable and effective learning journey for a diverse range of learners. Competitive cross-validation scores underscore the efficacy of sentence-transformers/LaBSE, achieving 0.66314, showcasing our methodology's effectiveness in diverse linguistic nuances for content alignment prediction. Index Terms-Curriculum Recommendation, Transformer model with InfoNCE Loss, Language Switching.
- C. Chamunyonga, C. Edwards, P. Caldwell, P. Rutledge, and J. Burbery, “The impact of artificial intelligence and machine learning in radiation therapy: considerations for future curriculum enhancement,” Journal of Medical Imaging and Radiation Sciences, vol. 51, no. 2, pp. 214–220, 2020.
- S. Bian, W. X. Zhao, K. Zhou, J. Cai, Y. He, C. Yin, and J.-R. Wen, “Contrastive curriculum learning for sequential user behavior modeling via data augmentation,” in Proceedings of the 30th ACM International Conference on Information & Knowledge Management, 2021, pp. 3737–3746.
- Y. Wang et al., “Research on online learner modeling and course recommendation based on emotional factors,” Scientific Programming, vol. 2022, 2022.
- A. Kumar, A. K. J. Saudagar, M. AlKhathami, B. Alsamani, M. B. Khan, M. H. A. Hasanat, and A. Kumar, “Customized curriculum and learning approach recommendation techniques in application of virtual reality in medical education.” JUCS: Journal of Universal Computer Science, vol. 28, no. 9, 2022.
- M. Marras, L. Boratto, G. Ramos, and G. Fenu, “Equality of learning opportunity via individual fairness in personalized recommendations,” International Journal of Artificial Intelligence in Education, vol. 32, no. 3, pp. 636–684, 2022.
- I. T. Sanusi, S. S. Oyelere, H. Vartiainen, J. Suhonen, and M. Tukiainen, “A systematic review of teaching and learning machine learning in k-12 education,” Education and Information Technologies, vol. 28, no. 5, pp. 5967–5997, 2023.
- M. U. Hassan, S. Alaliyat, R. Sarwar, R. Nawaz, and I. A. Hameed, “Leveraging deep learning and big data to enhance computing curriculum for industry-relevant skills: A norwegian case study,” Heliyon, vol. 9, no. 4, 2023.
- S. Atalla, M. Daradkeh, A. Gawanmeh, H. Khalil, W. Mansoor, S. Miniaoui, and Y. Himeur, “An intelligent recommendation system for automating academic advising based on curriculum analysis and performance modeling,” Mathematics, vol. 11, no. 5, p. 1098, 2023.
- A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, “Attention is all you need,” Advances in neural information processing systems, vol. 30, 2017.
- F. Feng, Y. Yang, D. Cer, N. Arivazhagan, and W. Wang, “Language-agnostic bert sentence embedding,” arXiv preprint arXiv:2007.01852, 2020.
- C. Wu, F. Wu, and Y. Huang, “Rethinking infonce: How many negative samples do you need?” arXiv preprint arXiv:2105.13003, 2021.
- C. Mou, W. Dai, X. Ye, and J. Wu, “Research on method of user preference analysis based on entity similarity and semantic assessment,” in 2023 8th International Conference on Signal and Image Processing (ICSIP). IEEE, 2023, pp. 1029–1033.
- W. Dai, Y. Jiang, C. Mou, and C. Zhang, “An integrative paradigm for enhanced stroke prediction: Synergizing xgboost and xdeepfm algorithms,” arXiv preprint arXiv:2310.16430, 2023.
- C. Mou, X. Ye, J. Wu, and W. Dai, “Automated icd coding based on neural machine translation,” in 2023 8th International Conference on Cloud Computing and Big Data Analytics (ICCCBDA). IEEE, 2023, pp. 495–500.
- B. Prasetiyo, M. Muslim, N. Baroroh et al., “Evaluation performance recall and f2 score of credit card fraud detection unbalanced dataset using smote oversampling technique,” in Journal of physics: conference series, vol. 1918, no. 4. IOP Publishing, 2021, p. 042002.
- M. W. Browne, “Cross-validation methods,” Journal of mathematical psychology, vol. 44, no. 1, pp. 108–132, 2000.
- G. Izacard, M. Caron, L. Hosseini, S. Riedel, P. Bojanowski, A. Joulin, and E. Grave, “Towards unsupervised dense information retrieval with contrastive learning,” arXiv preprint arXiv:2112.09118, vol. 2, no. 3, 2021.
- N. Reimers and I. Gurevych, “Sentence-bert: Sentence embeddings using siamese bert-networks,” arXiv preprint arXiv:1908.10084, 2019.
- T. Xiao, L. Zeng, X. Shi, X. Zhu, and G. Wu, “Dual-graph learning convolutional networks for interpretable alzheimer’s disease diagnosis,” in International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 2022, pp. 406–415.
- X. Wang, T. Xiao, J. Tan, D. Ouyang, and J. Shao, “Mrmrp: multi-source review-based model for rating prediction,” in Database Systems for Advanced Applications: 25th International Conference, DASFAA 2020, Jeju, South Korea, September 24–27, 2020, Proceedings, Part II 25. Springer, 2020, pp. 20–35.
- L. Zeng, H. Li, T. Xiao, F. Shen, and Z. Zhong, “Graph convolutional network with sample and feature weights for alzheimer’s disease diagnosis,” Information Processing & Management, vol. 59, no. 4, p. 102952, 2022.