Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
102 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Course Recommender Systems Need to Consider the Job Market (2404.10876v2)

Published 16 Apr 2024 in cs.IR and cs.LG

Abstract: Current course recommender systems primarily leverage learner-course interactions, course content, learner preferences, and supplementary course details like instructor, institution, ratings, and reviews, to make their recommendation. However, these systems often overlook a critical aspect: the evolving skill demand of the job market. This paper focuses on the perspective of academic researchers, working in collaboration with the industry, aiming to develop a course recommender system that incorporates job market skill demands. In light of the job market's rapid changes and the current state of research in course recommender systems, we outline essential properties for course recommender systems to address these demands effectively, including explainable, sequential, unsupervised, and aligned with the job market and user's goals. Our discussion extends to the challenges and research questions this objective entails, including unsupervised skill extraction from job listings, course descriptions, and resumes, as well as predicting recommendations that align with learner objectives and the job market and designing metrics to evaluate this alignment. Furthermore, we introduce an initial system that addresses some existing limitations of course recommender systems using LLMs for skill extraction and Reinforcement Learning (RL) for alignment with the job market. We provide empirical results using open-source data to demonstrate its effectiveness.

PDF HTML Abstract
Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Bookmark Chat Bubble Oval Streamline Icon: https://streamlinehq.com Chat (Pro)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (40)
  1. Complementing educational recommender systems with open learner models. In LAK ’20: 10th International Conference on Learning Analytics and Knowledge, Frankfurt, Germany, March 23-27, 2020, Christoph Rensing and Hendrik Drachsler (Eds.). ACM, 360–365.
  2. Reinforcement learning based recommender systems: A survey. Comput. Surveys 55, 7 (2022), 1–38.
  3. Estimating Skill Proficiency from Resumes. In Pacific-Asia Conference on Knowledge Discovery and Data Mining. Springer, 105–118.
  4. Koen Bothmer and Tim Schlippe. 2023. Skill Scanner: Connecting and Supporting Employers, Job Seekers and Educational Institutions with an AI-Based Recommendation System. In Innovative Approaches to Technology-Enhanced Learning for the Workplace and Higher Education, David Guralnick, Michael E. Auer, and Antonella Poce (Eds.). Springer International Publishing, Cham, 69–80.
  5. Benjamin Clavié and Guillaume Soulié. 2023. Large Language Models as Batteries-Included Zero-Shot ESCO Skills Matchers. arXiv preprint arXiv:2307.03539 (2023).
  6. Jobbert: Understanding job titles through skills. arXiv preprint arXiv:2109.09605 (2021).
  7. Extreme Multi-Label Skill Extraction Training using Large Language Models. arXiv preprint arXiv:2307.10778 (2023).
  8. David J Deming and Kadeem Noray. 2020. Earnings dynamics, changing job skills, and STEM careers. The Quarterly Journal of Economics 135(4) (2020), 1965–2005.
  9. COCO: Semantic-Enriched Collection of Online Courses at Scale with Experimental Use Cases. In Trends and Advances in Information Systems and Technologies, Álvaro Rocha, Hojjat Adeli, Luís Paulo Reis, and Sandra Costanzo (Eds.). Springer International Publishing, Cham, 1386–1396.
  10. A formal study of information retrieval heuristics. In SIGIR 2004: Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Sheffield, UK, July 25-29, 2004, Mark Sanderson, Kalervo Järvelin, James Allan, and Peter Bruza (Eds.). ACM, 49–56. https://doi.org/10.1145/1008992.1009004
  11. Hui Fang and ChengXiang Zhai. 2005. An exploration of axiomatic approaches to information retrieval. In SIGIR 2005: Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Salvador, Brazil, August 15-19, 2005, Ricardo A. Baeza-Yates, Nivio Ziviani, Gary Marchionini, Alistair Moffat, and John Tait (Eds.). ACM, 480–487. https://doi.org/10.1145/1076034.1076116
  12. Finding Paths for Explainable MOOC Recommendation: A Learner Perspective. arXiv preprint arXiv:2312.10082 (2023).
  13. Fine-Grained Extraction and Classification of Skill Requirements in German-Speaking Job Ads. In Proceedings of the Fifth Workshop on Natural Language Processing and Computational Social Science (NLP+CSS). Association for Computational Linguistics, Abu Dhabi, UAE, 14–24. https://doi.org/10.18653/v1/2022.nlpcss-1.2
  14. Goal-Based Course Recommendation. In Proceedings of the 9th International Conference on Learning Analytics & Knowledge (Tempe, AZ, USA) (LAK19). Association for Computing Machinery, New York, NY, USA, 36–45.
  15. Novel online recommendation algorithm for massive open online courses (NoR-MOOCs). Plos one 16, 1 (2021), e0245485.
  16. ESCO: Boosting job matching in Europe with semantic interoperability. Computer 47, 10 (2014), 57–64.
  17. ESCO: Boosting Job Matching in Europe with Semantic Interoperability. Computer 47, 10 (2014), 57–64. https://doi.org/10.1109/MC.2014.283
  18. JOBSKAPE: A Framework for Generating Synthetic Job Postings to Enhance Skill Matching. (2024). arXiv:2402.03242 [cs.CL]
  19. Equality of Learning Opportunity via Individual Fairness in Personalized Recommendations. International Journal of Artificial Intelligence in Education 32 (10 2021), 1–49.
  20. Distributed representations of words and phrases and their compositionality. Advances in neural information processing systems 26 (2013).
  21. Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602 (2013).
  22. Rethinking Skill Extraction in the Job Market Domain using Large Language Models. (2024). arXiv:2402.03832 [cs.CL]
  23. Robert Palmer. 2017. Jobs and skills mismatch in the informal economy. ILO. https://www. ilo. org/wcmsp5/groups/public/—ed_emp/—ifp_skills/documents/publication/wcms_629018. pdf (2017).
  24. Glove: Global vectors for word representation. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). 1532–1543.
  25. Guangyuan Piao and John G Breslin. 2016. Analyzing MOOC entries of professionals on LinkedIn for user modeling and personalized MOOC recommendations. In Proceedings of the 2016 conference on user modeling adaptation and personalization. 291–292.
  26. Reciprocal Peer Recommendation for Learning Purposes. In Proceedings of the 8th International Conference on Learning Analytics and Knowledge (Sydney, New South Wales, Australia) (LAK ’18). Association for Computing Machinery, New York, NY, USA, 226–235.
  27. Stable-baselines3: Reliable reinforcement learning implementations. The Journal of Machine Learning Research 22, 1 (2021), 12348–12355.
  28. Siriporn Sakboonyarat and Panjai Tantatsanawong. 2019. Massive open online courses (MOOCs) recommendation modeling using deep learning. In 2019 23rd International computer science and engineering conference (ICSEC). IEEE, 275–280.
  29. A course hybrid recommender system for limited information scenarios. Journal of Educational Data Mining 14, 3 (Dec. 2022), 162–188. https://jedm.educationaldatamining.org/index.php/JEDM/article/view/608
  30. Skill Based Course Recommendation System. In 2020 IEEE International Conference on Computing, Power and Communication Technologies (GUCON). IEEE, 573–576.
  31. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347 (2017).
  32. Hybrid Explainable Educational Recommender Using Self-attention and Knowledge-Based Systems for E-Learning in MOOC Platforms. In Responsible Data Science, Jimson Mathew, G. Santhosh Kumar, Deepak P., and Joemon M. Jose (Eds.). Springer Nature Singapore, Singapore, 61–74.
  33. Low-resource taxonomy enrichment with pretrained language models. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. 2747–2758.
  34. Xuetao Tian and Feng Liu. 2021. Capacity Tracing-Enhanced Course Recommendation in MOOCs. IEEE Transactions on Learning Technologies 14, 3 (2021), 313–321.
  35. TacoPrompt: A Collaborative Multi-Task Prompt Learning Method for Self-Supervised Taxonomy Completion. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing. 15804–15817.
  36. Eva Zangerle and Christine Bauer. 2022. Evaluating recommender systems: survey and framework. Comput. Surveys 55, 8 (2022), 1–38.
  37. Hierarchical Reinforcement Learning for Course Recommendation in MOOCs. In The Thirty-Third AAAI Conference on Artificial Intelligence, AAAI 2019, The Thirty-First Innovative Applications of Artificial Intelligence Conference, IAAI 2019, The Ninth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2019, Honolulu, Hawaii, USA, January 27 - February 1, 2019. AAAI Press, 435–442.
  38. Kompetencer: Fine-grained Skill Classification in Danish Job Postings via Distant Supervision and Transfer Learning. In Proceedings of the Thirteenth Language Resources and Evaluation Conference. European Language Resources Association, Marseille, France, 436–447. https://aclanthology.org/2022.lrec-1.46
  39. SkillSpan: Hard and Soft Skill Extraction from English Job Postings. In 2022 Annual Conference of the North American Chapter of the Association for Computational Linguistics. Association for Computational Linguistics.
  40. MOOC-Rec: Instructional Video Clip Recommendation for MOOC Forum Questions. In Proceedings of the 15th International Conference on Educational Data Mining, Antonija Mitrovic and Nigel Bosch (Eds.). International Educational Data Mining Society, Durham, United Kingdom, 705–709.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (5)
  1. Jibril Frej (13 papers)
  2. Anna Dai (5 papers)
  3. Syrielle Montariol (22 papers)
  4. Antoine Bosselut (85 papers)
  5. Tanja Käser (45 papers)
Citations (1)
View on Semantic Scholar