Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
80 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
7 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Iris: An AI-Driven Virtual Tutor For Computer Science Education (2405.08008v2)

Published 9 May 2024 in cs.HC and cs.AI

Abstract: Integrating AI-driven tools in higher education is an emerging area with transformative potential. This paper introduces Iris, a chat-based virtual tutor integrated into the interactive learning platform Artemis that offers personalized, context-aware assistance in large-scale educational settings. Iris supports computer science students by guiding them through programming exercises and is designed to act as a tutor in a didactically meaningful way. Its calibrated assistance avoids revealing complete solutions, offering subtle hints or counter-questions to foster independent problem-solving skills. For each question, it issues multiple prompts in a Chain-of-Thought to GPT-3.5-Turbo. The prompts include a tutor role description and examples of meaningful answers through few-shot learning. Iris employs contextual awareness by accessing the problem statement, student code, and automated feedback to provide tailored advice. An empirical evaluation shows that students perceive Iris as effective because it understands their questions, provides relevant support, and contributes to the learning process. While students consider Iris a valuable tool for programming exercises and homework, they also feel confident solving programming tasks in computer-based exams without Iris. The findings underscore students' appreciation for Iris' immediate and personalized support, though students predominantly view it as a complement to, rather than a replacement for, human tutors. Nevertheless, Iris creates a space for students to ask questions without being judged by others.

PDF HTML Abstract
Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Bookmark Chat Bubble Oval Streamline Icon: https://streamlinehq.com Chat (Pro)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (33)
  1. Supporting self-directed learning and self-assessment using TeacherGAIA, a generative AI chatbot application: Learning approaches and prompt engineering. Learning: Research and Practice 9, 2 (2023), 135–147.
  2. Programming Is Hard - Or at Least It Used to Be: Educational Opportunities and Challenges of AI Code Generation. In Proceedings of the 54th ACM Technical Symposium on Computer Science Education. ACM, 500–506. https://doi.org/10.1145/3545945.3569759
  3. Language models are few-shot learners. In Proceedings of the 34th International Conference on Neural Information Processing Systems. Curran Associates Inc.
  4. AI Chatbots as Multi-Role Pedagogical Agents: Transforming Engagement in CS Education. ArXiv abs/2308.03992 (2023). https://api.semanticscholar.org/CorpusID:260704621
  5. Artificial Intelligence (AI) Student Assistants in the Classroom: Designing Chatbots to Support Student Success. Information Systems Frontiers 25, 1 (2022), 161–182. https://doi.org/10.1007/s10796-022-10291-4
  6. To Elicit Or To Tell: Does It Matter?. In International Conference on Artificial Intelligence in Education. 197–204. https://doi.org/10.3233/978-1-60750-028-5-197
  7. Intelligent tutoring systems for programming education: a systematic review. In Proceedings of the 20th Australasian Computing Education Conference. ACM, 53–62. https://doi.org/10.1145/3160489.3160492
  8. Chatbot in a Campus Environment: Design of LiSA, a Virtual Assistant to Help Students in Their University Life. In Human-Computer Interaction. Interaction Technologies, Masaaki Kurosu (Ed.). Springer International Publishing, 103–116.
  9. AI-Tutoring in Software Engineering Education. In 46th International Conference on Software Engineering: Software Engineering Education and Training, ICSE (SEET). IEEE/ACM.
  10. Chatbot learning partners: Connecting learning experiences, interest and competence. Computers in Human Behavior 93 (2019), 279–289. https://doi.org/10.1016/j.chb.2018.12.023
  11. Exploring the Responses of Large Language Models to Beginner Programmers’ Help Requests. In Proceedings of the Conference on International Computing Education Research. ACM. https://doi.org/10.1145/3568813.3600139
  12. ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences 103 (2023), 102274. https://doi.org/10.1016/j.lindif.2023.102274
  13. Better Zero-Shot Reasoning with Role-Play Prompting. arXiv:2308.07702
  14. Stephan Krusche and Andreas Seitz. 2018. Artemis: An Automatic Assessment Management System for Interactive Learning. In Proceedings of the 49th Technical Symposium on Computer Science Education (SIGCSE). ACM, 284–289.
  15. Interactive Learning: Increasing Student Participation Through Shorter Exercise Cycles. In Proceedings of the 19th Australasian Computing Education Conference. ACM, 17–26.
  16. An interactive learning method to engage students in modeling. In 42nd International Conference on Software Engineering, Software Engineering Education and Training. ACM, 12–22.
  17. Nir Kshetri. 2023. The Economics of Generative Artificial Intelligence in the Academic Industry. Computer 56, 8 (2023), 77–83. https://doi.org/10.1109/MC.2023.3278089
  18. Comparing Code Explanations Created by Students and Large Language Models. In Proceedings of the Conference on Innovation and Technology in Computer Science Education. ACM, 124–130. https://doi.org/10.1145/3587102.3588785
  19. CAMEL: Communicative Agents for ”Mind” Exploration of Large Language Model Society. In Advances in Neural Information Processing Systems, Vol. 36. Curran Associates, Inc., 51991–52008.
  20. CodeHelp: Using Large Language Models with Guardrails for Scalable Support in Programming Classes. In Proceedings of the 23rd Koli Calling International Conference on Computing Education Research. ACM, Article 8, 11 pages. https://doi.org/10.1145/3631802.3631830
  21. An analysis of children’ interaction with an AI chatbot and its impact on their interest in reading. Comput. Educ. 189, C (2022). https://doi.org/10.1016/j.compedu.2022.104576
  22. Teaching CS50 with AI: Leveraging Generative Artificial Intelligence in Computer Science Education. In Proceedings of the 55th Technical Symposium on Computer Science Education. ACM. https://doi.org/10.1145/3626253.3635427
  23. ChatGPT and large language models in academia: opportunities and challenges. BioData Mining 16 (2023).
  24. Chinedu Wilfred Okonkwo and Abejide Ade-Ibijola. 2021. Chatbots applications in education: A systematic review. Computers and Education: Artificial Intelligence 2 (2021).
  25. AI and Web-Based Human-Like Interactive University Chatbot (UNIBOT). In 3rd International conference on Electronics, Communication and Aerospace Technology. 148–150. https://doi.org/10.1109/ICECA.2019.8822176
  26. Transformed by Transformers: Navigating the AI Coding Revolution for Computing Education: An ITiCSE Working Group Conducted by Humans. In Proceedings of the Conference on Innovation and Technology in Computer Science Education (Turku, Finland). ACM, 561–562. https://doi.org/10.1145/3587103.3594206
  27. Chatbot for university related FAQs. In International Conference on Advances in Computing, Communications and Informatics. 1525–1530. https://doi.org/10.1109/ICACCI.2017.8126057
  28. A. Renkl. 1999. Learning mathematics from worked-out examples: Analyzing and fostering self-explanations. European Journal of Psychology of Education 14 (1999), 477–488. https://doi.org/10.1007/BF03172974
  29. The Programmer’s Assistant: Conversational Interaction with a Large Language Model for Software Development. In Proceedings of the 28th International Conference on Intelligent User Interfaces. ACM. https://doi.org/10.1145/3581641.3584037
  30. Per Runeson and Martin Höst. 2009. Guidelines for conducting and reporting case study research in software engineering. Empirical Software Engineering 14, 2 (2009), 131–164.
  31. Chain-of-thought prompting elicits reasoning in large language models. In Proceedings of the 36th International Conference on Neural Information Processing Systems. Curran Associates Inc.
  32. Joseph Weizenbaum. 1966. ELIZA—a computer program for the study of natural language communication between man and machine. Commun. ACM 9, 1 (1966), 36–45.
  33. Large Language Models are Diverse Role-Players for Summarization Evaluation. In Natural Language Processing and Chinese Computing: 12th National CCF Conference, NLPCC 2023. Springer-Verlag, 695–707. https://doi.org/10.1007/978-3-031-44693-1_54
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (3)
  1. Patrick Bassner (3 papers)
  2. Eduard Frankford (4 papers)
  3. Stephan Krusche (17 papers)
Citations (8)
View on Semantic Scholar