Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
119 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

VizGroup: An AI-Assisted Event-Driven System for Real-Time Collaborative Programming Learning Analytics (2404.08743v2)

Published 12 Apr 2024 in cs.HC

Abstract: Programming instructors often conduct collaborative learning activities, like Peer Instruction, to foster a deeper understanding in students and enhance their engagement with learning. These activities, however, may not always yield productive outcomes due to the diversity of student mental models and their ineffective collaboration. In this work, we introduce VizGroup, an AI-assisted system that enables programming instructors to easily oversee students' real-time collaborative learning behaviors during large programming courses. VizGroup leverages LLMs to recommend event specifications for instructors so that they can simultaneously track and receive alerts about key correlation patterns between various collaboration metrics and ongoing coding tasks. We evaluated VizGroup with 12 instructors in a comparison study using a dataset collected from a Peer Instruction activity that was conducted in a large programming lecture. The results showed that VizGroup helped instructors effectively overview, narrow down, and track nuances throughout students' behaviors.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (58)
  1. 2023. Meta-Learning Student Feedback to 16,000 Solutions. https://ai.stanford.edu/blog/prototransformer/, Accessed: April, 2024.
  2. EduSense: Practical classroom sensing at Scale. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 3 (2019), 1–26.
  3. Understanding user preferences towards rule-based notification deferral. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. 1–6.
  4. Does the whole exceed its parts? The effect of AI explanations on complementary team performance. 2020. arXiv preprint arxiv:2006.14779 (2020).
  5. Factors affecting the adoption of peer instruction in computing courses. In Proceedings of the Working Group Reports on Global Computing Education. 1–25.
  6. Software agents for process monitoring and notification. In Proceedings of the 2004 ACM Symposium on Applied Computing (Nicosia, Cyprus) (SAC ’04). Association for Computing Machinery, New York, NY, USA, 94–100. https://doi.org/10.1145/967900.967921
  7. Characterizing guidance in visual analytics. IEEE transactions on visualization and computer graphics 23, 1 (2016), 111–120.
  8. AT Chamillard. 2011. Using a student response system in CS1 and CS2. In Proceedings of the 42nd ACM technical symposium on Computer science education. 299–304.
  9. Peakvizor: Visual analytics of peaks in video clickstreams from massive open online courses. IEEE transactions on visualization and computer graphics 22, 10 (2015), 2315–2330.
  10. EdCode: Towards Personalized Support at Scale for Remote Assistance in CS Education. In 2020 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). IEEE, 1–5.
  11. Codeon: On-demand software development assistance. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 6220–6231.
  12. Towards providing on-demand expert support for software developers. In Proceedings of the 2016 CHI conference on human factors in computing systems. 3192–3203.
  13. Doug Clow. 2013. An overview of learning analytics. Teaching in Higher Education 18, 6 (2013), 683–695.
  14. Catherine H Crouch and Eric Mazur. 2001. Peer instruction: Ten years of experience and results. American journal of physics 69, 9 (2001), 970–977.
  15. Uncovering ChatGPT’s Capabilities in Recommender Systems. In Proceedings of the 17th ACM Conference on Recommender Systems (Singapore, Singapore) (RecSys ’23). Association for Computing Machinery, New York, NY, USA, 1126–1132. https://doi.org/10.1145/3604915.3610646
  16. Group communication analysis: A computational linguistics approach for detecting sociocognitive roles in multiparty interactions. Behavior research methods 51 (2019), 1007–1041.
  17. Collaborative problem-solving education for the twenty-first-century workforce. Nature human behaviour 2, 6 (2018), 367–369.
  18. Foobaz: Variable name feedback for student code at scale. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. 609–617.
  19. OverCode: Visualizing variation in student solutions to programming problems at scale. ACM Transactions on Computer-Human Interaction (TOCHI) 22, 2 (2015), 1–35.
  20. Advancing the science of collaborative problem solving. Psychological science in the public interest 19, 2 (2018), 59–92.
  21. Scott Grissom and Mark J Van Gorp. 2000. A practical approach to integrating active and collaborative learning into the introductory computer science curriculum. In Proceedings of the seventh annual CCSC Midwestern conference on Small colleges. 95–100.
  22. Philip J Guo. 2015. Codeopticon: Real-time, one-to-many human tutoring for computer programming. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. 599–608.
  23. Richard R Hake. 1998. Interactive-engagement versus traditional methods: A six-thousand-student survey of mechanics test data for introductory physics courses. American journal of Physics 66, 1 (1998), 64–74.
  24. Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology. Vol. 52. Elsevier, 139–183.
  25. Writing reusable code feedback at scale with mixed-initiative program synthesis. In Proceedings of the Fourth (2017) ACM Conference on Learning@ Scale. 89–98.
  26. Nurture: notifying users at the right time using reinforcement learning. In Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers. 1194–1201.
  27. The classroom as a dashboard: Co-designing wearable cognitive augmentation for K-12 teachers. In Proceedings of the 8th international conference on learning Analytics and knowledge. 79–88.
  28. Technology probes: inspiring design for and with families. In Proceedings of the SIGCHI conference on Human factors in computing systems. 17–24.
  29. Mark C James and Shannon Willoughby. 2011. Listening to student conversations during clicker questions: What you have not heard might surprise you! American Journal of Physics 79, 1 (2011), 123–132.
  30. David W Johnson and Roger T Johnson. 2013. Cooperation and the use of technology. In Handbook of research on educational communications and technology. Routledge, 777–803.
  31. Visual analytics: Definition, process, and challenges. Springer.
  32. Visual analytics: Scope and challenges. Springer.
  33. Talkabout: Making distance matter with small groups in massive classes. In Proceedings of the 18th ACM conference on computer supported cooperative work & social computing. 1116–1128.
  34. PeerStudio: rapid peer feedback emphasizes revision and improves performance. In Proceedings of the second (2015) ACM conference on learning@ scale. 75–84.
  35. Can peer instruction be effective in upper-division computer science courses? ACM Transactions on Computing Education (TOCE) 13, 3 (2013), 1–22.
  36. Alert now or never: Understanding and predicting notification preferences of smartphone users. ACM Transactions on Computer-Human Interaction 29, 5 (2023), 1–33.
  37. Glancee: An adaptable system for instructors to grasp student learning status in synchronous online classes. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–25.
  38. Programming by choice: urban youth learning programming with scratch. In Proceedings of the 39th SIGCSE technical symposium on Computer science education. 367–371.
  39. Alerts as coordination mechanisms: implications for designing alerts for multidisciplinary and shared decision making. Proceedings of the ACM on Human-Computer Interaction 6, GROUP (2022), 1–14.
  40. ” Pop-Up Alerts are the Bane of My Existence”: Designing Alerts for Cognitive Aids Used in Time-Critical Medical Settings. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. 1–7.
  41. Affectivespotlight: Facilitating the communication of affective responses from audience members during online presentations. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–13.
  42. Halving fail rates using peer instruction: a study of four computer science courses. In Proceeding of the 44th ACM technical symposium on Computer science education. 177–182.
  43. Peer instruction: Do students really learn from peer discussion in computing?. In Proceedings of the seventh international workshop on Computing education research. 45–52.
  44. Leo Porter and Beth Simon. 2013. Retaining nearly one-third more majors with a trio of instructional best practices in CS1. In Proceeding of the 44th ACM technical symposium on Computer science education. 165–170.
  45. Ivan Poupyrev. 2023. The Ultimate Interface. In Adjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (UIST ’23 Adjunct). Association for Computing Machinery, New York, NY, USA, Article 111, 2 pages. https://doi.org/10.1145/3586182.3624511
  46. David Preston. 2005. Pair programming as a model of collaborative learning: a review of the research. Journal of Computing Sciences in colleges 20, 4 (2005), 39–45.
  47. Michael Prince. 2004. Does active learning work? A review of the research. Journal of engineering education 93, 3 (2004), 223–231.
  48. Groupnamics: Designing an interface for overviewing and managing parallel group discussions in an online classroom. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–18.
  49. Collaboration analytics—current state and potential futures. Journal of Learning Analytics 8, 1 (2021), 1–12.
  50. How we teach impacts student learning: Peer instruction vs. lecture in CS0. In Proceeding of the 44th ACM technical symposium on Computer science education. 41–46.
  51. Barbara Leigh Smith and Jean T MacGregor. 1992. What is collaborative learning.
  52. Using Peer Review to Teach Software Testing. In Proceedings of the Ninth Annual International Conference on International Computing Education Research (Auckland, New Zealand) (ICER ’12). Association for Computing Machinery, New York, NY, USA, 93–98. https://doi.org/10.1145/2361276.2361295
  53. Karthikeyan Umapathy and Albert D Ritzhaupt. 2017. A meta-analysis of pair-programming in computer programming courses: Implications for educational practice. ACM Transactions on Computing Education (TOCE) 17, 4 (2017), 1–13.
  54. PuzzleMe: Leveraging Peer Assessment for In-Class Programming Exercises. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (2021), 1–24.
  55. Eleven guidelines for implementing pair programming in the classroom. In Agile 2008 Conference. IEEE, 445–452.
  56. How Pairing by Code Similarity Influences Discussions in Peer Learning. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. 1–6.
  57. Pair-up: prototyping human-AI co-orchestration of dynamic transitions between individual and collaborative learning in the classroom. In Proceedings of the 2023 CHI conference on human factors in computing systems. 1–17.
  58. VizProg: Identifying Misunderstandings By Visualizing Students’ Coding Progress. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–16.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (6)
  1. Xiaohang Tang (16 papers)
  2. Sam Wong (6 papers)
  3. Kevin Pu (5 papers)
  4. Xi Chen (1036 papers)
  5. Yalong Yang (32 papers)
  6. Yan Chen (272 papers)
Citations (4)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets