Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
129 tokens/sec
GPT-4o
28 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Revealing Networks: Understanding Effective Teacher Practices in AI-Supported Classrooms using Transmodal Ordered Network Analysis (2312.10826v1)

Published 17 Dec 2023 in cs.CY and cs.AI

Abstract: Learning analytics research increasingly studies classroom learning with AI-based systems through rich contextual data from outside these systems, especially student-teacher interactions. One key challenge in leveraging such data is generating meaningful insights into effective teacher practices. Quantitative ethnography bears the potential to close this gap by combining multimodal data streams into networks of co-occurring behavior that drive insight into favorable learning conditions. The present study uses transmodal ordered network analysis to understand effective teacher practices in relationship to traditional metrics of in-system learning in a mathematics classroom working with AI tutors. Incorporating teacher practices captured by position tracking and human observation codes into modeling significantly improved the inference of how efficiently students improved in the AI tutor beyond a model with tutor log data features only. Comparing teacher practices by student learning rates, we find that students with low learning rates exhibited more hint use after monitoring. However, after an extended visit, students with low learning rates showed learning behavior similar to their high learning rate peers, achieving repeated correct attempts in the tutor. Observation notes suggest conceptual and procedural support differences can help explain visit effectiveness. Taken together, offering early conceptual support to students with low learning rates could make classroom practice with AI tutors more effective. This study advances the scientific understanding of effective teacher practice in classrooms learning with AI tutors and methodologies to make such practices visible.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (48)
  1. Vincent Aleven and Kenneth R Koedinger. 2000. Limitations of student control: Do students know when they need help?. In International conference on intelligent tutoring systems. Springer, 292–303.
  2. Robert K Atkinson and Alexander Renkl. 2007. Interactive example-based learning environments: Using interactive elements to encourage effective processing of worked examples. Educational Psychology Review 19 (2007), 375–386.
  3. Why students engage in “gaming the system” behavior in interactive learning environments. Journal of Interactive Learning Research 19, 2 (2008), 185–224.
  4. What Makes Problem-Solving Practice Effective? Comparing Paper and AI Tutoring. In European Conference on Technology Enhanced Learning. Springer, 44–59.
  5. Exploring interactions between computational and critical thinking in model-eliciting activities through epistemic network analysis. In Advances in Quantitative Ethnography: Third International Conference, ICQE 2021, Virtual Event, November 6–11, 2021, Proceedings 3. Springer, 346–361.
  6. Sima Caspari-Sadeghi. 2022. Applying learning analytics in online environments: Measuring learners’ engagement unobtrusively. In Frontiers in Education, Vol. 7. Frontiers, 840947.
  7. Predicting Behaviour Change in Students With Special Education Needs Using Multimodal Learning Analytics. IEEE Access (2023).
  8. Multi-source and multimodal data fusion for predicting academic performance in blended learning university courses. Computers & Electrical Engineering 89 (2021), 106908.
  9. A review on data fusion in multimodal learning analytics and educational data mining. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery 12, 4 (2022), e1458.
  10. Instructional Factors Analysis: A Cognitive Model For Multiple Instructional Interventions. In EDM 2011: 4th International Conference on Educational Data Mining. 61.
  11. The promise and challenges of multimodal learning analytics. British Journal of Educational Technology 51, 5 (2020), 1441–1449.
  12. Dissecting learning tactics in MOOC using ordered network analysis. Journal of Computer Assisted Learning 39, 1 (2023), 154–166.
  13. Classroom Dandelions: Visualising Participant Position, Trajectory and Body Orientation Augments Teachers’ Sensemaking. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–17.
  14. Modelling spatial behaviours in clinical team simulations using epistemic network analysis: methodology and teacher evaluation. In LAK21: 11th International Learning Analytics and Knowledge Conference. 386–396.
  15. Epistemic network analysis of students’ longer written assignments as formative/summative evaluation. In Proceedings of the 8th international conference on learning analytics and knowledge. 126–130.
  16. Preface: CrossMMLA in practice: Collecting, annotating and analyzing multimodal data across spaces. In CEUR Workshop Proceedings, Vol. 2610. CEUR Workshop Proceedings.
  17. The impact of gaming (?) on learning at the fine-grained level. In Proceedings of the 10th International Conference on Intelligent Tutoring Systems (ITS2010) Part, Vol. 1. 194–203.
  18. Peter W Hewson and Mariana G A’B Hewson. 1987. Science teachers’ conceptions of teaching: Implications for teacher education. International Journal of Science Education 9, 4 (1987), 425–440.
  19. SPACLE: investigating learning across virtual and physical spaces using spatial replays. In Proceedings of the Seventh International Learning Analytics & Knowledge Conference. 358–367.
  20. Student learning benefits of a mixed-reality teacher awareness tool in AI-enhanced classrooms. In Artificial Intelligence in Education: 19th International Conference, AIED 2018, London, UK, June 27–30, 2018, Proceedings, Part I 19. Springer, 154–168.
  21. Scoping the emerging field of quantitative ethnography: opportunities, challenges and future directions. In International Conference on Quantitative Ethnography. Springer, 3–17.
  22. Teacher Noticing and Student Learning in Human-AI Partnered Classrooms: A Multimodal Analysis. In Proceedings of the Annual Meeting for the International Society of the Learning Sciences (ISLS2023).
  23. A Spatiotemporal Analysis of Teacher Practices in Supporting Student Learning and Engagement in an AI-Enabled Classroom. In International Conference on Artificial Intelligence in Education. Springer, 450–462.
  24. Multimodal Analytics for Collaborative Teacher Reflection of Human-AI Hybrid Teaching: Design Opportunities and Constraints. In European Conference on Technology Enhanced Learning. 580–585.
  25. Exploring how teachers support students’ mathematical learning in computer-directed learning environments. Information and Learning Sciences 121, 1/2 (2019), 52–78.
  26. A data repository for the EDM community: The PSLC DataShop. Handbook of educational data mining 43 (2010), 43–56.
  27. Ran Liu and Kenneth R Koedinger. 2017. Towards Reliable and Valid Measurement of Individualized Student Parameters. In EDM 2017: 10th International Conference on Educational Data Mining. 135–142.
  28. What exactly do students learn when they practice equation solving? refining knowledge components with the additive factors model. In Proceedings of the 8th International Conference on Learning Analytics and Knowledge. 399–408.
  29. Where is the teacher? Digital analytics for classroom proxemics. Journal of Computer Assisted Learning 36, 5 (2020), 741–762.
  30. Annelies Raes. 2022. Exploring student and teacher experiences in hybrid learning environments: Does presence matter? Postdigital Science and Education 4, 1 (2022), 138–159.
  31. B-learning and technology: Enablers for university education resilience. An experience case under COVID-19 in Spain. Sustainability 13, 6 (2021), 3532.
  32. Using text replay tagging to produce detectors of systematic experimentation behavior patterns. In Educational Data Mining 2010.
  33. Teachers, computer tutors, and teaching: The artificially intelligent tutor as an agent for classroom change. American Educational Research Journal 31, 3 (1994), 579–607.
  34. A Case for (Inter) Action: The Role of Log Data in QE. In International Conference on Quantitative Ethnography. Springer, 395–408.
  35. David Williamson Shaffer. 2017. Quantitative ethnography. Madison, WI: Cathcart Press.
  36. Transmodal Analysis [manuscript in preparation]. ([n. d.]).
  37. Optimizing Parameters for Accurate Position Data Mining in Diverse Classrooms Layouts. EDM 2023: 16th International Conference on Educational Data Mining, 6310–317.
  38. Ordered network analysis. In International Conference on Quantitative Ethnography. Springer, 101–116.
  39. Challenges and opportunities for multi-device management in classrooms. ACM Transactions on Computer-Human Interaction (2022).
  40. How teacher characteristics relate to how teachers use dashboards: Results from two case studies in K-12. Journal of Learning Analytics 8, 2 (2021), 6–21.
  41. Modeling Collaborative Discourse with ENA Using a Probabilistic Function. In International Conference on Quantitative Ethnography. Springer, 132–145.
  42. Simplification of epistemic networks using parsimonious removal with interpretive alignment. In International Conference on Quantitative Ethnography. Springer, 137–151.
  43. Alyssa Friend Wise and David Williamson Shaffer. 2015. Why theory matters more than ever in the age of big data. Journal of Learning Analytics 2, 2 (2015), 5–13.
  44. Effects of a teacher dashboard for an intelligent tutoring system on teacher knowledge, lesson planning, lessons and student learning. In Data Driven Approaches in Digital Education: 12th European Conference on Technology Enhanced Learning, EC-TEL 2017, Tallinn, Estonia, September 12–15, 2017, Proceedings 12. Springer, 315–329.
  45. How do teachers use open learning spaces? Mapping from teachers’ socio-spatial data to spatial pedagogy. In LAK22: 12th international learning analytics and knowledge conference. 87–97.
  46. Pair-Up: Prototyping Human-AI Co-orchestration of Dynamic Transitions between Individual and Collaborative Learning in the Classroom. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–17.
  47. Can strategic behaviour facilitate confusion resolution? The interplay between confusion and metacognitive strategies in Betty’s Brain. Journal of Learning Analytics 8, 3 (2021), 28–44.
  48. Analysing Verbal Communication in Embodied Team Learning Using Multimodal Data and Ordered Network Analysis. In International Conference on Artificial Intelligence in Education. Springer, 242–254.
Citations (2)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets