Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
110 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
44 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Heterogenous Network Analytics of Small Group Teamwork: Using Multimodal Data to Uncover Individual Behavioral Engagement Strategies (2312.08786v1)

Published 14 Dec 2023 in cs.SI

Abstract: Individual behavioral engagement is an important indicator of active learning in collaborative settings, encompassing multidimensional behaviors mediated through various interaction modes. Little existing work has explored the use of multimodal process data to understand individual behavioral engagement in face-to-face collaborative learning settings. In this study we bridge this gap, for the first time, introducing a heterogeneous tripartite network approach to analyze the interconnections among multimodal process data in collaborative learning. Students' behavioral engagement strategies are analyzed based on their interaction patterns with various spatial locations and verbal communication types using a heterogeneous tripartite network. The multimodal collaborative learning process data were collected from 15 teams of four students. We conducted stochastic blockmodeling on a projection of the heterogeneous tripartite network to cluster students into groups that shared similar spatial and oral engagement patterns. We found two distinct clusters of students, whose characteristic behavioural engagement strategies were identified by extracting interaction patterns that were statistically significant relative to a multinomial null model. The two identified clusters also exhibited a statistically significant difference regarding students' perceived collaboration satisfaction and teacher-assessed team performance level. This study advances collaboration analytics methodology and provides new insights into personalized support in collaborative learning.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (57)
  1. Alexander Alonso and D Dunleavy. 2012. Building teamwork skills in healthcare: the case for communication and coordination competencies. In Improving patient safety through teamwork and team training, Eduardo Salas and Karen Frush (Eds.). Oxford University Press, 41–58.
  2. Network analysis in the social sciences. science 323, 5916 (2009), 892–895.
  3. Patrick W Brady and Linda M Goldenhar. 2014. A qualitative study examining the influences on situation awareness and the identification, mitigation and escalation of recognised patient risk. BMJ Quality & Safety 23, 2 (2014), 153–161. https://doi.org/10.1136/bmjqs-2012-001747
  4. Situated cognition and the culture of learning. Educational Researcher 18, 1 (1989), 32–42.
  5. Shared Leadership in Teams: An Investigation of Antecedent Conditions and Performance. Academy of Management Journal 50, 5 (2007), 1217–1234. https://doi.org/10.5465/amj.2007.20159921
  6. Quantitative approach to collaborative learning: Performance prediction, individual assessment, and group composition. International Journal of Computer-Supported Collaborative Learning 11 (2016), 187–225.
  7. Xiuyu Chen and Shihui Feng. 2023. Exploring the relationships between social presence and teaching presence in online video-based learning. Journal of Computer Assisted Learning (2023).
  8. The promise and challenges of multimodal learning analytics. BJET 51, 5 (Sept. 2020), 1441–1449.
  9. Marielle Dado and Daniel Bodemer. 2017. A review of methodological applications of social network analysis in computer-supported collaborative learning. Educational Research Review 22 (2017), 159–180.
  10. Pierre Dillenbourg. 1999. What do you mean by collaborative learning?
  11. Modelling spatial behaviours in clinical team simulations using epistemic network analysis: methodology and teacher evaluation. In LAK21: 11th International Learning Analytics and Knowledge Conference. 386–396.
  12. Juliene Madureira Ferreira. 2021. What if we look at the body? An embodied perspective of collaborative learning. Educational Psychology Review 33, 4 (2021), 1455–1473.
  13. School engagement: Potential of the concept, state of the evidence. Review of educational research 74, 1 (2004), 59–109.
  14. Let’s not forget: Learning analytics are about learning. TechTrends 59 (2015), 64–71.
  15. SENS: Network analytics to combine social and cognitive perspectives of collaborative learning. Computers in Human Behavior 92 (2019), 562–577.
  16. Using odds ratios as effect sizes for meta-analysis of dichotomous data: a primer on methods and issues. Psychological methods 3, 3 (1998), 339.
  17. Said Hadjerrouit. 2016. Assessing the level of collaborative writing in a wiki-based environment: A case study in teacher education. Competencies in Teaching, Learning and Educational Leadership in the Digital Age: Papers from CELDA 2014 (2016), 197–216.
  18. Self-regulation, co-regulation, and shared regulation in collaborative learning environments. In Handbook of self-regulation of learning and performance. Routledge, 83–106.
  19. Communication in interdisciplinary teams: exploring closed-loop communication during in situ trauma team training. BMJ Open 3, 10 (2013). https://doi.org/10.1136/bmjopen-2013-003525
  20. Stochastic blockmodels: First steps. Social networks 5, 2 (1983), 109–137.
  21. Enhancing situation awareness via automated situation assessment. IEEE Communications Magazine 48, 3 (2010), 146–152. https://doi.org/10.1109/MCOM.2010.5434386
  22. Clinical handover: critical communications. Medical Journal of Australia 190, 11 (2009), 108–109. https://doi.org/10.5694/j.1326-5377.2009.tb02613.x
  23. Brian Karrer and Mark EJ Newman. 2011. Stochastic blockmodels and community structure in networks. Physical review E 83, 1 (2011), 016107.
  24. Hae-Young Kim. 2017. Statistical notes for clinical researchers: Chi-squared test and Fisher’s exact test. Restorative dentistry & endodontics 42, 2 (2017), 152–155.
  25. Paul A Kirschner and Gijsbert Erkens. 2013. Toward a framework for CSCL research. Educational Psychologist 48, 1 (2013), 1–8.
  26. Jean Lave and Etienne Wenger. 1991. Situated learning: Legitimate peripheral participation. Cambridge university press.
  27. Students’ sense-making of personalised feedback based on learning analytics. Australasian Journal of Educational Technology 36, 6 (2020), 15–33.
  28. What do you mean by collaboration analytics? A conceptual model. Journal of Learning Analytics (2021).
  29. Mary L Mchugh. 2012. Interrater reliability: the kappa statistic. Biochemia medica 22, 3 (2012), 276–282.
  30. Patrick E McKnight and Julius Najab. 2010. Mann-Whitney U Test. The Corsini encyclopedia of psychology (2010), 1–1.
  31. Identifying key nursing and team behaviours to achieve high reliability. Journal of Nursing Management 17, 2 (2009), 247–255. https://doi.org/10.1111/j.1365-2834.2009.00978.x
  32. Many are the ways to learn identifying multi-modal behavioral profiles of collaborative learning in constructivist activities. International Journal of Computer-Supported Collaborative Learning 16, 4 (2021), 485–523.
  33. Mark Newman. 2018. Networks. Oxford university press.
  34. Tiago P Peixoto. 2014. Efficient Monte Carlo and greedy heuristic for the inference of stochastic block models. Physical Review E 89, 1 (2014), 012804.
  35. Forum posts, communication patterns, and relational structures: A multi-level view of discussions in online courses. Educational technology research and development (2023), 1–24.
  36. The nature, characteristics and patterns of perinatal critical events teams. Advances in Patient Safety: New Directions and Alternative Approaches (Vol. 3: Performance and Tools) (2008).
  37. Where are you? Exploring micro-location in indoor learning environments. IEEE Access 8 (2020), 125776–125785.
  38. Is there a “Big Five” in Teamwork? Small Group Research 36, 5 (2005), 555–599.
  39. A tutorial on epistemic network analysis: Analyzing the structure of connections in cognitive, social, and interaction data. Journal of Learning Analytics 3, 3 (2016), 9–45.
  40. Kshitij Sharma and Michail Giannakos. 2020. Multimodal data capabilities for learning: What can multimodal data tell us about learning? British Journal of Educational Technology 51, 5 (2020), 1450–1484.
  41. A survey of heterogeneous information network analysis. IEEE Transactions on Knowledge and Data Engineering 29, 1 (2016), 17–37.
  42. Gerry Stahl. 2004. Building collaborative knowing: Elements of a social theory of CSCL. In What we know about CSCL: And implementing it in higher education. Springer, 53–85.
  43. Planning, Shared Mental Models, and Coordinated Performance: An Empirical Link Is Established. Human Factors 41, 1 (1999), 61–71. https://doi.org/10.1518/001872099779577273
  44. Jan-Willem Strijbos and Maarten F De Laat. 2010. Developing the role concept for computer-supported collaborative learning: An explorative synthesis. Computers in human behavior 26, 4 (2010), 495–505.
  45. Zachari Swiecki and David Williamson Shaffer. 2020. iSENS: an integrated approach to combining epistemic and social network analyses. In Proceedings of the tenth International Conference on Learning Analytics & Knowledge. 305–313.
  46. Tensorial and bipartite block models for link prediction in layered networks and temporal networks. Physical Review E 99, 3 (2019), 032307.
  47. Guglielmo TREnTIn. 2009. Using a wiki to evaluate individual contribution to a collaborative learning project. Journal of computer assisted learning 25, 1 (2009), 43–55.
  48. Team learning: building shared mental models. Instructional Science 39, 3 (2011), 283–301. https://doi.org/10.1007/s11251-010-9128-3
  49. Lev Semenovich Vygotsky and Michael Cole. 1978. Mind in society: Development of higher psychological processes. Harvard university press.
  50. SeNA: Modelling Socio-spatial Analytics on Homophily by Integrating Social and Epistemic Network Analysis. In LAK23: 13th International Learning Analytics and Knowledge Conference. 22–32.
  51. Characterising individual-level collaborative learning behaviours using ordered network analysis and wearable sensors. In Proceedings of the 5th International Conference on Quantitative Ethnography. Springer, in press.
  52. Socio-spatial Learning Analytics in Co-located Collaborative Learning Spaces: A Systematic Literature Review. Journal of Learning Analytics (2023), 1–19.
  53. Takemi Yanagimoto. 1989. The inverse binomial distribution as a statistical model. Communications in Statistics-Theory and Methods 18, 10 (1989), 3625–3633.
  54. Tzu-Chi Yen and Daniel B Larremore. 2020. Community detection in bipartite networks with stochastic block models. Physical Review E 102, 3 (2020), 032309.
  55. Using online learner trace data to understand the cohesion of teams in higher education. Journal of Computer Assisted Learning (2023).
  56. METS: multimodal learning analytics of embodied teamwork learning. In LAK23: 13th International Learning Analytics and Knowledge Conference. 186–196.
  57. Xinran Zhu and Bodong Chen. 2023. Understanding Idea Creation in Collaborative Discourse through Networks: The Joint Attention-Interaction-Creation (AIC) Framework. arXiv preprint arXiv:2305.16262 (2023).
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (5)
  1. Shihui Feng (6 papers)
  2. Lixiang Yan (16 papers)
  3. Linxuan Zhao (10 papers)
  4. Roberto Martinez Maldonado (1 paper)
  5. Dragan Gašević (32 papers)
Citations (1)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com