Graph Enhanced Reinforcement Learning for Effective Group Formation in Collaborative Problem Solving (2403.10006v1)
Abstract: This study addresses the challenge of forming effective groups in collaborative problem-solving environments. Recognizing the complexity of human interactions and the necessity for efficient collaboration, we propose a novel approach leveraging graph theory and reinforcement learning. Our methodology involves constructing a graph from a dataset where nodes represent participants, and edges signify the interactions between them. We conceptualize each participant as an agent within a reinforcement learning framework, aiming to learn an optimal graph structure that reflects effective group dynamics. Clustering techniques are employed to delineate clear group structures based on the learned graph. Our approach provides theoretical solutions based on evaluation metrics and graph measurements, offering insights into potential improvements in group effectiveness and reductions in conflict incidences. This research contributes to the fields of collaborative work and educational psychology by presenting a data-driven, analytical approach to group formation. It has practical implications for organizational team building, classroom settings, and any collaborative scenario where group dynamics are crucial. The study opens new avenues for exploring the application of graph theory and reinforcement learning in social and behavioral sciences, highlighting the potential for empirical validation in future work.
- Laurie Miller Nelson. Collaborative Problem Solving. In Instructional-design Theories and Models, pages 241–267. Routledge, 1999.
- Advancing the science of collaborative problem solving. psychological science in the public interest, 19(2):59–92, 2018.
- The effect of expertise on collaborative problem solving. Thinking & Reasoning, 18(1):32–58, 2012.
- An analysis of student collaborative problem solving activities mediated by collaborative simulations. Computers & Education, 114:222–235, 2017.
- Matching data-driven models of group interactions to video analysis of collaborative problem solving on tablet computers. In International Conference of the Learning Sciences, 2018.
- Optimized group formation for solving collaborative tasks. The VLDB Journal, 28:1–23, 2019.
- Machine learning for science and society, 2014.
- Hitskt: A hierarchical transformer model for session-aware knowledge tracing. Knowledge-Based Systems, page 111300, 2023.
- Non-intrusive load monitoring for feeder-level EV charging detection: Sliding window-based approaches to offline and online detection, 2023. arXiv:2312.01887 [cs, eess].
- A review: Knowledge reasoning over knowledge graph. Expert Systems with Applications, 141:112948, 2020.
- DeepPath: A reinforcement learning method for knowledge graph reasoning, 2018. arXiv:1707.06690 [cs].
- Climate finance: Mapping air pollution and finance market in time series. Econometrics, 9(4):43, 2021.
- Dynamic knowledge graph reasoning based on deep reinforcement learning. Knowledge-Based Systems, 241:108235, 2022.
- Grl: Knowledge graph completion with gan-based reinforcement learning. Knowledge-Based Systems, 209:106421, 2020.
- Dapath: Distance-aware knowledge graph reasoning based on deep reinforcement learning. Neural Networks, 135:1–12, 2021.
- Minimum message length in hybrid arma and lstm model forecasting. Entropy, 23(12):1601, 2021.
- In search of conversational grain size: Modeling semantic structure using moving stanza windows. Journal of Learning Analytics, 4(3):123–139, 2017.
- David A Hofmann. Overcoming the obstacles to cross-functional decision making: laying the groundwork for collaborative problem solving. Organizational Dynamics, 44(1):17–25, 2015.
- Collaboration in the 21st century: The theory, assessment, and teaching of collaborative problem solving. Computers in Human Behavior, 104:106134, 2020.
- The construction of shared knowledge in collaborative problem solving. In Claire O’Malley, editor, Computer Supported Collaborative Learning, NATO ASI Series, pages 69–97, Berlin, Heidelberg, 1995. Springer.
- Automated code discovery via graph neural networks and generative ai. In International Conference on Quantitative Ethnography, pages 438–454. Springer, 2023.
- Neural epistemic network analysis: Combining graph neural networks and epistemic network analysis to model collaborative processes. In Proceedings of the 14th Learning Analytics and Knowledge Conference, pages 157–166, 2024.
- An optimized group formation scheme to promote collaborative problem-based learning. Computers & Education, 133:94–115, 2019.
- Ning Ding. Visualizing the sequential process of knowledge elaboration in computer-supported collaborative problem solving. Computers & Education, 52(2):509–519, 2009.
- Effects of group experience and information distribution on collaborative learning. Instructional Science, 47:531–550, 2019.
- Collective choice, collaboration, and communication. Annual Review of Psychology, 71:589–612, 2020.
- A comprehensive survey on graph neural networks. IEEE transactions on neural networks and learning systems, 32(1):4–24, 2020.
- Reinforcement learning. Adaptation, learning, and optimization, 12(3):729, 2012.
- An Introduction to Deep Reinforcement Learning. Foundations and Trends® in Machine Learning, 11(3-4):219–354, 2018. Publisher: Now Publishers, Inc.
- Robust multi-agent reinforcement learning via minimax deep deterministic policy gradient. In Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence and Thirty-First Innovative Applications of Artificial Intelligence Conference and Ninth AAAI Symposium on Educational Advances in Artificial Intelligence, AAAI’19/IAAI’19/EAAI’19, pages 4213–4220, Honolulu, Hawaii, USA, 2019. AAAI Press.
- Constrained clustering as an optimization method. IEEE Transactions on Pattern Analysis and Machine Intelligence, 15(8):785–794, 1993.
- Constrained Clustering: Advances in Algorithms, Theory, and Applications. Chapman and Hall/CRC, New York, 2008.
- Vygotsky’s social development theory. In Sam Goldstein and Jack A. Naglieri, editors, Encyclopedia of Child Behavior and Development, pages 1550–1550. Springer US, Boston, MA, 2011.