2000 character limit reached
Personalizing explanations of AI-driven hints to users' cognitive abilities: an empirical evaluation (2403.04035v2)
Published 6 Mar 2024 in cs.AI, cs.CY, and cs.HC
Abstract: We investigate personalizing the explanations that an Intelligent Tutoring System generates to justify the hints it provides to students to foster their learning. The personalization targets students with low levels of two traits, Need for Cognition and Conscientiousness, and aims to enhance these students' engagement with the explanations, based on prior findings that these students do not naturally engage with the explanations but they would benefit from them if they do. To evaluate the effectiveness of the personalization, we conducted a user study where we found that our proposed personalization significantly increases our target users' interaction with the hint explanations, their understanding of the hints and their learning. Hence, this work provides valuable insights into effectively personalizing AI-driven explanations for cognitively demanding tasks such as learning.
- Explaining reinforcement learning agents through counterfactual action outcomes. arXiv preprint arXiv:2312.11118, 2023.
- Adaptive navigational support and explainable recommendations in a personalized programming practice system. In Proceedings of the 34th ACM Conference on Hypertext and Social Media, pages 1–9, 2023.
- Explainable multi-agent reinforcement learning for temporal queries. In Edith Elkind, editor, Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, IJCAI-23, pages 55–63. International Joint Conferences on Artificial Intelligence Organization, 8 2023. Main Track.
- Are explanations always important? a study of deployed, low-cost intelligent interactive systems. In Proceedings of the 2012 ACM international conference on Intelligent User Interfaces, pages 169–178, 2012.
- The efficient assessment of need for cognition. Journal of personality assessment, 48(3):306–307, 1984.
- Toward personalized xai: A case study in intelligent tutoring systems. Artificial intelligence, 298:103503, 2021.
- A very brief measure of the big-five personality domains. Journal of Research in personality, 37(6):504–528, 2003.
- Unraveling ml models of emotion with nova: Multi-level explainable ai for non-experts. IEEE Transactions on Affective Computing, 13(3):1155–1167, 2020.
- Xai to increase the effectiveness of an intelligent pedagogical agent. In Proceedings of the 23rd ACM International Conference on Intelligent Virtual Agents, pages 1–9, 2023.
- Providing adaptive support in an interactive simulation for learning: An experimental evaluation. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pages 3671–3680, 2015.
- Samad Kardan. A data mining approach for adding adaptive interventions to exploratory learning environments. PhD thesis, University of British Columbia, 2017.
- Do stakeholder needs differ?-designing stakeholder-tailored explainable artificial intelligence (xai) interfaces. International Journal of Human-Computer Studies, 181:103160, 2024.
- Personalized explanations for hybrid recommender systems. In Proceedings of the 24th International Conference on Intelligent User Interfaces, pages 379–390, 2019.
- Principles of explanatory debugging to personalize interactive machine learning. In Proceedings of the 20th international conference on intelligent user interfaces, pages 126–137, 2015.
- Predicting personality traits from touchscreen based interactions. In 2018 Tenth international conference on quality of multimedia experience (QoMEX), pages 1–6. IEEE, 2018.
- To explain or not to explain: the effects of personal characteristics when explaining music recommendations. In Proceedings of the 24th International Conference on Intelligent User Interfaces, pages 397–407, 2019.
- What’s in a user? towards personalising transparency for music recommender interfaces. In Proceedings of the 28th ACM Conference on User Modeling, Adaptation and Personalization, pages 173–182, 2020.
- “knowing me, knowing you”: personalized explanations for a music recommender system. User Modeling and User-Adapted Interaction, 32(1-2):215–252, 2022.
- Argumentation-based explanations in recommender systems: Conceptual framework and empirical results. In Adjunct Publication of the 26th Conference on User Modeling, Adaptation and Personalization, pages 293–298, 2018.
- The big five personality dimensions and job performance. SA Journal of industrial psychology, 29(1):68–74, 2003.
- A missing piece in the puzzle: Considering the role of task complexity in human-ai decision making. In Proceedings of the 31st ACM Conference on User Modeling, Adaptation and Personalization, pages 215–227, 2023.
- I can do better than your ai: expertise and explanations. In Proceedings of the 24th International Conference on Intelligent User Interfaces, pages 240–251, 2019.
- Investigating an alternate form of the cognitive reflection test. Judgment and Decision making, 11(1):99–113, 2016.