Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
139 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

ChEDDAR: Student-ChatGPT Dialogue in EFL Writing Education (2309.13243v2)

Published 23 Sep 2023 in cs.CL

Abstract: The integration of generative AI in education is expanding, yet empirical analyses of large-scale, real-world interactions between students and AI systems still remain limited. In this study, we present ChEDDAR, ChatGPT & EFL Learner's Dialogue Dataset As Revising an essay, which is collected from a semester-long longitudinal experiment involving 212 college students enrolled in English as Foreign Langauge (EFL) writing courses. The students were asked to revise their essays through dialogues with ChatGPT. ChEDDAR includes a conversation log, utterance-level essay edit history, self-rated satisfaction, and students' intent, in addition to session-level pre-and-post surveys documenting their objectives and overall experiences. We analyze students' usage patterns and perceptions regarding generative AI with respect to their intent and satisfaction. As a foundational step, we establish baseline results for two pivotal tasks in task-oriented dialogue systems within educational contexts: intent detection and satisfaction estimation. We finally suggest further research to refine the integration of generative AI into education settings, outlining potential scenarios utilizing ChEDDAR. ChEDDAR is publicly available at https://github.com/zeunie/ChEDDAR.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (24)
  1. Maureen P. Boyd. Relations Between Teacher Questioning and Student Talk in One Elementary ELL Classroom. Journal of Literacy Research, 47(3):370–404, 2015. doi: 10.1177/1086296X16632451. URL https://doi.org/10.1177/1086296X16632451.
  2. Dialogue act modeling in a complex task-oriented domain. In Proceedings of the SIGDIAL 2010 Conference, pages 297–305, Tokyo, Japan, September 2010. Association for Computational Linguistics. URL https://aclanthology.org/W10-4356.
  3. Unsupervised cross-lingual representation learning at scale. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 8440–8451, Online, July 2020. Association for Computational Linguistics. doi: 10.18653/v1/2020.acl-main.747. URL https://aclanthology.org/2020.acl-main.747.
  4. Peter A. Cotton Debby R. E. Cotton and J. Reuben Shipway. Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, 0(0):1–12, 2023. doi: 10.1080/14703297.2023.2190148. URL https://doi.org/10.1080/14703297.2023.2190148.
  5. Measuring conversational uptake: A case study on student-teacher interactions. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 1638–1653, Online, August 2021. Association for Computational Linguistics. doi: 10.18653/v1/2021.acl-long.130. URL https://aclanthology.org/2021.acl-long.130.
  6. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pages 4171–4186, Minneapolis, Minnesota, June 2019. Association for Computational Linguistics. doi: 10.18653/v1/N19-1423. URL https://aclanthology.org/N19-1423.
  7. Paul Fyfe. How to Cheat on Your Final Paper: Assigning AI for Student Writing. AI Soc., 38(4):1395–1405, mar 2022. ISSN 0951-5666. doi: 10.1007/s00146-022-01397-z. URL https://doi.org/10.1007/s00146-022-01397-z.
  8. Simone Grassini. Shaping the Future of Education: Exploring the Potential and Consequences of AI and ChatGPT in Educational Settings. Education Sciences, 13(7), 2023. ISSN 2227-7102. doi: 10.3390/educsci13070692. URL https://www.mdpi.com/2227-7102/13/7/692.
  9. Combining verbal and nonverbal features to overcome the “information gap” in task-oriented dialogue. In Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 247–256, Seoul, South Korea, July 2012. Association for Computational Linguistics. URL https://aclanthology.org/W12-1634.
  10. RECIPE: How to Integrate ChatGPT into EFL Writing Education. In Proceedings of the Tenth ACM Conference on Learning @ Scale, L@S ’23, page 416–420, New York, NY, USA, 2023. Association for Computing Machinery. ISBN 9798400700255. doi: 10.1145/3573051.3596200. URL https://doi.org/10.1145/3573051.3596200.
  11. ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103:102274, 2023. ISSN 1041-6080. doi: https://doi.org/10.1016/j.lindif.2023.102274. URL https://www.sciencedirect.com/science/article/pii/S1041608023000195.
  12. Learning from Teaching Assistants to Program with Subgoals: Exploring the Potential for AI Teaching Assistants, 2023. URL https://doi.org/10.48550/arXiv.2309.10419.
  13. ReadingQuizMaker: A Human-NLP Collaborative System That Supports Instructors to Design High-Quality Reading Quiz Questions. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, CHI ’23, New York, NY, USA, 2023. Association for Computing Machinery. ISBN 9781450394215. doi: 10.1145/3544548.3580957. URL https://doi.org/10.1145/3544548.3580957.
  14. Classification of speech acts in tutorial dialog. In Proceedings of the Workshop on Modeling Human Teaching Tactics and Strategies of ITS 2000, pages 65–71, 2000.
  15. GPTeach: Interactive TA Training with GPT-Based Students. In Proceedings of the Tenth ACM Conference on Learning @ Scale, L@S ’23, page 226–236, New York, NY, USA, 2023. Association for Computing Machinery. ISBN 9798400700255. doi: 10.1145/3573051.3593393. URL https://doi.org/10.1145/3573051.3593393.
  16. Neil Mercer. The seeds of time: Why classroom dialogue needs a temporal analysis. Journal of the Learning Sciences, 17(1):33–59, 2008. doi: 10.1080/10508400701793182. URL https://doi.org/10.1080/10508400701793182.
  17. Plays Well With Others: A Study of EFL Learner Reciprocity in Action. TESOL Quarterly, 49(4):787–813, 2015. ISSN 00398322. URL http://www.jstor.org/stable/43893787.
  18. What makes an AI device human-like? The role of interaction quality, empathy and perceived psychological anthropomorphic characteristics in the acceptance of artificial intelligence in the service industry. Computers in Human Behavior, 122:106855, 2021. ISSN 0747-5632. doi: https://doi.org/10.1016/j.chb.2021.106855. URL https://www.sciencedirect.com/science/article/pii/S0747563221001783.
  19. Mike Perkins. Academic Integrity considerations of AI Large Language Models in the post-pandemic era: ChatGPT and beyond. Journal of University Teaching & Learning Practice, 20(2):7, 2023. doi: https://doi.org/10.53761/1.20.02.07. URL https://doi.org/10.53761/1.20.02.07.
  20. Junaid Qadir. Engineering Education in the Era of ChatGPT: Promise and Pitfalls of Generative AI for Education. In 2023 IEEE Global Engineering Education Conference (EDUCON), pages 1–9, 2023. doi: 10.1109/EDUCON54358.2023.10125121. URL https://doi.org/10.1109/EDUCON54358.2023.10125121.
  21. Student speech act classification using machine learning. In Proceedings of the Twenty-Fourth International Florida Artificial Intelligence Research Society Conference, 2011.
  22. ChatGPT in higher education: Considerations for academic integrity and student learning. Journal of Applied Learning and Teaching (JALT), 6(1), 2023. doi: 10.37074/jalt.2023.6.1.17. URL https://doi.org/10.37074/jalt.2023.6.1.17.
  23. Teo Susnjak. ChatGPT: The end of online exam integrity?, 2022. URL https://doi.org/10.48550/arXiv.2212.09292.
  24. Editorial: ChatGPT: Challenges, Opportunities, and Implications for Teacher Education. Contemporary Issues in Technology and Teacher Education, 23(1):1–23, March 2023. ISSN 1528-5804. URL https://www.learntechlib.org/p/222408.
Citations (3)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now