"The teachers are confused as well": A Multiple-Stakeholder Ethics Discussion on Large Language Models in Computing Education (2401.12453v1)
Abstract: LLMs are advancing quickly and impacting people's lives for better or worse. In higher education, concerns have emerged such as students' misuse of LLMs and degraded education outcomes. To unpack the ethical concerns of LLMs for higher education, we conducted a case study consisting of stakeholder interviews (n=20) in higher education computer science. We found that students use several distinct mental models to interact with LLMs - LLMs serve as a tool for (a) writing, (b) coding, and (c) information retrieval, which differ somewhat in ethical considerations. Students and teachers brought up ethical issues that directly impact them, such as inaccurate LLM responses, hallucinations, biases, privacy leakage, and academic integrity issues. Participants emphasized the necessity of guidance and rules for the use of LLMs in higher education, including teaching digital literacy, rethinking education, and having cautious and contextual policies. We reflect on the ethical challenges and propose solutions.
- GPT-3-driven pedagogical agents for training children’s curious question-asking skills. International Journal of Artificial Intelligence in Education (June 2023). https://doi.org/10.1007/s40593-023-00340-7 arXiv:2211.14228 [cs].
- Towards human-bot collaborative software architecting with chatgpt. In Proceedings of the 27th International Conference on Evaluation and Assessment in Software Engineering. 279–285.
- PS Aithal and Shubhrajyosna Aithal. 2023. Application of ChatGPT in Higher Education and Research–A Futuristic Analysis. International Journal of Applied Engineering and Management Letters (IJAEML) 7, 3 (2023), 168–194.
- Hussam Alkaissi and Samy I McFarlane. 2023. Artificial hallucinations in ChatGPT: implications in scientific writing. Cureus 15, 2 (2023).
- Mapping the global evidence around the use of ChatGPT in higher education: A systematic scoping review. Education and Information Technologies (2023), 1–41.
- Elissa Arias Sosa and Marco Godow. 2023. Comparing Google and ChatGPT as Assistive Tools for Students in Solving Programming Exercises.
- Let’s Do It Ourselves: Ensuring Academic Integrity in the Age of ChatGPT and Beyond. Authorea Preprints (2023).
- Oscar Backström and Annie Kihlert. 2023. Code Quality and Large Language Models in Computer Science Education: Enhancing student-written code through ChatGPT.
- Minhui Bao. [n. d.]. Can Home Use of Speech-Enabled Artificial Intelligence Mitigate Foreign Language Anxiety – Investigation of a Concept. Arab World English Journal (AWEJ) 5 ([n. d.]), 28–40.
- The Importance of Chat GPT Training for Higher Education: Case Study. In International Conference on Design and Digital Communication. Springer, 695–705.
- ChatGPT and the Pedagogical Challenge: Unveiling the Impact on Early-Career Academics in Higher Education. Indonesian Journal on Learning and Advanced Education (IJOLAE) 5, 3 (2023), 311–322.
- Programming Is Hard - Or at Least It Used to Be: Educational Opportunities and Challenges of AI Code Generation. In Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 1. ACM, Toronto ON Canada, 500–506. https://doi.org/10.1145/3545945.3569759
- On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency. ACM, Virtual Event Canada, 610–623. https://doi.org/10.1145/3442188.3445922
- Towards Automated Generation and Evaluation of Questions in Educational Domains. In Proceedings of the 15th International Conference on Educational Data Mining. International Educational Data Mining Society, Durham, United Kingdom, 701–704. https://doi.org/10.5281/zenodo.6853085
- Taking Flight with Copilot: Early insights and opportunities of AI-powered pair-programming tools. Queue 20, 6 (Dec. 2022), 35–57. https://doi.org/10.1145/3582083
- Som Biswas. 2023. Role of ChatGPT in Computer Programming.: ChatGPT in Computer Programming. Mesopotamian Journal of Computer Science 2023 (2023), 8–16.
- Sebastian Bordt and Ulrike von Luxburg. 2023. Chatgpt participates in a computer science exam. arXiv preprint arXiv:2303.09461 (2023).
- Virginia Braun and Victoria Clarke. 2012. Thematic analysis. American Psychological Association.
- Time to Revisit Existing Student’s Performance Evaluation Approach in Higher Education Sector in a New Era of ChatGPT—A Case Study. Cogent Education 10, 1 (2023), 2210461.
- Evaluating Large Language Models Trained on Code. http://arxiv.org/abs/2107.03374 arXiv:2107.03374 [cs].
- Virtual Classrooms and Real Harms: Remote Learning at {{\{{US}}\}}. Universities. In Seventeenth Symposium on Usable Privacy and Security (SOUPS 2021). 653–674.
- Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International (2023), 1–12.
- Geoffrey M Currie. 2023. Academic integrity and artificial intelligence: is ChatGPT hype, hero or heresy?. In Seminars in Nuclear Medicine. Elsevier.
- Reconceptualizing ChatGPT and generative AI as a student-driven innovation in higher education. (2023).
- Exposing gaps, exploring legacies: paradoxes of writing use in computing education. Journal of Computing Sciences in Colleges 23, 5 (2008), 24–33.
- The impact of ChatGPT on higher education. Dempere J, Modugu K, Hesham A and Ramasamy LK (2023) The impact of ChatGPT on higher education. Front. Educ 8 (2023), 1206936.
- The Idea Machine: LLM-based Expansion, Rewriting, Combination, and Suggestion of Ideas. In Proceedings of the 14th Conference on Creativity and Cognition. 623–627.
- Bronwyn Eager and Ryan Brunton. 2023. Prompting higher education towards AI-augmented teaching and learning practice. Journal of University Teaching & Learning Practice 20, 5 (2023), 02.
- Winoqueer: A community-in-the-loop benchmark for anti-lgbtq+ bias in large language models. arXiv preprint arXiv:2306.15087 (2023).
- Radha Firaina and Dwi Sulisworo. 2023. Exploring the usage of ChatGPT in higher education: Frequency and impact on productivity. Buletin Edukasi Indonesia 2, 01 (2023), 39–46.
- First 100 days of ChatGPT at Australian universities: An analysis of policy landscape and media discussions about the role of AI in higher education. Learning Letters (2023).
- Kevin Fuchs. 2023. Exploring the opportunities and challenges of NLP models in higher education: is Chat GPT a blessing or a curse?. In Frontiers in Education, Vol. 8. Frontiers, 1166682.
- Generative AI and ChatGPT: Applications, challenges, and AI-human collaboration. , 277–304 pages.
- ChatGPT and the Future of Work: A Comprehensive Analysis of AI’s Impact on Jobs and Employment. Partners Universal International Innovation Journal 1, 3 (2023), 154–186.
- Sparks: Inspiration for Science Writing using Language Models. In Proceedings of the 2022 ACM Designing Interactive Systems Conference (DIS ’22). Association for Computing Machinery, New York, NY, USA, 1002–1019. https://doi.org/10.1145/3532106.3533533
- Transformative effects of ChatGPT on modern education: Emerging Era of AI Chatbots. Internet of Things and Cyber-Physical Systems 4 (2024), 19–23.
- From chatgpt to threatgpt: Impact of generative ai in cybersecurity and privacy. IEEE Access (2023).
- Mohanad Halaweh. 2023. ChatGPT in education: Strategies for responsible implementation. (2023).
- Ahmed M Hasanein and Abu Elnasr E Sobaih. 2023. Drivers and Consequences of ChatGPT Use in Higher Education: Key Stakeholder Perspectives. European Journal of Investigation in Health, Psychology and Education 13, 11 (2023), 2599–2614.
- Adam Hörnemalm. 2023. ChatGPT as a Software Development Tool: The Future of Development.
- Xinhui Hu and Michael Twidale. 2023. A Scoping Review of Mental Model Research in HCI from 2010 to 2021. In International Conference on Human-Computer Interaction. Springer, 101–125.
- Jorge Jinchuña Huallpa et al. 2023. Exploring the ethical considerations of using Chat GPT in university education. Periodicals of Engineering and Natural Sciences 11, 4 (2023), 105–115.
- Bias assessment and mitigation in llm-based code generation. arXiv preprint arXiv:2309.14345 (2023).
- Bias Testing and Mitigation in LLM-based Code Generation. http://arxiv.org/abs/2309.14345 arXiv:2309.14345 [cs].
- Lucas Jasper Jacobsen and Kira Elena Weber. 2023. The Promises and Pitfalls of ChatGPT as a Feedback Provider in Higher Education: An Exploratory Study of Prompt Engineering and the Quality of AI-Driven Feedback. (2023).
- Chatgpt and software testing education: Promises & perils. In 2023 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW). IEEE, 4130–4137.
- Unlocking the opportunities through ChatGPT Tool towards ameliorating the education system. BenchCouncil Transactions on Benchmarks, Standards and Evaluations 3, 2 (2023), 100115.
- Marcin Jukiewicz. [n. d.]. The Future of Grading Programming Assignments in Education: The Role of ChatGPT in Automating the Assessment and Feedback Process. ([n. d.]).
- ChatGPT for good? On opportunities and challenges of large language models for education. Learning and individual differences 103 (2023), 102274.
- Ferial Khaddage. 2023. Towards an Innovative Strategy for ChatGPT in Higher Education “Respond, Reimagine, Recreate, & Reform”. In EdMedia+ Innovate Learning. Association for the Advancement of Computing in Education (AACE), 274–279.
- AI Accountability Policy. NTIA-2023-0005-0810 (2023).
- “How technical do you get? I’m an English teacher”: Teaching and Learning Cybersecurity and AI Ethics in High School. In 2023 IEEE Symposium on Security and Privacy (SP). IEEE, 2032–2032.
- Gabriela Kiryakova and Nadezhda Angelova. 2023. ChatGPT—A Challenging Tool for the University Professors in Their Teaching Practice. Education Sciences 13, 10 (2023), 1056.
- Impact of Guidance and Interaction Strategies for LLM Use on Learner Performance and Perception. arXiv preprint arXiv:2310.13712 (2023).
- AI-assisted learning with ChatGPT and large language models: Implications for higher education. In 2023 IEEE International Conference on Advanced Learning Technologies (ICALT). IEEE, 226–230.
- Karim R Lakhani and Robert G Wolf. 2003. Why hackers do what they do: Understanding motivation and effort in free/open source software projects. Open Source Software Projects (September 2003) (2003).
- Sam Lau and Philip Guo. 2023. From” Ban it till we understand it” to” Resistance is futile”: How university programming instructors plan to adapt as more students use AI code generation and explanation tools such as ChatGPT and GitHub Copilot. In Proceedings of the 2023 ACM Conference on International Computing Education Research-Volume 1. 106–121.
- Jonna Lee and Meryem Yilmaz Soylu. 2023. ChatGPT and Assessment in Higher Education. (2023).
- Towards understanding and mitigating social biases in language models. In International Conference on Machine Learning. PMLR, 6565–6576. http://proceedings.mlr.press/v139/liang21a.html
- Is your code generated by chatgpt really correct? rigorous evaluation of large language models for code generation. arXiv preprint arXiv:2305.01210 (2023).
- Leo S Lo. 2023. The CLEAR path: A framework for enhancing information literacy through prompt engineering. The Journal of Academic Librarianship 49, 4 (2023), 102720.
- Michael Loubier. 2023. ChatGPT: A Good Computer Engineering Student?: An Experiment on its Ability to Answer Programming Questions from Exams.
- Academic integrity: a review of the literature. Studies in higher education 39, 2 (2014), 339–358.
- Generating Diverse Code Explanations using the GPT-3 Large Language Model. In Proceedings of the 2022 ACM Conference on International Computing Education Research - Volume 2 (ICER ’22, Vol. 2). Association for Computing Machinery, New York, NY, USA, 37–39. https://doi.org/10.1145/3501709.3544280
- On the educational impact of ChatGPT: Is Artificial Intelligence ready to obtain a university degree?. In Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V. 1. 47–53.
- Challenges for Computer Science Education Arising from new AI Systems like ChatGPT. In Conference Proceedings. The Future of Education 2023.
- Empowering education with llms-the next-gen interface and content generation. In International Conference on Artificial Intelligence in Education. Springer, 32–37.
- Generative Conversational AI And Academic Integrity: A Mixed Method Investigation To Understand The Ethical Use of LLM Chatbots In Higher Education. Available at SSRN 4548263 (2023).
- Philip Mark Newton and Maira Xiromeriti. 2023. ChatGPT performance on MCQ exams in higher education. A pragmatic scoping review. (2023).
- Thi Thuy An Ngo. 2023. The Perception by University Students of the Use of ChatGPT in Education. International Journal of Emerging Technologies in Learning (Online) 18, 17 (2023), 4.
- Sinan Onal and Derya Kulavuz-Onal. 2023. A Cross-Disciplinary Examination of the Instructional Uses of ChatGPT in Higher Education. Journal of Educational Technology Systems (2023), 00472395231196532.
- Detecting llm-generated text in computing education: A comparative study for chatgpt cases. arXiv preprint arXiv:2307.07411 (2023).
- Pethigmage Perera and Madushan Lankathilaka. 2023. AI in higher education: A literature review of chatgpt and guidelines for responsible implementation. International Journal of Research and Innovation in Social Science 7, 6 (2023), 306–314.
- Junaid Qadir. 2022. Engineering Education in the Era of ChatGPT: Promise and Pitfalls of Generative AI for Education. (Dec. 2022). https://doi.org/10.36227/techrxiv.21789434.v1
- Basit Qureshi. 2023. Exploring the use of chatgpt as a tool for learning and assessment in undergraduate computer science curriculum: Opportunities and challenges. arXiv preprint arXiv:2304.11214 (2023).
- \\\backslash\” Call me Kiran\\\backslash\”–ChatGPT as a Tutoring Chatbot in a Computer Science Course. In Proceedings of the 26th International Academic Mindtrek Conference. 83–94.
- Michael Reiche and J Leidner. 2023. Bridging the Programming Skill Gap with ChatGPT: A Machine Learning Project with Business Students. Nowacyk et al., S.(ed.) ECAI (2023).
- Laria Reynolds and Kyle McDonell. 2021. Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm. arXiv:2102.07350 (Feb. 2021). http://arxiv.org/abs/2102.07350 arXiv:2102.07350 [cs].
- ChatGPT: Bullshit spewer or the end of traditional assessments in higher education? Journal of Applied Learning and Teaching 6, 1 (2023).
- War of the chatbots: Bard, Bing Chat, ChatGPT, Ernie and beyond. The new AI gold rush and its impact on higher education. Journal of Applied Learning and Teaching 6, 1 (2023).
- Privacy governance not included: analysis of third parties in learning management systems. Information and Learning Sciences 124, 9/10 (2023), 326–348.
- Factors influencing the acceptance of ChatGPT usage among higher education students in Bangkok, Thailand. Advance Knowledge for Executives 2, 4 (2023), 1–14.
- Matthew Shardlow and Annabel Latham. 2023. ChatGPT in computing education: a policy whitepaper. (2023).
- Exploring Computer Science Students’ Perception of ChatGPT in Higher Education: A Descriptive and Correlation Study. Education Sciences 13, 9 (2023), 924.
- Artur Strzelecki. 2023. To use or not to use ChatGPT in higher education? A study of students’ acceptance and use of technology. Interactive Learning Environments (2023), 1–14.
- ChatGPT in higher education: Considerations for academic integrity and student learning. (2023).
- Tzu-Yu Tai and Howard Hao-Jan Chen. 2023. The impact of Google Assistant on adolescent EFL learners’ willingness to communicate. Interactive Learning Environments 31, 3 (April 2023), 1485–1502. https://doi.org/10.1080/10494820.2020.1841801
- Elham Tajik and Fatemeh Tajik. 2023. A comprehensive Examination of the potential application of Chat GPT in Higher Education Institutions. TechRxiv. Preprint (2023), 1–10.
- Challenges and Opportunities of AI-Assisted Learning: A Systematic Literature Review on the Impact of ChatGPT Usage in Higher Education. International Journal of Learning, Teaching and Educational Research 22, 7 (2023), 122–135.
- Bert Waits and H Pomerantz. 1997. The Role of Calculators in Math Education. USA: Department of Mathematics of The Ohio State University (1997), 39–43.
- Tianchong Wang. 2023. Navigating Generative AI (ChatGPT) in Higher Education: Opportunities and Challenges. In International Conference on Smart Learning Environments. Springer, 215–225.
- Exploring the Role of AI Assistants in Computer Science Education: Methods, Implications, and Instructor Perspectives. In 2023 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). IEEE, 92–102.
- Empowering llm to use smartphone for intelligent task automation. arXiv preprint arXiv:2308.15272 (2023).
- Ramazan Yilmaz and Fatma Gizem Karaoglan Yilmaz. 2023. Augmented intelligence in programming learning: Examining student views on the use of ChatGPT for programming learning. Computers in Human Behavior: Artificial Humans 1, 2 (2023), 100005.
- ” It’s a Fair Game”, or Is It? Examining How Users Navigate Disclosure Risks and Benefits When Using LLM-Based Conversational Agents. arXiv preprint arXiv:2309.11653 (2023).
- A survey of large language models. arXiv preprint arXiv:2303.18223 (2023).
- ” I’m Not Confident in Debiasing AI Systems Since I Know Too Little”: Teaching AI Creators About Gender Bias Through Hands-on Tutorials. arXiv preprint arXiv:2309.08121 (2023).
- Toward Ethical Use of Generative AI in AP Courses. Information Matters 3, 11 (2023).
- Kyrie Zhixuan Zhou and Madelyn Rose Sanfilippo. 2023. Public perceptions of gender bias in large language models: Cases of chatgpt and ernie. arXiv preprint arXiv:2309.09120 (2023).
- A Moral-and Event-Centric Inspection of Gender Bias in Fairy Tales at A Large Scale. arXiv preprint arXiv:2211.14358 (2022).
- Kyrie Zhixuan Zhou (17 papers)
- Zachary Kilhoffer (3 papers)
- Madelyn Rose Sanfilippo (6 papers)
- Ted Underwood (5 papers)
- Ece Gumusel (5 papers)
- Mengyi Wei (7 papers)
- Abhinav Choudhry (3 papers)
- Jinjun Xiong (118 papers)