Generative AI and Teachers -- For Us or Against Us? A Case Study (2404.03486v1)
Abstract: We present insightful results of a survey on the adoption of generative artificial intelligence (GenAI) by university teachers in their teaching activities. The transformation of education by GenAI, particularly LLMs, has been presenting both opportunities and challenges, including cheating by students. We prepared the online survey according to best practices and the questions were created by the authors, who have pedagogy experience. The survey contained 12 questions and a pilot study was first conducted. The survey was then sent to all teachers in multiple departments across different campuses of the university of interest in Sweden: Lule{\aa} University of Technology. The survey was available in both Swedish and English. The results show that 35 teachers (more than half) use GenAI out of 67 respondents. Preparation is the teaching activity with the most frequency that GenAI is used for and ChatGPT is the most commonly used GenAI. 59% say it has impacted their teaching, however, 55% say there should be legislation around the use of GenAI, especially as inaccuracies and cheating are the biggest concerns.
- Procot: Stimulating critical thinking and writing of students through engagement with large language models (llms). arXiv preprint arXiv:2312.09801 (2023).
- Generative ai in education and research: Opportunities, concerns, and solutions. Journal of Chemical Education 100, 8 (2023), 2965–2971.
- Am last page: Avoiding four visual-design pitfalls in survey development. Academic Medicine 87, 10 (2012), 1452.
- Open-ended versus closed-ended responses: A comparison study using topic modeling and factor analysis. IEEE transactions on intelligent transportation systems 22, 4 (2020), 2123–2132.
- Methods for pre-testing and piloting survey questions: illustrations from the kenqol survey of health-related quality of life. Health policy and planning 17, 3 (2002), 322–330.
- Students’ voices on generative ai: Perceptions, benefits, and challenges in higher education. International Journal of Educational Technology in Higher Education 20, 1 (2023), 43.
- The ai generation gap: Are gen z students more interested in adopting generative ai such as chatgpt in teaching and learning than their gen x and millennial generation teachers? Smart Learning Environments 10, 1 (2023), 60.
- Comparing the use of open and closed questions for web-based measures of the continued-influence effect. Behavior research methods 51 (2019), 1426–1440.
- Reconceptualizing chatgpt and generative ai as a student-driven innovation in higher education. Procedia CIRP 119 (2023), 84–90.
- The survey checklist (manifesto). Academic Medicine 93, 3 (2018), 360–366.
- Guidance for generative AI in education and research. UNESCO Publishing, 2023.
- Who’s up first? testing for order effects in structured interviews using a counterbalanced experimental design. Journal of Abnormal Child Psychology 27 (1999), 439–445.
- The effects of asking filter questions in interleafed versus grouped format. Sociological Methods & Research 40, 1 (2011), 88–104.
- Krosnick, J. A. Questionnaire design. The Palgrave handbook of survey research (2018), 439–455.
- Aurora-m: The first open source multilingual language model red-teamed according to the u.s. executive order.
- New strategies for pretesting survey questions. Journal of official statistics 7, 3 (1991), 349.
- Methods for testing and evaluating survey questions. Methods for testing and evaluating survey questionnaires (2004), 1–22.
- Open-ended vs. close-ended questions in web questionnaires. Developments in applied statistics 19, 1 (2003), 159–177.
- Problems in the use of survey questions to measure public opinion. Science 236, 4804 (1987), 957–959.
- Educator and student perspectives on the impact of generative ai on assessments in higher education. In Proceedings of the tenth ACM conference on Learning@ Scale (2023), pp. 378–382.
- Llama 2: Open foundation and fine-tuned chat models. arXiv preprint arXiv:2307.09288 (2023).
- Jenny Pettersson (1 paper)
- Elias Hult (1 paper)
- Tim Eriksson (1 paper)
- Tosin Adewumi (27 papers)