The AI Assessment Scale (AIAS): A Framework for Ethical Integration of Generative AI in Educational Assessment (2312.07086v2)

Abstract: Recent developments in Generative Artificial Intelligence (GenAI) have created a paradigm shift in multiple areas of society, and the use of these technologies is likely to become a defining feature of education in coming decades. GenAI offers transformative pedagogical opportunities, while simultaneously posing ethical and academic challenges. Against this backdrop, we outline a practical, simple, and sufficiently comprehensive tool to allow for the integration of GenAI tools into educational assessment: the AI Assessment Scale (AIAS). The AIAS empowers educators to select the appropriate level of GenAI usage in assessments based on the learning outcomes they seek to address. The AIAS offers greater clarity and transparency for students and educators, provides a fair and equitable policy tool for institutions to work with, and offers a nuanced approach which embraces the opportunities of GenAI while recognising that there are instances where such tools may not be pedagogically appropriate or necessary. By adopting a practical, flexible approach that can be implemented quickly, the AIAS can form a much-needed starting point to address the current uncertainty and anxiety regarding GenAI in education. As a secondary objective, we engage with the current literature and advocate for a refocused discourse on GenAI tools in education, one which foregrounds how technologies can help support and enhance teaching and learning, which contrasts with the current focus on GenAI as a facilitator of academic misconduct.

Introduction

Generative Artificial Intelligence (GenAI) technologies have significantly impacted education by introducing transformative pedagogical opportunities and posing new ethical and academic challenges. The integration of GenAI tools into educational assessment prompts the need for frameworks that navigate ethical usage while leveraging their benefits.

Generative AI and Educational Assessment

GenAI models are artificial intelligence systems capable of generating content such as text, images, and audio. Their integration in education has sparked a discourse on how such tools can support innovative teaching and learning practices while upholding academic integrity. The increasing presence of these technologies in higher education fuels the demand for nuanced assessment tools that accommodate the benefits and ethical considerations of GenAI applications.

The AI Assessment Scale

This paper introduces the AI Assessment Scale (AIAS), a tool crafted to help educators discern suitable levels of GenAI use in assessments, aiming to align with desired learning outcomes. The AIAS aims to add clarity and transparency for learners and educators alike, fostering an environment where GenAI technologies can be employed responsibly. It is a scale that ranges from no AI usage in assessments to full AI integration and is flexible for application across education levels, from K-12 to higher education.

Discussion and Future Directions

In embracing a shift towards GenAI acceptance, considering GenAI as a holistic tool for learning rather than merely a means to academic dishonesty is crucial. While GenAI presents opportunities for enhanced learning experiences, considerations around equitable access to these technologies remain pivotal. The AIAS has been designed to adapt alongside evolving AI technologies, supporting its adoption within a learning institution's existing policy framework.

The successful integration of AI tools hinges on ongoing research and empirical testing in diverse educational settings. By encouraging the responsible use of GenAI, institutions can prepare students for technology-rich professional futures, contributing to an ethically-minded, adaptable education system.