Repurposing Text-Generating AI into a Thought-Provoking Writing Tutor

Abstract: Text-generating AI technology has the potential to revolutionize writing education. However, current AI writing-support tools are limited to providing linear feedback to users. In this work, we demonstrate how text-generating AI can be repurposed into a thought-provoking writing tutor with the addition of recursive feedback mechanisms. Concretely, we developed a prototype AI writing-support tool called Scraft that asks Socratic questions to users and encourages critical thinking. To explore how Scraft can aid with writing education, we conducted a preliminary study with 15 students in a university writing class. Participants expressed that Scraft's recursive feedback is helpful for improving their writing skills. However, participants also noted that Scraft's feedback is sometimes factually incorrect and lacks context. We discuss the implications of our findings and future research directions.