Papers
Topics
Authors
Recent
Search
2000 character limit reached

NIRVANA: A Comprehensive Dataset for Reproducing How Students Use Generative AI for Essay Writing

Published 8 Apr 2026 in cs.HC | (2604.07344v1)

Abstract: With the rapid adoption of AI writing assistants in education, educators and researchers need empirical evidence to understand the impact on student writing and inform effective pedagogical design. Despite widespread use, we lack systematic understanding of how students engage with these tools during authentic writing tasks: when they seek assistance, what they ask, and how they incorporate AI-generated content into their essays. This gap limits evidence-based policy development and rigorous evaluation of generative AI's learning effects. To address this gap, we introduce NIRVANA, a dataset capturing how university students use generative AI while writing an analytical essay. The dataset includes 77 students who completed an essay task with access to ChatGPT, recording keystroke-level writing behavior, full ChatGPT conversation histories, and all text copied from ChatGPT, enabling a complete reconstruction of the writing process and revealing how AI assistance shapes student work. Our analysis identifies key behavioral patterns, including variation in ChatGPT query frequency and its relationship to essay characteristics such as length and readability. We identify four writing profiles based on students' contribution and revision patterns: Lead Authors, Collaborators, Drafters, and Vibe Writers. To support deeper investigation, we developed a replay interface that reconstructs the writing process; qualitative analysis of sampled replays demonstrates how this tool enables systematic examination of student-AI interactions.

Summary

  • The paper introduces NIRVANA, detailing a dataset capturing keystroke-level and conversational dynamics in student-AI essay writing.
  • It employs a custom writing platform to record detailed interaction events, enabling quantitative analysis of AI query frequency, essay metrics, and writer profiles.
  • Findings indicate that higher AI query frequency correlates with longer, less readable essays, offering actionable insights for pedagogical and policy interventions.

NIRVANA: A Comprehensive Dataset for Reproducing Student-AI Essay Writing Dynamics

Introduction and Context

The NIRVANA dataset represents a substantial advancement in empirical research on AI-assisted academic writing, documenting keystroke-level behaviors and full conversational histories as university students complete argumentative essays with unrestricted access to ChatGPT. Unlike survey-based studies, NIRVANA reconstructs the temporal dynamics of AI usage, capturing not only when and how students seek assistance but also the exact pathways by which AI-generated content is incorporated into their writing. This enables rigorous quantitative and qualitative analysis of student–AI interaction patterns, critical for informing pedagogical design and policy amid increasing adoption of generative AI in education. Figure 1

Figure 1: Screenshot of the editor interface where student essays were composed and monitored during data collection.

Dataset Collection Methodology

NIRVANA was collected via a custom writing platform integrating an in-house instance of ChatGPT (GPT-3.5-turbo), supporting authentic student-driven interaction. The platform monitored all keystroke events (insertions, deletions, cursor movements, copy–paste), ChatGPT queries, responses, and event timestamps. Students completed an ACT-style argumentative prompt over approximately 30 minutes, following a pre-survey capturing demographic and attitudinal measures (self-efficacy, TAM) and a post-survey evaluating perceived ownership and creativity support. Seventy-seven participants were recruited from U.S. university mailing lists and Prolific, spanning a diverse range of backgrounds. Figure 2

Figure 2: Screenshot of the in-house ChatGPT interface provided to participants within the writing environment.

Quantitative Analysis of AI Usage Patterns

The dataset supports high-resolution quantitative characterization of essay metrics (length, readability, time taken) and AI interaction patterns (number, content, timing of queries). The observed word count distribution (μ=382\mu=382, σ=235\sigma=235) and the inquiry counts (mean $4.51$, skew $2.24$), demonstrate substantial inter-participant variability. Figure 3

Figure 3

Figure 3: Distribution of essay word counts across all participants.

Spearman rank correlations show that query frequency is significantly associated with essay length (ρ=0.485\rho=0.485) and time taken (ρ=0.493\rho=0.493), but not with perceived ownership or creativity support. Higher query counts yield longer and less readable essays, as measured by Dale-Chall scores (ρ=0.380\rho=0.380), suggesting that increased engagement with AI is linked to both more voluminous and more complex output. Figure 4

Figure 4

Figure 4: Word count correlation between ChatGPT query frequency and essay length.

Human Contribution and Writer Profiling

Two key behavioral metrics were introduced: Human Contribution Ratio (HCR), representing the proportion of final essay words authored by the participant, and Human Edit Ratio (HER), quantifying the proportion of editing activity attributable to the participant, including deletions of AI-generated text. Both distributions reveal polarization—most essays are either predominantly human-written or heavily AI-authored, with few blended cases. Figure 5

Figure 5

Figure 5: Distribution of the Human Contribution Ratio (HCR) across participants.

K-means clustering (with K=4K=4, confirmed via SSE elbow method) based on HCR and HER identifies four primary writer profiles:

  • Lead Authors: High HCR/HER, minimal AI-generated text, substantial independent writing and editing.
  • Collaborators: Intermediate HCR/HER, blended contributions.
  • Vibe Writers: Low HCR/HER, predominantly pasted AI-generated essays with minimal human edits.
  • Drafters: Low HCR, high HER, initial independent drafting overwritten by AI output. Figure 6

    Figure 6: Visualization of participant clusters by HCR and HER; marker size denotes cluster population.

Statistical comparisons reveal strong differences: Collaborators query ChatGPT more frequently than Lead Authors; Vibe Writers produce essays most rapidly, but with lowest perceived ownership; Lead Authors' essays are more readable (lower Dale-Chall scores), and they report higher authorship agency.

(Figures 6–9)

Figure 7: Inquiry usage distribution across writer clusters.

Figure 8: Task completion time across clusters.

Figure 9: Dale-Chall readability scores across clusters.

Figure 10: Perceived Ownership score distribution across clusters.

Replay Interface and Qualitative Analysis

To enable in-depth, process-level review beyond aggregate metrics, a replay interface was developed, allowing chronological reconstruction of essay composition and AI interaction. Researchers can visualize text growth, pinpoint pivotal events (queries, copies, edits), and correlate them with student-AI exchanges. Case studies illuminate the nuanced engagement patterns: some students use AI for ideation while writing independently; others 'vibe write', outsourcing essay authorship to ChatGPT; a subset initially drafts essays themselves but ultimately adopt AI-generated rewrites. Figure 11

Figure 11: Example of the writing replay interface for participant P26, capturing text evolution and AI interaction events.

Theoretical and Practical Implications

NIRVANA provides critical empirical evidence to dissect the spectrum of student involvement with generative AI, exposing the limitations of final-product analysis and enabling nuanced assessment of cognitive engagement. The clustering framework yields actionable pedagogical insight: scaffolding assignments toward independent drafting with selective AI use fosters greater ownership and agency, while metrics such as HER differentiate superficial editing from substantive engagement.

The findings complicate simple narratives about AI dependency: while most students retain authorship, a notable minority fully delegate essay generation. The dataset, with its full traceability, is instrumental for investigating academic integrity issues, developing AI policy guardrails, and benchmarking detection systems (2604.07344). Furthermore, it is highly relevant for evaluating the impact of AI assistance on learning outcomes and critical thinking—recent meta-analyses show positive effects on learning performance but ambiguous effects on higher-order thinking, emphasizing the need for process-based research [wang_effect_2025], [lee_impact_2025].

Future Directions

NIRVANA supports further exploration in several domains:

  • Semantic provenance analysis linking AI responses to final essay content using NLP techniques;
  • Evaluation of AI policy interventions and guardrails within monitored platforms;
  • Longitudinal studies on evolving AI usage patterns as technology advances;
  • Integrative assessment of essay quality and learning outcomes with instructor evaluation;
  • Taxonomic classification of query types mapped to cognitive writing stages [flower_cognitive_1981]. Figure 12

    Figure 12: Sum of squared errors (SSE) for K-means clustering across potential values of K.

Conclusion

NIRVANA constitutes a comprehensive, reproducible framework for studying authentic student–AI writing interaction at temporal granularity. It delivers critical empirical resources for learning science, HCI, and NLP communities to develop evidence-based pedagogical and policy responses to generative AI, enabling sophisticated analysis of academic integrity, learning outcomes, and authorial agency. Through its dataset and replay tools, it establishes a foundation for advancing research, supporting responsible AI integration, and designing adaptive educational systems as generative technologies reshape academic writing.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Collections

Sign up for free to add this paper to one or more collections.