Dice Question Streamline Icon: https://streamlinehq.com

Long-term real-world usage and outcomes of GhostWriter

Investigate how participants use GhostWriter or similar large language model-powered writing systems over extended periods in real-world tasks, and characterize long-term interactions and outcomes that are not observable in short, lab-based sessions.

Information Square Streamline Icon: https://streamlinehq.com

Background

The evaluation consisted of two one-hour sessions focusing on editing and generative writing tasks. Due to this short-term setting, the paper design does not capture longitudinal behaviors or real-world adoption patterns.

The authors explicitly note the inability to observe longer-term usage and provide the example of understanding how participants would use such systems over extended periods for real-world tasks, identifying this as an unresolved question.

References

We could not capture long-term interactions and outcomes with GhostWriter in just two study sessions, e.g., how participants would use such a system over a longer period to perform real-world tasks.

GhostWriter: Augmenting Collaborative Human-AI Writing Experiences Through Personalization and Agency (2402.08855 - Yeh et al., 13 Feb 2024) in Section 7: Limitations and Future Work