Contribution of OnGoal beyond user familiarity effects

Ascertain the incremental contribution of OnGoal’s interface features to users’ evaluation and review performance beyond improvements attributable to growing familiarity with large language models over time.

Background

Participants reported that reviewing became easier as they grew familiar with the LLM regardless of interface, making it difficult to isolate OnGoal’s added value.

A controlled analysis separating learning effects from interface-driven benefits would clarify causal impacts of goal tracking and visualization features.