Determine whether the DynaSent example is ironic

Determine whether the ending of the DynaSent sentence in Figure 1 is intended to be ironic, thereby explaining the disagreement among its five human annotators.

Background

Figure 1 presents a DynaSent sentiment-classification example in which the sentence begins with predominantly negative adjectives but ends positively. The authors identify this shift as a source of disagreement among annotators and note that the intended interpretation of the ending—particularly whether it is ironic—cannot be established from the example.

References

This shift in expressed sentiment leads to relatively high disagreement among the five annotators; it is unclear whether the ending is meant to be ironic or not.

— Post-hoc Alignment of LLM-judges to Human Judgment Distribution  (2609.01073 - Steindl et al., 1 Sep 2026) in Figure 1 caption, Introduction