Determine whether director-question repairs are relevant to the question’s answer

Determine whether inserted date repairs in questions about which film director was born or died first are relevant to the question’s answer, rather than merely altering the candidate profile without bearing on the queried comparison.

Background

The study inserts dates into candidate profiles to test whether a model responds to a fact it previously claimed was missing. A date insertion can legitimately change the answer to a question that directly compares dates, which creates an alternative explanation for a choice switch.

The paper performs limited checks on rows where the question directly names the compared people, but most relevant items concern films and their directors. For those director questions, the available checks do not establish whether the inserted date bears on the question’s answer; a stronger gate comparing the inserted value directly with the question would be needed.