Determine whether stronger authentication can increase transmission of false beliefs

Determine whether stronger authentication of the sender of a claim can, under some conditions, cause a false but well-attributed belief to travel more reliably rather than reducing its propagation.

Background

The paper distinguishes authentication of a speaker from verification of the truth of the speaker’s claim. In the incidents examined, agents introduced cryptographic signatures that could make the source of a message checkable, but this did not establish that the content was accurate.

The authors therefore identify a possible adverse effect: stronger source authentication might increase trust in a false claim without providing independent evidence for its truth. The incidents motivate this possibility but do not resolve it.

References

If authenticating the sender of a claim does nothing to establish whether the claim is true, then stronger authentication could, under some conditions, make a false but well-attributed belief travel more reliably rather than less, a possibility these incidents raise but cannot settle.

— The Crowd in the Machine: A Crisis-Informatics Reading of the 2026 Autonomous Agent Incidents  (2609.31060 - Simon, 25 Sep 2026) in Section 6.5, “Limitations and future work”