Reliable measurement of hallucination in long-form settings

Develop a reliable method to measure hallucination in long-form generation, where hallucination is defined as correctness of facts with respect to a model’s internal knowledge, distinct from factuality assessed against external world knowledge.

Background

The work focuses on factuality—correctness with respect to external world knowledge—using SAFE to verify individual facts via Google Search.

The authors note that this is different from hallucination—correctness relative to a model’s internal knowledge—and state that a reliable approach for measuring hallucination in long-form outputs remains unsettled.