Determine whether expert calculation errors change SFBench gold labels
Determine whether the documented errors in several SFBench expert calculations—including swapped component identities, incorrect composition labeling, omitted phases, and mismatched composition totals—change the corresponding gold feasibility labels.
References
We have not established whether any of these problems changes a gold label.
— Same Claim, Different Interpretations: How LLM Agents Resolve Ambiguity in Scientific Claims
(2610.20457 - Rao et al., 14 Oct 2026) in Appendix F.1, Agent and Expert Calculations