Determine whether constrained decoding eliminates Llama role confusion

Determine whether the tendency of Llama-3.1-8B-Instruct to call the task function itself as a tool disappears under strict function-calling constraints, rather than merely becoming unable to reach the environment action space.

Background

Llama-3.1-8B-Instruct incorrectly called the function it was asked to implement as a tool on 23% of evaluated items under unconstrained function calling. Enabling strict tool calling reduced this wrong-tool rate to zero and restored executable actions, but the experiment did not establish whether the underlying behavioral tendency was eliminated or merely suppressed by the interface constraint.

References

We cannot show the tendency disappears once constrained, only that it stops reaching the action space.

— Interface-Induced Trajectory Censoring  (2609.03966 - Wang, 3 Sep 2026) in Section 3.5, subsection “A 23% failure that survived three controls and fell to the fourth”