Potential non-human strategic preferences in Solar and Mistral

Investigate whether Solar 10.7B and Mistral 7B exhibit distinctly non-human strategic preferences in contexts beyond those studied and characterize the conditions under which such divergences arise.

Background

While the experiments demonstrate human-like strategic preferences by Solar and Mistral in specific scenarios, the authors caution that this does not establish global human-likeness. They highlight the likelihood of contexts where these models deviate from human preferences and note the difficulty of proving otherwise.