Model imitation shows false promise in language model improvement (arxiv.org)

Summary:

• Finetuning weaker language models on stronger ones like ChatGPT can produce convincing outputs but fails to close the capability gap.
• Imitation models can mimic the style of ChatGPT but not its factuality, making it a false promise for improving open-source models.

Tags: