Dice Question Streamline Icon: https://streamlinehq.com

Why narrative prompting improves GPT-4 forecasting accuracy

Ascertain why framing predictions as future narratives—making the prediction task subservient to creative storytelling—improves the forecasting accuracy of GPT-4 relative to direct prediction prompts.

Information Square Streamline Icon: https://streamlinehq.com

Background

The paper finds that GPT-4’s predictions markedly improve when the model is asked to produce fictional future narratives in which authoritative speakers recount past events, compared to direct requests for forecasts.

Despite demonstrating this empirical effect, the authors explicitly state they do not understand the mechanism by which narrative framing enhances predictive accuracy, raising a methodological open question about prompt design and model behavior.

References

Why this matters is not clear, but we think that making the prediction task subservient to the primary task of creative storytelling does indeed make a difference in the accuracy of ChatGPT's forecasting.

Can Base ChatGPT be Used for Forecasting without Additional Optimization? (2404.07396 - Pham et al., 11 Apr 2024) in Prompting Methodology and Data Collection (end of section)