Dice Question Streamline Icon: https://streamlinehq.com

Origins and control of long-term drift attractors in autoregressive ML Earth system models

Characterize the mechanisms that generate long-term drift attractors in autoregressive machine learning Earth System Models using the Spherical Fourier Neural Operator architecture, specifically in the coupled atmosphere–ocean Ola configuration, and develop effective strategies to control or suppress these drifts to enable stable simulations beyond six months.

Information Square Streamline Icon: https://streamlinehq.com

Background

The authors report substantial drifts at higher latitudes in the Ola coupled model that lead to dynamical instabilities for rollout periods longer than six months, even though similar ML models have demonstrated century-long stability when sufficiently tuned and trained. They emphasize that understanding and mitigating these long-term drift attractors is necessary to advance coupled ML models toward climate-scale simulation capabilities.

References

Understanding the origins of such long-term drift attractors in autoregressive ML, and how to control them, is an open area deserving of systematic empirical testing.

Coupled Ocean-Atmosphere Dynamics in a Machine Learning Earth System Model (2406.08632 - Wang et al., 12 Jun 2024) in Section 'Discussion, Limitations, and Future Work'