Determine the Continuation and Limits of Algorithmic and Hardware Trends Reducing Compute Requirements
Ascertain whether long-run trends that reduce compute requirements and cost—namely algorithmic progress that improves compute efficiency, hardware price–performance improvements, and communication-efficient training that enables more decentralized training—will continue, and characterize their practical limits and implications for the efficacy of compute governance.
References
It is unclear whether these trends will continue in the long run, and what their limits, if any, are.
— Computing Power and the Governance of Artificial Intelligence
(2402.08797 - Sastry et al., 13 Feb 2024) in Section 6.1, Issues of Feasibility and Efficacy — Algorithmic and hardware progress