Dice Question Streamline Icon: https://streamlinehq.com

Accounting for quantization and dropout in compute measures

Determine how governance-relevant measures of training compute should account for algorithmic techniques such as quantization and dropout so that compute-based thresholds accurately reflect risk.

Information Square Streamline Icon: https://streamlinehq.com

Background

Compute thresholds are increasingly used to scope governance obligations, but actual compute use depends on training techniques that compress or regularize models.

Clarifying how to incorporate quantization, dropout, and similar methods into compute accounting would improve the precision and defensibility of compute-based policies.

References

It's also unclear how measures of training compute should take into account techniques such as quantization and drop-out.

Open Problems in Technical AI Governance (2407.14981 - Reuel et al., 20 Jul 2024) in Section 7.1 Translation of Governance Goals into Policies and Requirements