Accounting for quantization and dropout in compute measures
Determine how governance-relevant measures of training compute should account for algorithmic techniques such as quantization and dropout so that compute-based thresholds accurately reflect risk.
References
It's also unclear how measures of training compute should take into account techniques such as quantization and drop-out.
— Open Problems in Technical AI Governance
(2407.14981 - Reuel et al., 20 Jul 2024) in Section 7.1 Translation of Governance Goals into Policies and Requirements