Dice Question Streamline Icon: https://streamlinehq.com

Verification of model architecture and training procedures

Show practical methods for verifying properties such as model architecture and training procedures to support formal compliance claims by developers and deployers.

Information Square Streamline Icon: https://streamlinehq.com

Background

Beyond performance metrics, regulators may require attestation of architectural and training details. Formal verification at model scale remains largely untested and difficult.

Developing methods to verify architecture and training processes would strengthen compliance and trust in declared system properties.

References

Furthermore, verifying properties such as a system's architecture or training procedure remain open questions.

Open Problems in Technical AI Governance (2407.14981 - Reuel et al., 20 Jul 2024) in Section 5.3.1 Verification of Model Properties