Checks / Obligations / Prove it works as intended
Obligation · 30 controls · 12 laws
Prove it works as intended
AI systems must be accurate, robust and tested, with known limits and documented performance.
What to put in place
Define how accuracy is measured, test before release and record the results and known limits.
Policy wording you can use
[your organisation] defines accuracy and robustness measures for each AI system, tests them before release and after changes, and documents the results and the system's known limits.
Prove it once
Describe or link the evidence that this is in place: the policy, the page, the document reference. It is sealed once and applied to all 28 controls here that take a yes or a document (the rest need their own number or date and are listed after).
Every control that asks for this
Model risk (SR 11-7)
- SR 11-7 - independent validation
- SR 11-7 - conceptual soundness reviewed
- SR 11-7 - outcomes analysis / backtesting
- SR 11-7 - benchmarking performed
- SR 11-7 - limitations stated
- SR 11-7 - used within approved scope
EU AI Act
- EU AI Act Art.15 - accuracy metric recorded
- EU AI Act Art.15 - robustness tested
- EU AI Act Art.5 - prohibited-practice screen passed
- EU AI Act Art.55 - systemic-model evaluation
- EU AI Act Art.55 - adversarial red-team testing
Agent output: compliance gates
- EU AI Act Art.15 - accuracy metric recorded
- EU AI Act Art.15 - robustness tested
- ISO/IEC 42001 A.9 - intended use documented
- NIST AI RMF MEASURE-1 - metrics identified
- NIST AI RMF MEASURE-2 - trustworthiness evaluated
ISO/IEC 42001
- ISO/IEC 42001 A.9 - intended use documented
- ISO/IEC 42001 A.9 - foreseeable misuse considered
- ISO/IEC 42001 Cl.9 - performance monitoring
NIST AI RMF
- NIST AI RMF MEASURE-1.1 - metrics identified
- NIST AI RMF MEASURE-2.3 - performance evaluated
- NIST AI RMF MEASURE-2.7 - security & resilience tested
UK evidence and records law
- CPA 1987 s.4(1)(e) - state of the art at release evidenced and dated
- CRA 2015 s.34-36 - AI digital content matches its description