Module 8: NIST MEASURE
Testing plan, acceptance criteria, benchmarks and model card
What you'll show in Module 8
The critical areas of this module's Knowledge Check.
- Metrics and measurement approach
- Testing and evaluation (TEVV)
- Fairness and bias measurement
How Module 8 works
- 1Learn
- 2Check
- 3Practise
- 4Demonstrate
- 5Evidence
Learn
Lesson to followThe video and materials for this module are still being written. You can already check and practise: follow your path above.
Your assignment
MEASURE performance and harms
- Your role
- AI evaluation lead
- Decision
- What evidence would test the claims?
- Case
- RMFAI
- Evidence you produce
- Evaluation plan and model-card critique
Review criteria
- Set testable criteria and thresholds
- Distinguish evidence from supplier claims
- Required to complete the module: Knowledge Check and Practitioner Challenge. Recommended: guided practice in the Practitioner Lab. Optional: weekly self-check.
- Continue the case from Module 7. This module's evidence (NIST MEASURE Testing Plan, Model Card) is submitted and reviewed on its own.
- Your work adds to the RMFAI dossier begun in Module 5. Your trainer reviews it at the Module 9 milestone.
- It is used next in Module 9 and in the capstone (Module 24).
Revision (optional)
Use these to find gaps before or after your Knowledge Check. They don't count towards your badge: only the Check and Demonstrate do.
- Module 8 self-checkOptional warm-up for your Knowledge Check