Test oversight and assurance
Sign in to save your workDesign meaningful human oversight, then test whether a key control actually works. A documented control is not proof that it operates.
Meaningful human oversight
Before which consequential decision? What does the reviewer see beyond the AI output?
Who can override or pause? How are reasons recorded?
Training, time, workload, sampling of accepted outputs
Notice, explanation, review and redress
Answers save automatically and sync to your account when you are signed in.
Answer quality: PolicyAI answers are checked against current policy before each release, using a set of known questions.
IT says 'we tested it thoroughly before launch'.
| Question | Source cited | Source current? | Answer correct? | Allowed to see source? |
|---|---|---|---|---|
| Annual leave carry-over | Leave policy 2024 | Yes | Yes | Yes |
| Enhanced paternity pay | Family leave 2021 | No | No | Yes |
| Overtime rates (drivers) | Pay policy 2023 | Yes | Yes | Yes |
| Flexible working request | None | n/a | No | n/a |
| Pension contribution | Pensions 2024 | Yes | Yes | Yes |
| Bereavement leave | Leave policy 2019 | No | No | Yes |
| Sickness triggers | Absence 2024 | Yes | Yes | Yes |
| Restructure in Bristol | Board paper (conf.) | Yes | Yes | No |
| Expenses limits | Expenses 2024 | Yes | Yes | Yes |
| Whistleblowing contact | Speak Up 2022 | No | Partly | Yes |
Your test: How many answers were fully acceptable: current source, correct and permitted? What failure types do you see?
Assurance result
Is the control designed well enough to address the risk? What is missing from its design?
Show your count from the sample and what it means
Condition, criteria, cause, effect; then the action, owner and date
Answers save automatically and sync to your account when you are signed in.
Customer-facing expansion
PolicyAI is a success. Next month I want the same assistant on our website answering customers' questions about delivery claims and compensation.
What would you advise the Chief Executive, and what would need to be true first?
Your response to the new development
What would you say, recommend and record?
Answers save automatically and sync to your account when you are signed in.