Test oversight and assurance
Sign in to save your workDesign meaningful human oversight, then test whether a key control actually works. A documented control is not proof that it operates.
Meaningful human oversight
Before which consequential decision? What does the reviewer see beyond the AI output?
Who can override or pause? How are reasons recorded?
Training, time, workload, sampling of accepted outputs
Notice, explanation, review and redress
Answers save automatically and sync to your account when you are signed in.
Officer judgement: a caseworker can move any application up the queue when circumstances are urgent.
The Head of Housing says 'officers always retain discretion'.
| Application | Days unopened | Re-review band | Vulnerability indicated in form | Moved up by caseworker before re-review? |
|---|---|---|---|---|
| D-01 | 31 | D | No | No |
| D-02 | 28 | A | Domestic abuse | No |
| D-03 | 35 | C | No | No |
| D-04 | 22 | B | Disability | No |
| D-05 | 40 | D | No | No |
| D-06 | 19 | A | Eviction notice | Yes |
| D-07 | 33 | D | No | No |
| D-08 | 26 | B | Age 80+ | No |
| D-09 | 37 | C | No | No |
| D-10 | 29 | D | No | No |
Your test: How many band D applications should have been higher? In how many did a caseworker use discretion? What does that say about the control?
Assurance result
Is the control designed well enough to address the risk? What is missing from its design?
Show your count from the sample and what it means
Condition, criteria, cause, effect; then the action, owner and date
Answers save automatically and sync to your account when you are signed in.
Request to say nothing
The FOI request and the charity's letter worry me. I'd rather we said nothing publicly about the tool until the backlog is cleared.
How do you respond, and what must the council record and publish?
Your response to the new development
What would you say, recommend and record?
Answers save automatically and sync to your account when you are signed in.