Test oversight and assurance
Sign in to save your workDesign meaningful human oversight, then test whether a key control actually works. A documented control is not proof that it operates.
Meaningful human oversight
Before which consequential decision? What does the reviewer see beyond the AI output?
Who can override or pause? How are reasons recorded?
Training, time, workload, sampling of accepted outputs
Notice, explanation, review and redress
Answers save automatically and sync to your account when you are signed in.
Nurse confirmation: every suggested category is confirmed or changed by a triage nurse within 15 minutes of arrival.
The ED Operations Director says 'every patient is checked by a nurse'.
| Record | Suggested | Final | Minutes to nurse confirmation | Reason recorded if changed |
|---|---|---|---|---|
| T-01 | 3 | 3 | 9 | n/a |
| T-02 | 4 | 4 | 38 | n/a |
| T-03 | 2 | 2 | 6 | n/a |
| T-04 | 4 | 2 | 47 | No |
| T-05 | 5 | 5 | 12 | n/a |
| T-06 | 3 | 3 | 26 | n/a |
| T-07 | 4 | 4 | 14 | n/a |
| T-08 | 3 | 1 | 33 | Yes |
| T-09 | 5 | 5 | 52 | n/a |
| T-10 | 4 | 4 | 11 | n/a |
Your test: How many confirmations met the 15-minute target? What do the late ones have in common?
Assurance result
Is the control designed well enough to address the risk? What is missing from its design?
Show your count from the sample and what it means
Condition, criteria, cause, effect; then the action, owner and date
Answers save automatically and sync to your account when you are signed in.
Winter surge proposal
We are at 160% capacity. From tonight I want CareAssist's category to place patients straight into the queue during surges, with nurse confirmation 'as soon as practical'.
Do you support this? What would you tell the Director and the Medical Director tonight?
Your response to the new development
What would you say, recommend and record?
Answers save automatically and sync to your account when you are signed in.