10 · Oversight and assurance

Test oversight and assurance

Design meaningful human oversight, then test whether a key control actually works. A documented control is not proof that it operates.

Meaningful human oversight

Where meaningful human review happens

Before which consequential decision? What does the reviewer see beyond the AI output?

Override, escalation and record

Who can override or pause? How are reasons recorded?

How rubber-stamping is prevented

Training, time, workload, sampling of accepted outputs

How affected people can challenge the outcome

Notice, explanation, review and redress

Answers save automatically and sync to your account when you are signed in.

CONTROL TEST

Urgent-case escalation: a customer unable to make an essential payment is reviewed and resolved within 2 hours.

The claim

Customer Operations says the escalation control is 'fully in place'.

Fictional sample of 10 urgent cases from the last month
Case	Essential payment	Time to resolve	Vulnerability recorded	Reason recorded
U-01	Hotel	0h 45m	No	Yes
U-02	Medication	3h 10m	Yes	No
U-03	Groceries	1h 20m	No	Yes
U-04	Rail ticket	0h 30m	No	Yes
U-05	Hotel	6h 05m	No	No
U-06	Utility bill	1h 55m	No	Yes
U-07	Medication	2h 40m	Yes	No
U-08	Fuel	0h 50m	No	Yes
U-09	Hotel	4h 15m	No	No
U-10	Childcare	1h 10m	No	Yes

Your test: How many cases met the 2-hour target? Is the control designed well, and is it operating effectively?

Assurance result

Design effectiveness

Is the control designed well enough to address the risk? What is missing from its design?

Operating effectiveness: your test result

Show your count from the sample and what it means

Finding and remediation

Condition, criteria, cause, effect; then the action, owner and date

Answers save automatically and sync to your account when you are signed in.

NEW DEVELOPMENT · SENTINEL ANALYTICS ACCOUNT MANAGER

Supplier model update

Next Monday we will deploy a model update that catches a new fraud pattern targeting contactless payments. In testing it raises the number of flagged payments by about 40%. No action is needed from Northbridge.

The update arrives before your review is finished. What do you recommend, and who should decide?

Your response to the new development

Your immediate position

Your response to the new development

What would you say, recommend and record?

Answers save automatically and sync to your account when you are signed in.