How much human oversight do I need when using AI in decision making?

Answered

You need meaningful human control, not a rubber stamp. The ICO says meaningful human review usually comes after the automated decision and must relate to the actual outcome — merely feeding data into a model is not enough. The Playbook still requires humans to validate high-risk decisions and provide ways to intervene. People remain responsible for decisions they make with AI support.

From the guidance

Primary (how) ICO: Article 22 of the UK GDPR and fairness

In most cases, for human review to be meaningful, human involvement should come after the automated decision has taken place and it must relate to the actual outcome.

Section: When does the human-determined decision take place?

Read this in ICO: Article 22 of the UK GDPR and fairness (opens in new tab)

Secondary (normative) AI Playbook for the UK Government

You need to monitor the AI’s behaviour and have plans in place to prevent any harmful effects on users. This includes ensuring that humans validate any high-risk decisions influenced by AI and that you have strategies for meaningful intervention.

Section: Principle 4: You have meaningful human control at the right stages

Read this in AI Playbook for the UK Government (opens in new tab)

Secondary (normative) Data and AI Ethics Framework

People must be able to monitor and influence how systems work, even when the system is partially or fully automated. People should remain responsible for the decisions they make when these are supported or informed by an AI system.

Section: Maintain human oversight

Read this in Data and AI Ethics Framework (opens in new tab)

Related questions