How do I monitor an AI system once it is live?

Answered

Put ongoing performance monitoring in place, evidence that the system is operating as expected, and manage model updates through a controlled release process that can be rolled back.

From the guidance

Primary (how) AI Playbook for the UK Government

Once you’ve released your AI system for use and it’s operational, you should have ongoing performance monitoring in place. This will ensure your system is operating as expected, and you should be able to provide evidence of this.

Section: Operational monitoring

Read this in AI Playbook for the UK Government (opens in new tab)

Related questions

• Should we monitor AI system inputs as well as outputs?
• How should I threat-model an AI system? Security and safe use of tools
• How do I manage bias and fairness in an AI system? Lawful, ethical and responsible use
• Who is accountable if an AI system causes harm or makes a bad decision?
• Do equality and data-protection checks stop once an AI contract is signed?