How often should we formally review an automated decision-making system?
Answered
Monitor continuously and set formal review points — recommended at least quarterly. Review datasets, whether the policy intent still holds, and how robust governance, transparency and explainability remain. Adapt to new risks and legal changes.
From the guidance
Primary (how) Ethics, Transparency and Accountability Framework for Automated Decision-Making
Continuously monitor the algorithm or system, institute formal review points (recommended at least quarterly), and end user challenge to ensure it delivers the intended outcomes and mitigates against unintended consequences that may develop over time
Section: 7. Build something that is future proof
Related questions
- Should we publish algorithms used for automated decision-making?
- When should I use the Ethics, Transparency and Accountability Framework for Automated Decision-Making?
- Should automated decision-making be the default solution for complex policy problems?
- Do automated decision-making systems need legal sign-off?
- Should we red-team automated decision-making systems before go-live?