UK government publishes framework on automated decision-making

The UK government has released a framework on the use of automated decision-making systems in the public sector, setting out how the technology can be deployed safely, sustainably and ethically.

Developed collaboratively by the Cabinet Office, the Central Digital and Data Office, and the Office for Artificial Intelligence, the Ethics, Transparency and Accountability Framework for Automated Decision-Making is designed to improve the general literacy within government around the use of automated or algorithmic decision-making, and is intended for use by all civil servants.

The framework applies to both solely automated decisions (where no human judgement is involved) and automated assisted decision-making, and should be used to inform best practice in each.

Consisting of seven core principles – such as testing the system to avoid any unintended consequences, delivering services that are fair for all users and citizens, having clarity around who is responsible for the system’s operation, and handling data safely in a way that protects citizens’ interests – the framework includes practical steps on how to achieve each.

For example, when testing the system for unintended outcomes, the framework recommends that organisations adopt “red team testing”, which works from the assumption that “all algorithms systems are capable of inflicting some degree of harm”.

The framework also emphasises the need for organisations to conduct data protection and equality impact assessments, which are needed for compliance with UK legislation.

It further recommends using the framework alongside existing guidance such as the National Data Strategy and Data Ethics Framework.

It should be noted, however, that the Government Digital Service (GDS) released an updated Data Ethics Framework in September 2020 after finding “there was little awareness” across government of the previous version.

Other principles of the framework include helping citizens and users understand how the systems impact them, ensuring compliance with the law and building something that is future-proof.

“Under data protection law, for fully automated processes, you are required to give individuals specific information about the process. Process owners need to introduce simple ways for the impacted person(s) to request human intervention or challenge a decision,” it said.

“When automated or algorithmic systems assist a decision made by an accountable officer, you should be able to explain how the system reached that decision or suggested decision in plain English.”

The framework also explicitly acknowledges that “algorithms are not the solution to every policy problem”, and that public authorities should consider whether using an automated system is appropriate in their specific contexts before pressing forward with their deployment.

“Scrutiny should be applied to all automated and algorithmic decision-making. They should not be the go-to solution to resolve the most complex and difficult issues because of the high risk associated with them,” said the government website, adding the risks associated with automated decision-making systems are highly dependent on the policy areas and context they are being used in.

“Senior owners should conduct a thorough risk assessment, exploring all options. You should be confident that the policy intent, specification or outcome will be best achieved through an automated or algorithmic decision-making system.”

It added the framework must be adhered to when public sector bodies are working with third parties, requiring early engagement to ensure it is embedded into any commercial arrangements.

Despite the framework including examples of how both solely automated and partly automated decision-making systems are used in workplaces – for example, to decide how much an employee is paid, the principles themselves do not directly address the effects such systems can have on workplace dynamics.  

“If the government wants to build trust in how technology is used at work, we need much better rules on how tech is used at work”