UK to Be First Country to Ban AI Tools for Creating Child Abuse Content

UK: Britain is set to become the first country in the world to introduce laws criminalizing the use of AI tools designed to create child sexual abuse material (CSAM), according to a government minister. The new legislation will make it illegal to possess, create, or distribute AI tools aimed at generating such content, with offenders facing up to five years in prison.

In addition to banning AI-generated CSAM, the law will also make it illegal to possess AI-generated paedophile manuals, with a maximum sentence of three years for offenders. These manuals instruct individuals on how to use AI for creating abusive content.

Home Secretary Yvette Cooper described AI as “industrializing” online child sexual abuse, making it far more widespread and accessible. “AI is now putting the online child abuse on steroids,” she told the BBC.

The Internet Watch Foundation (IWF) reported a significant rise in AI-generated CSAM, with 245 cases recorded in 2024, up from just 51 the previous year. Of these, 193 cases involved imagery so realistic that it had to be treated as if it were real photographic abuse.

IWF Interim Chief Executive Derek Ray-Hill praised the government’s decision, stating, “These steps will have a concrete impact on online safety.” He also highlighted the tragic impact on children, noting that images of past abuse were being exploited to train AI models, making it easier to create new victimizing material.

MP Gregor Poynton, Chair of the All-Party Parliamentary Group on Children’s Online Safety, expressed his support for the measures, emphasizing that protecting children must remain the top priority. While acknowledging the benefits of AI, Poynton stressed that child safety must never be compromised.