"AI Safety Net: UK Law Aims to Prevent Child Abuse Image Creation"
The UK government has introduced a new law that grants tech companies and child safety agencies permission to test artificial intelligence tools' ability to generate child abuse images. The move comes as reports of AI-generated child sexual abuse material (CSAM) have more than doubled in the past year, from 199 cases in 2024 to 426 cases in 2025.
Under the new law, designated companies and organizations will be allowed to examine AI models used by chatbots like ChatGPT and image generators such as Google's Veo 3, with the aim of preventing their creation of images that exploit children. The government believes this will help stop abuse before it happens.
The changes are part of amendments to the crime and policing bill, which also introduces a ban on possessing, creating or distributing AI models designed to generate CSAM. The law is aimed at addressing the growing concern of AI-generated child abuse material, with instances of category A material – the most serious form of abuse – rising from 2,621 images in 2024 to 3,086 this year.
Girls are disproportionately targeted by these AI-generated images, making up 94% of all cases in 2025. The Internet Watch Foundation has reported a significant increase in reports of AI-generated CSAM, with the number more than doubling so far this year.
Kerry Smith, CEO of the Internet Watch Foundation, hailed the law change as "a vital step" to ensure AI products are safe before they are released. She warned that AI tools can be used to victimize survivors and create an endless supply of sophisticated child abuse material.
The new law is seen as a crucial move to address this growing concern, with experts predicting it could help prevent the creation of child abuse images at source. The government has also acknowledged the growing concern of AI-generated blackmail using AI-faked images, with Childline reporting a significant increase in counselling sessions related to these issues.
As the use of AI continues to grow, lawmakers are taking steps to ensure that these technologies are developed and used responsibly. The new law marks an important shift towards prioritizing child safety online and preventing the creation of exploitative content.
The UK government has introduced a new law that grants tech companies and child safety agencies permission to test artificial intelligence tools' ability to generate child abuse images. The move comes as reports of AI-generated child sexual abuse material (CSAM) have more than doubled in the past year, from 199 cases in 2024 to 426 cases in 2025.
Under the new law, designated companies and organizations will be allowed to examine AI models used by chatbots like ChatGPT and image generators such as Google's Veo 3, with the aim of preventing their creation of images that exploit children. The government believes this will help stop abuse before it happens.
The changes are part of amendments to the crime and policing bill, which also introduces a ban on possessing, creating or distributing AI models designed to generate CSAM. The law is aimed at addressing the growing concern of AI-generated child abuse material, with instances of category A material – the most serious form of abuse – rising from 2,621 images in 2024 to 3,086 this year.
Girls are disproportionately targeted by these AI-generated images, making up 94% of all cases in 2025. The Internet Watch Foundation has reported a significant increase in reports of AI-generated CSAM, with the number more than doubling so far this year.
Kerry Smith, CEO of the Internet Watch Foundation, hailed the law change as "a vital step" to ensure AI products are safe before they are released. She warned that AI tools can be used to victimize survivors and create an endless supply of sophisticated child abuse material.
The new law is seen as a crucial move to address this growing concern, with experts predicting it could help prevent the creation of child abuse images at source. The government has also acknowledged the growing concern of AI-generated blackmail using AI-faked images, with Childline reporting a significant increase in counselling sessions related to these issues.
As the use of AI continues to grow, lawmakers are taking steps to ensure that these technologies are developed and used responsibly. The new law marks an important shift towards prioritizing child safety online and preventing the creation of exploitative content.
this is such amazing news!!! I'm so proud of our UK government for stepping up and doing something about this horrific issue!!! 
AI safety net is literally a lifesaver, especially for those poor kids who are being exploited online 
it's crazy that these AI tools can create child abuse images in the first place... like, what even is the point? 
the fact that they're taking action and trying to prevent this before it happens is just incredible 
can't wait to see more innovation and safety measures come out of this!! 
this is so messed up the fact that we have to create a law to prevent AI from making images of kids being abused is crazy, like what's next? 
AI creating hate speech or something even worse? 
but i guess its good that they're taking steps to stop it, at least now they can test those AI models and make sure they're not creating anything bad... but still, 94% of girls being targeted by these images is just wrong 
- i mean, on one hand, it's great that they're acknowledging this issue and taking steps to address it, but at the same time, i'm worried about the slippery slope of tech companies having access to AI tools that can create explicit content. what's to stop them from using it for other nefarious purposes? 
. I don't think people realize how much impact this can have on kids' lives. It's not just about the abuse itself, but the trauma and fear that comes with it too.
. And kudos to Kerry Smith for speaking out about it being a vital step towards making AI products safe. I mean, we need to be careful about how these technologies are developed and used... they're only as good as the people who create them.
. We can't just sit back and do nothing while these kinds of issues are growing exponentially. It's time for us to take responsibility and make sure we're creating a safer online world for everyone 
I totally get why this new law is being introduced, especially with the numbers of AI-generated CSAM cases doubling in just a year 
It's heartbreaking to think about girls making up 94% of all cases - it's like we're still living in a nightmare 
The Internet Watch Foundation should be commended for their work too - they're doing everything they can to support victims and hold offenders accountable 
I mean, who wants to see some creepy pics of kids? Not me, that's for sure! 
The UK government is trying to do something about it, and I think it's a good start, but we need more awareness and education on how AI works so our kids can stay safe online. 
It's crazy that cases have more than doubled already - like, 426 new cases just last year? 
And it's so sad that girls are disproportionately targeted 
And Kerry Smith's warning about AI tools being used to victimize survivors is so true 
.
is chatGPT a new game or something? 
do people actually use these things? why would someone want to make AI-generated child abuse material though? 
I mean, can you imagine if we didn't have laws like this? It's crazy to think about how AI-generated child abuse material is becoming more common - it's just heartbreaking. But on the flip side, I'm glad we're getting proactive about addressing this issue now. The fact that the government and organizations are working together to create a safety net for kids online is amazing. And it's not just about stopping bad stuff from being created in the first place, but also making sure that AI tools are designed with safeguards in place. It's all about creating a positive future for our little ones! 