News

Young girls withdrawing from online life due to ‘nudification’ deepfake threat

Disturbing new evidence of how generative AI and widely available “nudification” tools are being used to create “deepfake” sexually explicit images has led to calls for apps using this technology to be banned.
Growing threat: Content on the most visited bespoke websites for sexually explicit deepfakes received 40 million views in the month of January 2024. Google searches for the term ‘deepfakes’ increased by 76% between 2019 and 2023 - Adobe Stock

A report from the Children’s Commissioner reveals how young people – especially girls – are now withdrawing from online life, afraid that their images will be taken and manipulated using such technologies.

Dame Rachel de Souza is calling for “a total ban” on apps that allow users to create deepfake sexually explicit images, saying that “there is no positive reason for these to exist”.

While it is illegal to create or share a sexually explicit image of a child, the report warns that the technology enabling deepfake images to be created remains legal and is becoming more easily available via large social media platforms and search engines. GenAI technology, it adds, has “supercharged” the growth of these tools.

Register now, read forever

Thank you for visiting SecEd and reading some of our content for professionals in secondary education. Register now for free to get unlimited access to all content.

What's included:

  • Unlimited access to news, best practice articles and podcast

  • New content and e-bulletins delivered straight to your inbox every Monday and Thursday

Register

Already have an account? Sign in here