UK schools should remove pupils’ online photos as AI blackmail threat grows, say experts

UK schools should remove pupils’ online photos as AI blackmail threat grows, say experts


UK schools should remove pictures of pupils’ faces from their websites and social media accounts because blackmailers are using them to create sexually explicit images, experts have said.

Child safety experts and the UK’s National Crime Agency (NCA) warn that criminals are using AI to manipulate photos of children and then demand cash not to publish them.

They are recommending educational institutions remove identifiable pictures of children from their websites and social media accounts – or consider not using them at all.

The Internet Watch Foundation (IWF) said an unnamed UK secondary school had recently been subjected to a blackmail attempt after criminals used the institution’s website or social media accounts to take photos of schoolchildren and then, using AI tools, turned them into child sexual abuse material (CSAM). The blackmailers sent the images to the school and threatened to publish them online if they did not receive money.

The IWF, which monitors CSAM online, used a digital tool to turn the blackmail images into a “hash”, or digital fingerprint, which was shared with leading tech platforms in order to prevent them from being uploaded. The watchdog said 150 of the images from the secondary school blackmail attempt could be classified as CSAM under UK law.

Jess Phillips, the minister for safeguarding and violence against women and girls, said the attempted blackmailing of schools was a “deeply worrying emerging threat” and laws on use of AI to create explicit images would be updated if necessary, having announced a ban on possessing AI models designed to generate CSAM.

“We will not hesitate to go further if necessary and make sure our laws stay up to date with the latest threats,” she said.

The IWF said the secondary school incident, which happened late last year, is not the only blackmail attempt involving manipulated school website or social media account photos that it is aware of in the UK. The IWF is not naming the school involved in the incident last year, or the police force that contacted it seeking help in blocking distribution of the images.

A UK advisory body on tackling online harms, the early warning working group (EWWG), has issued guidance to schools on protecting pupils from blackmailers. Although the problem is not widespread, the group is concerned it is “only a matter of time” before more schools are targeted.

The group recommended schools remove images that show a student face-on and instead publish images that are harder to misuse, such as pictures taken from a distance, blurred images or portraits taken from behind a pupil. The advice warned against publishing “identifiable information” that could be used to harm or blackmail an individual, such as “names or faces”.

Schools should also consider whether they need pupil photos at all, said the guidance, stating that establishments should mull over “whether using imagery without children and young people’s faces can still achieve your objectives”. This included “celebrating achievements more safely” by showcasing milestones “while minimising risks”.

Avoiding the use of names or full names in labelling photos will reduce the risk of blackmail, the advice added, while applying privacy settings to a school website or social media account will limit who can view or share content.

A checklist of actions recommended by the EWWG included conducting regular audits of children’s images on websites, social media accounts and promotional material and regularly seeking re-signing of image consent agreements.

If an incident occurs, the group advised schools to contact the police immediately, retain any criminal images and remove from view the original images that had been tampered with. The EWWG’s members include the NSPCC charity, the IWF, the Welsh government, Education Scotland, the Safeguarding Board for Northern Ireland and the NCA.

The Confederation of School Trusts (CST), whose academy schools educate more than four million primary and secondary schoolchildren across England, said schools would “carefully consider” the guidance and find the “right balance” between “celebrating pupils … and keeping everyone safe”.

“As educators we instinctively want to celebrate children’s achievements and that includes sharing photos and videos of all the good things that go on in our schools – it is deeply depressing that in doing so we potentially have to contend with threats from abusers and scammers,” said Leora Cruddas, CST chief executive.

Blackmailing people over intimate images is known as sextortion and the crime has a become increasingly prevalent, with the advent of generative AI tools giving criminals a new way of extorting victims. Typically, sextortion involves manipulating a child or adult into sending intimate images or videos of themselves and then threatening to send the images to friends or relatives, or release them online, if the victim does not send money or more explicit images.

Sextortion has been linked to the suicides of several British teenagers who have killed themselves after receiving extortion threats. In 2024, the Guardian reported the threat was evolving due to advances in AI, with one teenager being sent a fake “nude” image of herself that appeared to have been taken from her Instagram account.

The Report Remove service, which allows children to flag explicit images or videos of themselves that have appeared – or could appear – online, said sextortion attempts are increasing. Last year it received 394 reports from under-18s of blackmail attempts after the victims had been manipulated into sending sexual images to predators. The figure is 34% higher than in 2024.

Sextortion has been carried out by criminal gangs based outside the UK, with the NCA pointing to west Africa and Nigeria as hubs. It is understood that the secondary school sextortion attempt involved the use of terms that appear in negotiation “scripts” used by sextortion gangs.

Some schools have already taken action after an increase in the threat from AI tools. Last year, the Loughborough Schools Foundation, which represents three private schools, redesigned its website to remove recognisable images of pupils.



Source link

Posted in

Sarkiya Ranen

I am an editor for Ny Journals, focusing on business and entrepreneurship. I love uncovering emerging trends and crafting stories that inspire and inform readers about innovative ventures and industry insights.

Leave a Comment