Meta to roll out new tools to combat sextortion on Instagram

In response to the alarming rise of sextortion scams targeting users, particularly teenagers, Meta has announced the rollout of a new nudity protection feature in Instagram Direct Messages (DMs). 

According to Meta, the feature aims to mitigate the risks associated with the unsolicited sharing of intimate images and combat the tactics employed by scammers seeking to exploit individuals.

The new feature, set to undergo testing soon, incorporates on-device machine learning to analyze images exchanged within Instagram DMs. Images detected to contain nudity will be automatically blurred under a warning screen, giving recipients the choice to view or discard the content. This approach not only shields users from unwanted exposure but also empowers them with the ability to block senders and report suspicious activity.

ALSO READ:
PLDT, Smart block over half-a-million child abuse links
Globe blocks nearly half a million child porn sites in 2023

“Companies have a responsibility to ensure the protection of minors who use their platforms,” John Shehan, SVP of the National Center for Missing & Exploited Children, said in Meta’s media advisory. “Meta’s proposed device-side safety measures within its encrypted environment is encouraging. We are hopeful these new measures will increase reporting by minors and curb the circulation of online child exploitation.”

For users under the age of 18, nudity protection will be enabled by default globally, with adults receiving notifications encouraging them to activate the feature. Individuals sending or receiving images containing nudity will be presented with safety tips outlining potential risks and avenues for support.

Vulnerable users

With the nudity protection feature, Meta said it is intensifying efforts to identify and disrupt accounts engaged in sextortion scams. By leveraging a range of signals indicative of suspicious behavior, the platform aims to preemptively prevent interactions between potential scammers and vulnerable users. Message requests from suspected sextortion accounts will be diverted to a hidden requests folder, shielding recipients from exposure to harmful content.

Meta is enhancing support resources for individuals who may have encountered sextortion scams. Pop-up messages will direct affected users to expert-backed resources and helplines, offering guidance and assistance in navigating such situations.

The company’s collaboration with the Tech Coalition’s Lantern program underscores its commitment to combatting sextortion across multiple platforms. By sharing sextortion-specific signals, Meta aims to curtail the prevalence of these scams across the broader internet landscape.

Meta is a founding member of Lantern, a program run by the Tech Coalition that enables technology companies to share signals about accounts and behaviors that violate their child safety policies.