Deepfake apps

More than 400 AI apps with hidden sexual deepfake features reached Apple and Google stores

WIRED found the apps posed as benign tools, then loaded explicit interfaces; Apple removed 19 and Google removed most.

Illustration: More than 400 AI apps with hidden sexual deepfake features reached Apple and Google stores
Illustration: Gadgetry

A network of more than 400 AI apps concealing sexually abusive deepfake features reached Apple’s App Store and Google Play, according to a WIRED investigation published Monday. 9to5Mac reported that the same apps were also available in the Google Play Store. The apps were disguised as everyday tools such as pet portrait makers, language tutors, and AI workout coaches, but could load explicit interfaces under certain conditions, WIRED reported.

WIRED said the apps used bait-and-switch methods. They displayed harmless content during app review, but a server-side check could unlock hidden features. Downloading one of the apps after tapping an ad on Meta’s Facebook or Instagram appears to be one trigger. Once unlocked, the hidden web interface offered dozens of pornographic photo and video templates, including scenes labeled “bedroom rape” and “threatening knife.” Users could buy credits called diamonds to generate deepfakes from uploaded photos.

Apple removed 19 apps, including a pet photo app called Viefur, after WIRED contacted the company and provided the domains, WIRED reported. Apple spokesperson Adam Dema said the apps had met Apple’s rules at review. Apple said it had suspended tens of thousands of apps using bait-and-switch tactics over the previous year and recently updated App Store rules to further restrict nudify tools. Apple said it had suspended tens of thousands of apps using bait-and-switch tactics over the previous year and recently updated App Store rules to further restrict nudify tools.

Google removed the majority of the apps before WIRED contacted it, according to WIRED. Google did not respond to a request for comment.

The operation appears to involve Chinese developers and a Hong Kong company named KeLing Technology Limited, based on an examination of web domains and service behavior, WIRED reported. Researchers said the code is written in Chinese and uses Chinese hosting, and explicit video ads carried watermarks from Chinese-language video editing software. After WIRED contacted KeLing email addresses, someone removed public connections between the company and the deepfake tools.

Meta took action against ad accounts, business pages, users and pages linked to the domains and blocked 209 apps from advertising on its platforms, WIRED reported. Meta told WIRED it took action against 11,600 ad accounts, over 4,700 business pages, 5,200 users, and 15,000 pages. A Meta spokesperson said: “We have strict rules against promoting nudify apps and work aggressively to keep this material off our services.” 9to5Mac reported Meta said it had acted against more than 10,000 ad accounts tied to the apps.

One popular app in the network, DiffAI, had been downloaded more than 100,000 times from Google Play before its removal, according to WIRED. Across the network, apps had been downloaded collectively more than 350,000 times and many were rated suitable for all ages, based on research from AI Forensics. Paul Bouchaud, lead researcher at nonprofit AI Forensics, said: “This is an organized, commercially run operation: One operator behind hundreds of disposable apps and domains, cloaked to pass App Store review and pushed through tens of thousands of Meta ads under fake payer names.”

Toward the end of the investigation, comparable ads and apps were still appearing on the platforms, WIRED noted.

Corrections.Report an error to corrections@gadgetrymag.com. We list substantive corrections on the corrections page.

Latest