Apple and Google have removed dozens of AI nudify apps following safety concerns and reports of exploitation.
Both Apple and Google have acted against a host of AI nudify apps that generate nude images from user photos, following an investigation by TTP experts. The analysis revealed 55 such apps available on Google Play and 47 on the App Store.
In response to the findings, Apple has removed 28 of these apps and cautioned developers that ongoing violations could lead to further deletions. Meanwhile, some apps were reinstated after addressing compliance issues. A representative from Google confirmed that multiple programs have been suspended for review.
TTP experts expressed concern, stating, “Both companies claim to care about user safety, yet they host apps that can turn an innocent photo of a woman into an offensive sexual image.” The investigation involved testing various apps using AI-generated images, uncovering two primary types: those that stripped clothing from images and those that superimposed faces onto explicit content.
Kathy Paul, Director of TTP, emphasized that these applications are not merely for clothing alterations but are explicitly designed to sexualize individuals without their consent. Notably, 14 of the identified apps originated from China, raising concerns about data privacy. Paul noted that, due to Chinese data laws, any information generated could be accessible to the government, presenting substantial risks for individuals whose images were used.
The Dangers of AI Usage
The recent incidents highlight the potential misuse of AI technologies in creating explicit content. In a related issue earlier this year, the chatbot Grok faced backlash over an ability to generate explicit images before disabling the feature. Additionally, legal actions are being initiated; in August 2024, San Francisco City Attorney David Chiu filed a lawsuit against major websites facilitating AI-based nude image generation without consent, citing violations of multiple laws.
Chiu remarked, “Generative AI has tremendous potential, but like all new technologies, it comes with unforeseen consequences and criminals eager to exploit it. We must be clear that this is not innovation — it is sexual violence.” The lawsuits target platforms allowing users to upload photos for generating lifelike pornographic images, which can be used for various forms of exploitation.
In response to the growing concern over deepfake pornography, Microsoft announced a partnership with StopNCII in September 2024 to combat this issue through its Bing search engine.
