Apple and Google ordered to purge ‘nudify’ apps from App Stores

San Francisco has directed Apple and Google to remove numerous “nudify” apps from their app stores, citing violations of local laws aimed at preventing the creation and distribution of non-consensual deepfake pornography. The order follows ongoing efforts by city officials to hold technology companies accountable for facilitating access to such harmful content. The directive comes amid growing concerns over the proliferation of apps capable of digitally altering photographs to expose individuals' private parts. These applications, often marketed under innocuous names, enable users to generate explicit imagery from ordinary photos, raising serious ethical and legal issues. According to the city attorney’s office, the apps operate within the app stores despite existing state and local legislation designed to curb this type of exploitation. California enacted laws in 2025 that criminalize knowingly facilitating or recklessly aiding the production of non-consensual deepfake pornography. Additionally, the state allows victims to file civil lawsuits against third parties who assist in creating such material. Despite these legal frameworks, San Francisco asserts that Apple and Google have persisted in allowing these apps to remain active while generating revenue through in-app purchases. In statements obtained by TechCrunch, San Francisco City Attorney David Chiu emphasized that the tech giants are profiting from platforms that exploit women and girls by enabling the generation of nonconsensual intimate deepfakes. “While the companies cut ties with some problematic apps, Apple and Google have a responsibility to be proactive and vigilant to prevent sexual abuse,” Chiu stated. Chiu’s office sent formal letters to both companies, detailing that they had been aware of the issue for nearly a year. The correspondence noted that Apple and Google had received repeated warnings about hosting these apps, including reports from the Tech Transparency Project (TTP). In January and again in April, TTP published findings indicating that both companies hosted dozens of apps that sold deepfake non-consensual intimate images (NCII) and processed payments for such transactions. The TTP report from April accused Google and Apple of deliberately steering users toward these apps, labeling them as key players in the dissemination of AI tools that transform real individuals into sexualized images. The organization argued that the companies’ actions contributed to the widespread availability of harmful content. Chiu further indicated that both companies may have earned millions of dollars in fees from apps offering such services. The city’s letters warn that Apple and Google could face civil penalties for failing to comply with the law and request that they respond within 28 days. The issue extends beyond high-profile figures, as deepfake pornography has increasingly targeted everyday individuals. With the rise of nudify apps, even publicly available photos can be exploited, posing risks to privacy and personal safety. While the exact number of affected users remains unclear, the potential for harm is significant. TechCrunch attempted to reach out to Apple and Google for official comments, but as of now, no response has been received. The situation highlights the complex challenges faced by regulators in balancing innovation with user protection, particularly in the rapidly evolving landscape of artificial intelligence and digital media.