San Francisco city officials have directed Apple and Google to remove numerous “nudify” apps from their respective app stores. These apps use artificial intelligence to digitally remove clothing from images, essentially creating non-consensual deepfake pornography. California law explicitly criminalizes knowingly facilitating or recklessly aiding in such activities, and a 2025 statute empowers victims to pursue civil cases against third-party facilitators. Despite these laws, the tech giants have continued to host and financially benefit from these applications.

San Francisco City Attorney David Chiu accused Apple and Google of profiting from apps that exploit women and girls by generating intimate deepfakes without consent. Letters sent to both companies revealed that they have been aware of these violations for nearly a year, with the agencies warning them repeatedly about hosting apps that sell non-consensual intimate images (NCII). Reports from the Tech Transparency Project in January and April detailed app stores’ roles in promoting and processing payments for such illicit services, highlighting the companies’ involvement in the spread of these harmful AI tools.

Chiu’s office has urged Apple and Google to act within 28 days or face potential civil penalties. In response, Apple stated that nudify apps are prohibited on its platform, announcing the removal of three offending apps and threatening developer account termination for others violating policies. Google also confirmed suspensions of five apps flagged in the warnings and indicated it restricts related search terms. Both companies emphasized their efforts to investigate and enforce rules against policy breaches when reported.

The problem of deepfake pornography has primarily affected female celebrities, but the availability of nudify apps makes many individuals vulnerable by using publicly accessible photos. San Francisco’s move represents a push for stronger accountability from platform providers, highlighting the ongoing challenges in policing AI-driven content abuse. This action underscores the increasing legal and ethical scrutiny faced by tech companies in regulating emerging technologies that can facilitate sexual exploitation.