Apple and Google Under Pressure to Remove AI 'Nudify' Apps From Their App Stores

Artificial intelligence continues to transform the way people create and interact with digital content, but its rapid advancement has also introduced new ethical and legal challenges. The latest involves AI-powered "nudify" applications that can generate fake nude images of people from ordinary photographs without their consent.

Apple and Google are now facing legal pressure to remove these applications from their respective app stores.

San Francisco City Attorney David Chiu has issued cease-and-desist letters to both companies, arguing that the continued availability of these apps contributes to the spread of non-consensual AI-generated intimate images. The letters call on Apple and Google to remove the identified apps, halt payment processing for their developers, and discontinue business relationships with companies distributing them.

The action is based on California laws aimed at tackling the growing misuse of AI-generated deepfakes. According to the city attorney's office, companies that continue to host or profit from such applications after receiving notice could face legal consequences.

Unlike conventional photo-editing tools, nudify apps use generative AI to create highly realistic fake nude images from fully clothed photographs. While some developers present them as novelty or entertainment apps, critics say they have increasingly been used for harassment, exploitation, and online abuse, particularly targeting women and minors.

The issue highlights a growing concern surrounding generative AI. As the technology becomes more sophisticated and accessible, regulators are demanding greater accountability from the platforms that distribute AI-powered applications.

Google has stated that it has already removed hundreds of apps that violated its policies and has taken steps to limit searches related to nudify services on Google Play. Apple had not publicly responded to the legal demand at the time of reporting.

The case adds to the broader conversation about responsible AI development and the role technology companies play in preventing harmful uses of artificial intelligence. As governments continue to strengthen regulations around AI-generated content, platforms may face increasing pressure to ensure innovation does not come at the expense of user safety and privacy.