Experts indicate a rise in the popularity of applications and websites leveraging artificial intelligence to manipulate images and create nude depictions of individuals.
In September, an astounding 24 million people reportedly visited platforms dedicated to this type of content, according to data from the social network analysis firm Graphika.
These platforms, commonly known as “nudify” services, are actively advertised on major social media networks. Graphika noted a significant surge of over 2,400% in advertisements for such apps on platforms like X and Reddit. These services utilize AI technology to generate simulated nude images, with a particular focus on women.
The proliferation of these tools highlights a concerning trend of non-consensual pornography driven by advancements in artificial intelligence, also referred to as algorithmic or synthetic media. The unauthorized use of images sourced from social media without consent raises substantial legal and ethical issues.
Graphika attributes the spike in popularity to the widespread availability of open-source AI models capable of producing highly realistic images. These models, accessible for free, have democratized the use of such technology.
Santiago Lakatos, an analyst at Graphika, emphasized the significant enhancement in the realism of deepfake images, noting the current ability to generate remarkably authentic content.
Instances of inappropriate advertising for these services have been noted, with a platform on X promoting image manipulation software using suggestive language hinting at the creation and potential misuse of nude imagery. Despite Google’s policies against sexually explicit ads, sponsored content related to these services has appeared on YouTube.
While some services charge a monthly fee of $9.99, they claim to have garnered a sizable customer base, leading to a surge in both traffic and revenue. However, privacy experts have raised concerns about the ease and effectiveness with which AI technology facilitates the production and dissemination of non-consensual sexual content.
Eva Galperin, the head of security at the Electronic Frontier Foundation, highlighted a troubling trend where individuals, including students, are increasingly involved in creating such content. Victims of deepfake pornography encounter challenges in seeking legal redress, as law enforcement may hesitate to investigate or prosecute cases due to the complexity of these incidents.
Although federal laws do not explicitly forbid deepfake pornography, regulations exist against producing such content involving minors. A recent case saw a North Carolina psychiatrist sentenced to 40 years in prison for using nude apps on patient photos, setting a significant legal precedent in this area.
Platforms like TikTok and Meta Platforms Inc. have taken steps to limit searches related to undressing software, acknowledging the potential violations associated with such content. TikTok has blocked searches for terms connected to these solutions, while Meta Platforms Inc. has imposed similar restrictions in response to public concerns.
