Apple and Google are urged by San Francisco to remove AI Nudify applications from their app stores.

To differentiate ethical AI content, outputs are watermarked with encrypted metadata through Reelmind’s similar verification process. Non-consensual edits are strictly prohibited by Reelmind’s community guidelines, and policy breaches are flagged in real-time by AI moderators. Many free Nudify tools indiscriminately scrape images, in contrast to Reelmind’s model training system, which is auditable and allows users control over data inputs.

This section includes a review of the method by Light et al. and an explanation of our strategy for selecting a representative sample of PornWorks AI blog applications, as well as how we collected and analyzed the data through a walkthrough analysis. A sample of 20 nudification applications (websites) was collected to address our research questions, and they were systematically analyzed using the application walkthrough method—a methodology employed across various fields, including and beyond computer science (e.g., 31, 45, 39, 55, 21, 12). To protect yourself, it is advisable to refrain from using or sharing personal images on platforms utilizing these tools while also supporting stricter regulations to mitigate potential harm from such technologies. Engaging in open conversations with teenagers about online safety enables us to assist them in avoiding becoming victims of these detrimental apps. By empowering and educating teens to make safer online decisions, we can aid in shielding them from becoming victims of harmful technologies.

Prosecution rates for private creation without distribution remain low in most jurisdictions that criminalize it. The ruling sided with victims who sued the platform, not just the individual users who uploaded their photos. Minnesota filed a state bill in March 2026 that would criminalize the use of nudify tools against any Minnesota resident, even if the tool and user are located elsewhere. The DEFIANCE Act takes a civil approach. This law focuses on distribution and platform accountability. Instead, two federal laws passed within months of each other, each attacking the problem from a different angle.

One of the primary challenges is the lack of specific legislation that directly addresses the non-consensual creation and distribution of such content. They raise important questions about the responsibility of developers, the role of platforms in distributing such apps, and the legal measures necessary to protect individuals’ privacy and dignity in the digital age. The non-consensual nature of these images, whether created by Nudify or Undress apps, can have severe emotional and psychological impacts on the victims, contributing to a culture of exploitation and disrespect.

“These new, evolving, technologies require a new, proactive, approach to harm prevention – and we’ll work closely with industry to achieve this.” As researchers, while we strive to be objective, we realize that our personal backgrounds and perspectives could influence our interpretation of the data that we collected. While collecting data from a university campus, the researchers ensured that other people in the environment were not exposed to the imagery on the websites in our study. Using this approach, the researchers explore not only the available features but also the workflow of using the product (e.g., the various interfaces and how they interact).

New turnkey kit makes it easy for anyone to become a scammer

AI porn video generator

This also includes being in underwear or wet or transparent clothing that exposes those body parts. It is a criminal offence to share intimate images of someone without their consent under the Sexual Offences Act in England and Wales, which includes images created by AI. Social media regulation is a nascent area, let alone trying to control the deployment of artificial intelligence.

However, this research shows current legislation is not fit for purpose, that is why Government must ban ‘nudifying’ tools in the UK. Our previous research found that 38% of teenage girls, compared to 27% of teenage boys, strongly agreed that a having a deepfake nude shared of themselves would be worse than a real nude. While some sites include statements in their FAQs suggesting that consent is required when using another person’s image, we did not come across any mechanisms within the upload process to verify or enforce this. The following table displays the number of ‘nudification’ websites returned on the first page of search results for each major search engine. However, other search terms did return direct links to ‘nudification’ websites.

Starting in 2023, researchers found that generative AI models were being misused to create sexually explicit images of children. Researchers pitted a person against a Claude agent and found that, after a week of texting, the AI chatbot was more effective at creating “exploitable trust” with others. While tech companies and regulators have taken a glacial approach to tackling abusive deepfakes since they first emerged more than a decade ago, there has been some recent movement.

xAI, the company founded by Elon Musk, has initiated legal action against Minnesota regarding the state’s pioneering law prohibiting “nudification” technology on websites and applications, which could test the extent of state power in regulating the use of artificial intelligence constitutionally. Comprehensive education is essential for young individuals to critically evaluate and discuss digital content and information, encompassing aspects like data privacy, digital rights, and fostering respectful digital relationships. They can block keywords like “undress” or “nudify,” limit search results, issue warnings or “nudges” to users of related search terms, and employ watermarking and provenance indicators to trace the origins of images. Additionally, open-source AI models may be fine-tuned to develop new nudify tools. Nicola Henry holds the positions of Professor, Australian Research Council Future Fellow, and Deputy Director at RMIT University’s Social Equity Research Centre in Melbourne, Australia. Currently, the specific time frames and practical implementation details of the ban remain uncertain.

This misuse raises critical concerns about the erosion of privacy rights and the potential for creating a surveillance state, where every action can be monitored and analyzed. However, the effectiveness of keyword blocking is limited, as users can find alternative ways to search for or share such content. This measure is part of TikTok’s broader strategy to prevent content that violates their guidelines from gaining traction on the platform. TikTok has taken proactive steps by blocking the keyword “undress,” a popular search term linked to these services. Additionally, Google’s search algorithms have been updated to demote websites that host or promote such content.

Need Help With a Legal Issue?

is nudify AI legal

This is an outlier for our dataset and represents something closer to a crowdworker paradigm than a point-and-click application paradigm. Referral programs were offered to all users by some of the AI nudification applications. All AI nudification applications are commercial platforms, which could be a vector to incentivize guardrails against abusive use.

Generative AI gives them the ability to digitally strip people in images, potentially creating pornographic images from shots of anyone. This was highlighted at the start of this year, when it was revealed “nudify” apps were prevalent on both major smartphone app stores. Apple blocks many of the search terms listed in the TTP’s report, and was able to block a number more thanks to the report’s findings. I delight in looking at the phone market from as many angles as possible, and while my opinions may be odd, at times, they’re always from the heart as much as the head. Recognize the psychological impact of these violations and provide a safe space for victims to express their feelings and seek help. Staying updated on the latest developments in AI and digital manipulation technologies is crucial for understanding the evolving risks and protective measures.

The Tech Transparency Project conferred with an analytics firm to estimate that the nudification apps found through their searches “have been downloaded 483 million times and made more than $122 million in lifetime revenue.” Mahari’s appointment comes at a time when Anthropic has been rolling out new slates of AI solutions for legal work, and other AI developers are also making their way into legal tech. In addition, researchers say Grok has created more than 3 million sexualized images — including more than 20,000 that appeared to depict children — over an 11-day period between Dec. 29 and Jan. 8.

Deluge of ‘nudified’ images on social media platform X raises questions about regulation of use of AI technologies The deluge prompted California Attorney General Rob Bonta to open an investigation into whether xAI broke any state laws, which includes a ban on nonconsensual intimate imagery passed last year. Several lawsuits allege Grok and X did not adhere to industry standards on preventing explicit content. Sherman said they are the “frontline defenders of consumer protection and data privacy.”

Related Post