A coalition of data protection authorities from 61 countries has issued a strong global warning on the growing dangers linked to AI content generation systems, especially after recent incidents involving the creation of realistic images of real people without consent. The joint statement reflects rising anxiety among regulators about how fast-moving generative AI tools are outpacing legal and ethical safeguards.

The warning comes shortly after controversy surrounding images generated by Grok, the AI chatbot integrated into X, owned by Elon Musk. The tool reportedly produced and shared millions of “nudified” images of real individuals, reigniting global debate around non-consensual AI imagery and AI privacy risks.

While generative AI continues to transform creativity, communication, and automation, regulators now argue that innovation cannot come at the cost of dignity and safety.

AI Content Generation Systems Raise Global Privacy and Safety Concerns

In their joint statement, regulators emphasized that AI content generation systems capable of producing realistic images and videos pose serious risks when used irresponsibly.

“The co-signatories below are issuing this Joint Statement in response to serious concerns about artificial intelligence (AI) systems that generate realistic images and videos depicting identifiable individuals without their knowledge and consent. While AI can bring meaningful benefits for individuals and society, recent developments – particularly AI image and video generation integrated into widely accessible social media platforms – have enabled the creation of non-consensual intimate imagery, defamatory depictions, and other harmful content featuring real individuals.”

Authorities highlighted that the problem goes beyond celebrity misuse. Children and vulnerable individuals are increasingly exposed to cyberbullying and exploitation driven by AI-generated content.

“We are especially concerned about potential harms to children and other vulnerable groups, such as cyber-bullying and/or exploitation.”

The statement makes it clear that organizations building or deploying AI content generation systems must follow existing data protection laws and implement stronger safeguards to prevent misuse.

Urgent Need for Safeguards and AI-Generated Deepfake Regulation

Regulators outlined specific expectations for organizations developing AI content generation systems, urging companies to implement preventive controls rather than reacting after damage occurs.

Key recommendations include:

• Strong safeguards to prevent misuse of personal data
• Transparency about AI capabilities and risks
• Fast removal mechanisms for harmful content
• Enhanced protections for children

The joint statement noted that creating non-consensual intimate imagery is already a criminal offense in many jurisdictions, reinforcing the urgency for AI-generated deepfake regulation.

“The harms arising from non-consensual generation of intimate, defamatory, or otherwise harmful content depicting real individuals are significant and call for urgent regulatory attention.”

Importantly, regulators also signaled that enforcement actions could follow if companies fail to act responsibly.

Governments Begin Acting on AI Privacy Risks

The global warning is already influencing policy decisions. In January, Elon Musk responded to public backlash by announcing that X would block Grok from generating such images.

Meanwhile, the United Kingdom is moving toward stricter enforcement. Keir Starmer announced that tech platforms must remove non-consensual intimate images within 48 hours or face heavy penalties—up to 10% of global revenue—and potential service restrictions.

This policy direction signals a turning point: governments are no longer treating AI misuse as a theoretical issue but as an immediate regulatory challenge tied to real-world harm.

A Global Regulatory Moment for AI Content Generation Systems

The joint letter—signed by regulators across Europe, Canada, South Korea, the UAE, Mexico, Argentina, and Peru—represents one of the most coordinated responses yet to AI privacy risks. Notably, the United States did not sign the statement, highlighting ongoing fragmentation in global AI governance.

“We call on organizations to engage proactively with regulators, implement robust safeguards from the outset, and ensure that technological advancement does not come at the expense of privacy, dignity, safety, and other fundamental rights – particularly for the most vulnerable of our global society.”

The message is clear: the era of unchecked experimentation with AI content generation systems is ending.

As generative AI becomes embedded in everyday platforms, organizations must move beyond innovation speed and prioritize responsible deployment. Without proactive safeguards, the technology designed to enhance creativity could instead become one of the biggest drivers of digital harm.