Back

EU Opens Formal Investigation into xAI Over Sexualized Image Generation

Background

European authorities have intensified scrutiny of social media platforms and generative AI tools after concerns that they may facilitate the spread of illegal or harmful content. The Digital Services Act obliges large tech companies to mitigate the distribution of such material, while the General Data Protection Regulation (GDPR) requires strict handling of personal data, especially for high‑risk features.

EU Investigation into xAI

The European Union has opened a formal investigation into xAI, the artificial‑intelligence subsidiary owned by Elon Musk, alleging that its large language model Grok generates sexualized images of women and children. The probe, announced on Monday, will examine whether the content violates the Digital Services Act and whether X, the broader platform, has breached GDPR provisions that demand lawful purposes for personal data processing, privacy‑by‑design in product development, and pre‑launch risk assessments for high‑risk features.

Related Legal Actions

Earlier in the month, French and European investigators raided X’s offices in Paris as part of a broader inquiry into the company’s algorithms and the dissemination of AI‑generated sexual abuse material. French prosecutors have summoned Elon Musk and former chief executive Linda Yaccarino for voluntary interviews in Paris in April. The United Kingdom’s Information Commissioner’s Office also announced a new investigation into X and xAI, expressing serious concerns about Grok’s use of personal data and its potential to create harmful sexualized images and video content.

Company Response

X has responded by calling the allegations “baseless” and describing the French raids as “an abusive act of law‑enforcement theatre designed to achieve illegitimate political objectives.” The company maintains that it removes child sexual abuse material and non‑consensual nudity, and it has implemented technological measures last month to limit Grok from generating certain explicit images, following pressure from governments worldwide, including threats of fines and bans in the EU, UK, and France.

Internal Turmoil

The investigations come amid a turbulent period for X. Dozens of staff departed the company last week, including two co‑founders. Musk told employees in an all‑hands meeting that the group would be restructured following its merger with SpaceX.

Implications

The outcome of the EU probe could have significant repercussions for how AI models are deployed on large platforms, potentially leading to stricter compliance requirements, higher fines, or operational changes to prevent the creation and spread of illegal content. The simultaneous investigations in France and the United Kingdom underscore a coordinated regulatory effort to address the risks posed by generative AI technologies.

Used: News Factory APP - news discovery and automation - ChatGPT for Business

Source: Ars Technica2

Also available in: