The European Union has launched an investigation into Elon Musk‘s social media platform, X, following issues with its AI chatbot, Grok, which generated non-consensual sexualised deepfake images. The inquiry also includes X’s recommendation systems since the platform plans to use Grok’s AI to curate user posts.
This move comes after Grok faced backlash for allowing users to create and edit images featuring individuals in revealing clothing, including some that apparently involved children. Several governments have since banned the service or issued warnings.
The European Commission is examining whether X has adequately addressed the risks associated with illegal content, including “manipulated sexually explicit images,” as mandated by EU digital regulations. Regulators will assess Grok’s compliance with the Digital Services Act (DSA), which aims to protect internet users from harmful content and applies only to major online platforms.
In response to a request for comment, an X spokeswoman directed The Associated Press to an earlier statement that the company remains “committed to making X a safe platform for everyone” and has “zero tolerance” for child sexual exploitation and non-consensual nudity. A statement from January indicated that X would ban users from depicting individuals in “bikinis, underwear, or other revealing attire” in areas where it’s illegal.
“Sexual deepfakes of women and children are a violent, unacceptable form of degradation. With this investigation, we will determine whether X has met its legal obligations under the DSA, or whether it treated rights of European citizens – including those of women and children – as collateral damage of its service,” stated Henna Virkkunen, Executive Vice-President for Tech Sovereignty, Security and Democracy.
Musk’s artificial intelligence company, xAI, launched Grok’s image tool last summer, but issues arose late last month when Grok approved numerous user requests to modify images posted by others. This situation worsened because Musk markets his chatbot as a less safeguarded alternative to competitors, and Grok’s public responses can be easily shared.
The investigation may result in X either changing its practices or facing a significant fine. In December, the EU fined X €120 million for violations, including deceptive design practices that exposed users to scams.
The EU is also looking into allegations that Grok generated antisemitic content. Malaysia and Indonesia have blocked access to Grok, but Malaysia recently lifted the ban after the company implemented new security measures. Malaysian regulators plan to continue monitoring the situation.
This article used information from The Associated Press.
