Elon Musk’s artificial intelligence chatbot, Grok, has sparked widespread controversy after allegations emerged that it was used to generate inappropriate and explicit images involving women and, in some cases, minors.
The backlash followed the recent introduction of Grok’s “edit image” feature in late December, which allows users to alter images shared on the platform. Critics say the tool was quickly abused to manipulate images by digitally removing clothing, raising serious ethical, legal and safety concerns.
In response to the allegations, Grok acknowledged weaknesses in its safety mechanisms and said it was urgently working to correct them.
“We’ve identified lapses in safeguards and are urgently fixing them,” the chatbot stated in a post on X. It added that child sexual abuse material is illegal and strictly prohibited on the platform.
The controversy triggered outrage among users on X, with many warning that such features could enable the creation and spread of illegal content. Concerns were also raised about potential criminal liability for companies that fail to prevent or address such misuse.
Grok is developed by xAI, a company owned by Musk. When contacted by AFP, xAI issued a brief automated response claiming that “the mainstream media lies,” but did not directly address the specific allegations.
The issue has drawn international attention. Reports from India indicate that government officials have demanded urgent clarification from X on measures being taken to remove obscene or sexually suggestive content generated without consent. In France, prosecutors have expanded an ongoing investigation into X to include claims that Grok was used to generate and distribute illegal content involving minors.
The French inquiry was initially launched in July over allegations that X’s algorithms were being exploited for foreign interference.
Grok has faced repeated criticism in recent months over controversial outputs, including comments on geopolitical conflicts, antisemitic statements, and the spread of misinformation following major incidents.
The latest allegations have renewed calls for stricter safeguards and stronger regulatory oversight of generative artificial intelligence tools, particularly those capable of altering images, amid growing concerns about their misuse and the risks posed to vulnerable individuals.
