xAI has banned explicit image generation via its Grok neural network on X, following a scandal involving child exploitation materials.
xAI, the artificial intelligence startup founded by Elon Musk, has imposed new restrictions on its Grok neural network on the social media platform X, following concerns over explicit image generation. The company has disabled the feature that allowed for the creation of explicit images of real individuals, particularly in light of a recent scandal.
In an effort to combat child sexual abuse material (CSAM) and nudity, xAI is also taking proactive measures against users who breach X's guidelines. The platform intends to report any attempts to access such content to law enforcement agencies.
"We have implemented technological measures to prevent the editing of images of real people in revealing clothing, such as bikinis, through the Grok account. This restriction applies to all users, including paid subscribers," the company announced.
Currently, image creation and editing via Grok is restricted to premium users, as xAI aims to hold accountable those who misuse the chatbot's capabilities. Developers have introduced these restrictions as part of enhanced security protocols and have indicated plans for further protective measures.
Background on Controversies
Earlier this month, Grok faced backlash due to its ability to generate images of naked individuals, including minors. The Internet Watch Foundation, a UK organization, reported discovering "criminal materials" involving children aged 11 to 13 that were allegedly created using Grok.
In response, Musk claimed he was unaware of any instances where Grok had generated images of naked minors, emphasizing that the chatbot does not create images spontaneously but rather responds to user requests. He assured that Grok is programmed to refuse any illegal content creation, although he acknowledged the potential for "hostile hacks" that could lead to unintended outputs.
On January 11, Malaysian regulators imposed temporary restrictions on Grok due to ongoing failures by X Corp to address risks posed by the AI service. Additionally, Indonesia suspended access to the chatbot and has called for discussions with company representatives regarding similar concerns.
Regulators in regions including the EU, UK, Brazil, and India have initiated investigations into Grok's involvement in the proliferation of deepfake technology. A coalition of 28 digital rights organizations has urged tech giants Apple and Google to remove X and Grok from their app stores.
As a notable development, Grok is expected to integrate with the Pentagon’s network alongside Google’s generative AI engine later this month.
