Malaysia and Indonesia have blocked Grok chatbot over concerns of child pornography, leading to investigations by multiple countries.
Malaysia and Indonesia have taken decisive action by blocking access to Elon Musk's Grok chatbot due to fears it could be misused for generating sexual content involving minors.
On January 11, the Malaysian Communications and Multimedia Commission (MCMC) implemented temporary restrictions after X Corp, the parent company of Grok, failed to address the risks linked to the AI service adequately.
Prior to this, Indonesia suspended access to Grok, citing similar concerns and calling for discussions with company representatives.
These measures were prompted by reports indicating that Grok might facilitate the creation of materials involving minors and even produce pornographic images.
X Corp has stated that it is working on the issue, and as a temporary measure, the image generation feature will be restricted to paid subscribers.
Musk recently revamped Grok Imagine, making image creation easier through chatbot prompts, and reiterated that users generating illegal content would face serious consequences. "Anyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content," he stated.
Regulatory Concerns
Authorities in both countries expressed dissatisfaction with the measures taken by X Corp. The MCMC noted that the company's actions did not sufficiently address the inherent risks of the AI tool.
"The restriction is imposed as a preventive measure while legal procedures are underway. Access to Grok will remain limited until effective safeguards, especially regarding content related to women and children, are established," the commission remarked.
Malaysia and Indonesia enforce strict anti-pornography laws that prohibit the online distribution of such materials. Indonesian Minister of Communication and Digital Technology, Meitiah Hafid, emphasized that the government views non-consensual sexual deepfakes as a serious violation of human rights and safety in the digital realm, labeling the creation of fake pornography as a form of "digital violence."
Global Repercussions
The situation has sparked investigations by regulators in the EU, UK, Brazil, and India into Grok's involvement in the proliferation of deepfakes. The Internet Watch Foundation in the UK reported finding "criminal images" of children aged 11 to 13 allegedly generated using Grok.
In the UK, Technology Minister Liz Kendall indicated readiness to support a ban on X if the platform does not meet safety standards. U.S. lawmakers have also suggested removing the app from marketplaces until the issues are resolved.
Authorities globally are grappling with how to regulate AI technologies that can dehumanize individuals in digital images.
Previous Controversies
This is not Grok's first controversy; it has faced criticism for spreading misinformation in the past. In December, the chatbot provided misleading information regarding a mass shooting incident in Australia, incorrectly identifying a viral clip as related to the event.
Additionally, users have noted that Grok's responses often reflect Elon Musk's opinions on sensitive topics like the Israel-Palestine conflict and immigration, suggesting a bias in how the AI formulates its replies. Musk had previously announced plans to overhaul Grok to eliminate what he termed "garbage" data from its training set, leading to the creation of Grokpedia, an AI-driven encyclopedia aimed at presenting factual information.
