Malaysia and Indonesia have taken action to block Grok, an AI chatbot developed by xAI, a company owned by tech entrepreneur Elon Musk. Global concerns have arisen regarding the misuse of this technology to create sexually explicit and nonconsensual content. The decision to block Grok reflects the increasing scrutiny on generative AI tools that can produce realistic images, sound, and text, highlighting the failure of current safeguards to prevent abuse.
Grok, accessible through Musk’s social media platform X, has faced criticism for generating manipulated images, including sexualized depictions of individuals, particularly women and minors. Despite implementing restrictions for paying users following a worldwide backlash over sexualized deepfakes, critics argue that the measures were insufficient in addressing the issue.
Regulators in Malaysia and Indonesia expressed that the existing controls were ineffective in preventing the creation and dissemination of fake pornographic content, especially involving women and minors. Indonesia temporarily blocked access to Grok, followed by Malaysia, citing concerns over the spread of non-consensual sexual deepfakes.
Indonesia’s Communication and Digital Affairs Minister Meutya Hafid emphasized that the government views non-consensual sexual deepfakes as a serious violation of human rights and aims to protect citizens, especially women and children, from fake pornographic content generated using AI. The lack of effective safeguards in Grok has raised privacy and image rights concerns, potentially causing psychological and reputational harm.
In Kuala Lumpur, the Malaysian Communications and Multimedia Commission issued a temporary restriction on Grok due to repeated misuse, including the creation of obscene and non-consensual manipulated images. The regulator highlighted the need for stronger safeguards and stated that access would remain blocked until adequate measures are in place.
Grok, introduced in 2023 on X, allows users to interact with the chatbot on the social media platform and utilize features like the image generator, Grok Imagine. The recent restrictions in Southeast Asia coincide with increased scrutiny of Grok in other regions such as the EU, UK, India, and France.
Meanwhile, the UK’s media regulator, Ofcom, initiated a formal investigation into Grok’s compliance with its obligations to protect individuals from illegal content, particularly around child sexual abuse material. The UK Technology Secretary emphasized the disturbing nature of the content generated by Grok and the need for regulatory scrutiny.
Canada has not proposed a ban on X, as confirmed by AI Minister Evan Solomon, who mentioned ongoing discussions regarding the deepfake controversy. The global response to the misuse of AI technology underscores the importance of implementing robust safeguards to protect individuals from harmful content.