Indonesia and Malaysia block Grok over non-consensual, sexualized deepfakes

Authorities in Indonesia and Malaysia have initiated a temporary ban on access to xAI's chatbot, Grok, in a significant response to the proliferation of non-consensual, sexualized deepfakes. These AI-generated images have frequently implicated real women and minors, sometimes even showcasing violent content. This action marks one of the most decisive moves by government officials to combat the surge of such harmful digital content, which has been circulating on the social platform X, owned by the same parent company as xAI. In a statement released to various media outlets, including the Guardian, Indonesia’s Communications and Digital Minister Meutya Hafid condemned the creation and distribution of non-consensual sexual deepfakes. She highlighted it as a grave infringement on human rights and the dignity of individuals within the digital realm. The Indonesian ministry has also summoned officials from X to address these concerns directly. The Malaysian government followed suit, announcing a similar ban just a day later, reflecting a growing regional discontent with the misuse of AI technology. This comes amidst varied international responses, including a directive from India's IT ministry demanding that xAI take measures to curb Grok's production of inappropriate content. Furthermore, the European Commission has ordered the company to preserve all related documents, potentially paving the way for a formal investigation. In the U.K., the communications regulator Ofcom has indicated it will conduct a rapid evaluation to identify any compliance issues that could necessitate further scrutiny. Prime Minister Keir Starmer has expressed his full support for Ofcom's initiative. Meanwhile, in the United States, while the Trump administration has remained silent—possibly due to xAI CEO Elon Musk's connections to Trump—Democratic senators have urged Apple and Google to remove X from their app stores. In response to the controversy, xAI initially issued an apology via the Grok account, admitting a post had breached ethical guidelines and possibly U.S. laws regarding child sexual abuse material. The company has since limited the AI image-generation feature to paid subscribers on X, although this restriction did not extend to the Grok app, which continues to permit image generation for all users. In reaction to inquiries about the lack of action against other AI image generation platforms in the U.K., Musk remarked that there seems to be a desire for censorship under the guise of regulation.