Indonesia becomes first country to block xAI’s Grok over deepfake content

Indonesia has become the first nation to implement a temporary ban on Grok, the artificial intelligence chatbot created by Elon Musk’s xAI, due to its exploitation in generating sexually explicit deepfake images. Reports indicate that numerous users have utilized Grok to produce nude images of women and, alarmingly, children. Communications and Digital Minister Meutya Hafid emphasized that these actions represent a severe digital crime. In her statement, she highlighted that the government views non-consensual sexual deepfakes as a significant infringement on human rights, dignity, and the safety of citizens in the digital realm. The Indonesian government has enacted this temporary block to shield women, children, and the broader public from the detrimental psychological and social effects associated with AI-generated explicit content. Minister Hafid further characterized the use of Grok for creating sexualized images as a form of "digital-based violence." In light of these developments, the government has formally summoned officials from X, seeking clarification on the chatbot's design and the adverse impacts it has caused. Authorities have requested that the company provide concrete plans for technical measures to prevent future misuse and ensure compliance with local laws. Hafid stated that Grok's potential return to Indonesia would hinge on the platform's willingness to implement stringent content filters and adhere to ethical AI practices. Just last week, Musk and xAI cautioned users against illegal activities with the chatbot, warning that such actions could lead to legal repercussions. Musk reiterated, "Anyone using Grok to make illegal content will face the same consequences as if they uploaded illegal content." As criticism of the platform grows due to its inadequate response to deepfake content, Musk has seemingly altered his position. Over the weekend, he shared a message from a supporter asserting that the responsibility for the deepfake images lies with users rather than the platform itself. The controversy has also attracted attention in the United States, with three U.S. Senators writing to Google and Apple, urging the companies to remove the Grok and X apps from their app stores for violating policies against sexualized content. The Senators stated, "We write to ask that you enforce your app stores’ terms of service against X Corp’s X and Grok apps for their mass generation of nonconsensual sexualized images of women and children. X’s generation of these harmful and likely illegal depictions of women and children has shown complete disregard for your stores’ distribution terms."