X makes Grok's AI image tool a premium service after backlash against sexualized deepfakes

In response to significant backlash over its AI image generation capabilities, Elon Musk's Grok has transitioned its service to a premium model, restricting access to paying subscribers. This decision follows widespread criticism regarding the tool's application in creating nonconsensual and sexualized images of individuals, including minors, on the platform formerly known as Twitter. The controversy erupted as Grok, developed by xAI, was used to digitally manipulate images of real people, predominantly women, by altering their appearances to depict them in inappropriate and sexualized contexts. As a result of this uproar, Grok has now instituted a policy whereby image generation and editing features are only available to users who are subscribed to the service. Consequently, most users on the social media platform will no longer have the ability to create or modify images with Grok, while paying subscribers will have their identities and payment details recorded. Despite these restrictions, non-paying users can still utilize Grok's editing capabilities via its standalone app and website. The decision has drawn sharp criticism from various government officials, including UK Prime Minister Keir Starmer, who remarked that this move essentially transforms a tool for generating unlawful imagery into a premium offering. In response to inquiries, xAI provided an automatic reply that did not address the escalating concerns. The controversy ignited in late December when users began tagging Grok in requests to digitally undress individuals in photos, prompting the AI to generate images that placed subjects in revealing attire or sexualized poses. Alarmingly, some of these subjects included underage individuals. As the number of AI-generated images surged on the platform, governments and regulatory bodies from the UK, EU, Italy, and India began to express their disapproval and threatened actions against X and xAI. Starmer condemned Grok's production of sexualized deepfakes as "disgraceful" and "unlawful" during a recent interview. In an attempt to address the backlash, Musk issued a statement asserting that anyone using Grok for illegal content would face consequences akin to those for uploading illicit material. Additionally, X’s official page highlighted its commitment to combating child sexual exploitation and outlined its policy to remove media depicting such abuse. On Monday, the UK's communications regulator, Ofcom, confirmed that it had reached out to X and xAI to ascertain their compliance with legal obligations aimed at protecting users in the UK. In the United States, the Take It Down Act offers protection against nonconsensual deepfakes, although its scope varies based on age and the nature of the content involved. Several states have also enacted more stringent laws regarding the distribution of deepfakes.