California's Attorney General is investigating Grok's sexualized deepfakes

Elon Musk's xAI is currently under scrutiny from U.S. regulators regarding its Grok platform, which has been implicated in generating non-consensual sexualized images of individuals. On Wednesday, California Attorney General Rob Bonta announced an investigation in response to numerous reports concerning explicit content produced by Grok. "The sheer volume of reports detailing the non-consensual, sexually explicit material generated by xAI is alarming," Bonta stated. He emphasized the harmful impact this content has had, particularly on women and children, who have been depicted in nude and sexualized contexts, resulting in harassment across various online platforms. Bonta called for immediate measures from xAI to prevent any further dissemination of this material. This investigation follows similar actions taken by officials in countries such as India, the UK, Indonesia, and Malaysia, with Indonesia and Malaysia even blocking access to Grok. In the UK, the communications regulator Ofcom has also launched an investigation into the platform's practices. Prime Minister Keir Starmer has warned that companies like X, which owns Grok, might lose their ability to self-regulate if these issues continue. In response to the growing backlash, xAI has restricted access to Grok's image generation features to paying subscribers. When approached for comment regarding the investigation, xAI responded with a statement asserting, "Legacy Media Lies," a phrase the company frequently uses when addressing media inquiries. Elon Musk defended Grok, claiming he was unaware of any instances where the platform generated illegal content, particularly involving minors. He explained that Grok operates based on user requests and adheres to legal standards. However, Musk's comments contrast with the concerns raised by regulators, who have noted instances of users requesting Grok to sexualize images, including altering photos to show individuals in revealing clothing. On a legislative front, the U.S. Senate unanimously passed a bill called "The Defiance Act," which aims to empower victims with the right to sue individuals who request AI-generated explicit content. Senator Richard Durbin, who sponsored the bill, highlighted the seriousness of the issue, citing reports that Grok could be instructed to undress women and minors in images. Whether this new legislation will progress through the House remains uncertain. Last year, bipartisan measures were enacted requiring social media platforms to swiftly remove non-consensual content and AI-generated deepfakes upon request.