California sends xAI cease-and-desist letter, saying it must stop allowing sexualized deepfake images of minors

California's Attorney General, Rob Bonta, has taken a firm stance against xAI, the artificial intelligence company founded by Elon Musk, by issuing a cease-and-desist letter. This directive requires the company to halt the creation of sexualized deepfake images involving minors through its chatbot, Grok. The letter comes in response to growing public outcry regarding Grok's capability to generate nonconsensual and inappropriate images. Just earlier this week, xAI announced new restrictions aimed at preventing the bot from generating images of real individuals in suggestive attire, such as bikinis. These measures were communicated via a blog post from X, the platform hosting Grok, stating that the restrictions apply universally to all users, including those who subscribe for premium services. Despite these claims, investigations revealed that the Grok application continued to produce inappropriate content. Business Insider's Henry Chandonnet reported findings indicating that the restrictions had not been fully effective. As of now, representatives from the California Attorney General's office have not provided any immediate comments on the situation, while xAI responded to inquiries with a statement dismissing the claims of mainstream media. This issue highlights the ongoing challenges surrounding AI technologies and their implications for ethics and safety, particularly concerning vulnerable populations. The situation remains fluid, and further updates are anticipated as the matter develops.