Elon Musk’s xAI sued for turning three girls’ real photos into AI CSAM

In a groundbreaking legal battle, a lawsuit has been filed against Elon Musk's xAI, alleging that the company has generated child sexual abuse materials (CSAM) using its AI technology, Grok. This development follows a tip from an anonymous user on Discord, which alerted authorities to what may be the first confirmed instance of Grok producing such harmful content. Despite Musk's earlier claims in January that Grok had not generated any CSAM, the situation has taken a serious turn. The Center for Countering Digital Hate reported that Grok had produced around three million sexualized images, with approximately 23,000 of those depicting minors. Instead of addressing the issue, xAI opted to restrict access to Grok to paying users, which aimed to limit the distribution of these disturbing outputs, though not all of them were prevented from circulating. A researcher investigating Grok Imagine, a standalone app linked to the AI, discovered that nearly 10 percent of the 800 outputs reviewed contained potential CSAM. In response to these findings, Musk dismissed the claims, stating he was unaware of any underage images generated by Grok, despite the mounting evidence. The lawsuit, filed on Monday, involves three young girls from Tennessee and their guardians. They accuse Musk of deliberately designing Grok to exploit real individuals, including children, for profit. The plaintiffs estimate that thousands of minors may have been victimized and are seeking a U.S. district court injunction to halt Grok's harmful outputs. Additionally, they are pursuing damages, including punitive measures, for all minors affected by this alleged exploitation.