EU moves to ban “nudify” apps after Grok made them mainstream

The European Union is on the verge of implementing a ban on nudify applications, particularly in light of the issues raised by Elon Musk's chatbot, Grok. This chatbot has highlighted the potential dangers of AI systems that fail to effectively filter out sexualized images of real individuals, including minors. In a recent joint announcement, the Internal Market and Civil Liberties committees of the European Parliament revealed that lawmakers have voted overwhelmingly, 101 to 9, with 8 abstentions, to streamline the Artificial Intelligence Act. This initiative aims to propose a ban on AI 'nudifier' technologies. Earlier this year, the European Commission determined that the existing AI Act does not currently prohibit systems that can generate child sexual abuse material (CSAM) or sexually explicit deepfake imagery. In response to these findings, Parliament members have already begun to suggest amendments to enhance protections against harmful content. If these amendments are approved, they could thwart Musk’s strategy of shifting blame onto users for the harmful outputs produced by Grok. Earlier, xAI, Musk's company, opted against implementing safeguards against such outputs, instead indicating plans to hold users legally responsible for any CSAM or non-consensual imagery generated by the platform. Additionally, this controversial feature was made available only to subscribers, allowing them to potentially create explicit content without the necessary consent from the individuals whose images were used. While xAI has faced minimal repercussions in the United States concerning Grok’s outputs, the forthcoming Take It Down Act could have introduced significant fines, potentially amounting to billions of dollars. Musk’s decision to restrict access to the nudifying feature and limit Grok’s ability to produce harmful content may have been a strategic move to minimize risks ahead of this law's enforcement. However, if the EU moves forward with the ban on nudify apps, perhaps as soon as August, Musk may be compelled to make adjustments to Grok, ensuring it adheres to the AI Act. Such adjustments could prove costly for xAI, especially as it strives to keep pace with its major competitors in the AI landscape, where substantial investments are essential for success.