How a 'nudify' site turned a group of friends into key figures in a fight against AI-generated porn

In June 2022, Jessica Guistolise's life took a dramatic turn when she received a shocking text from an acquaintance revealing that her estranged husband, Ben, had been creating deepfake pornography using images of over 80 women, all sourced from social media. The conversation, which lasted nearly two hours, left Guistolise feeling overwhelmed and frantic. The images were created using a site called DeepSwap, part of a troubling trend of 'nudify' websites that have surged in popularity alongside advancements in generative AI. Upon returning to Minneapolis, Guistolise was confronted with manipulated images featuring her own likeness, including one from a family vacation and another from her goddaughter's graduation. This disturbing revelation marked the beginning of a relentless fight against the misuse of AI technology. Guistolise, alongside other victims like Molly Kelley, a law student, began navigating the complex legal landscape surrounding AI-generated content. The women soon discovered the grim reality: Ben's actions, while morally reprehensible, were not necessarily illegal as the deepfakes had not been distributed publicly. This loophole in the law left them feeling powerless, prompting them to advocate for stronger regulations to address the misuse of AI tools. Kelley noted, "He did not break any laws that we're aware of, and that is problematic." The rise of nudify apps reflects a disturbing aspect of the AI boom, with tools like DeepSwap being easily accessible to anyone, regardless of technical expertise. Guistolise and her peers expressed concern that as this technology becomes more widespread, many more individuals could find themselves victimized. In their quest for justice, the group sought the help of Minnesota State Senator Erin Maye Quade, who had previously sponsored legislation aimed at criminalizing nonconsensual deepfake dissemination. In response to their stories, Maye Quade proposed a new bill that would hold AI companies accountable for facilitating the creation of such harmful content. While the legislation would impose significant fines on companies generating nonconsensual deepfakes, enforcing the law against foreign-based entities remains a challenge. Maye Quade highlighted the need for a federal approach to adequately address the issue. As these women continue to grapple with the emotional fallout from their experiences, they are also determined to raise awareness about the potential dangers of AI misuse. Guistolise emphasized the importance of public understanding, stating, "It's really accessible and really easy to do, and it really needs to stop." The fight against AI-generated exploitation is far from over, but these advocates are committed to bringing about change and ensuring that such technology is not weaponized against individuals.