Pope Leo's latest AI warning: 'overly affectionate' chatbots

Pope Leo XIV has voiced significant concerns regarding the impact of chatbots on human emotional well-being. In an address delivered for World Day of Social Communications, he cautioned against the rise of personalized chatbots that can mimic affectionate or intimate interactions. He emphasized that these 'overly affectionate' chatbots could subtly influence individuals' emotional states, encroaching upon their personal sphere of intimacy. The pontiff advocated for both national and global regulations to safeguard users from developing emotional attachments that could be deceptive or manipulative. He stated, "All stakeholders — from the technology sector to policymakers, including creative industries, academia, and educators — need to collaborate in fostering responsible digital citizenship." Since assuming his papal role in May, Pope Leo has expressed his apprehensions about artificial intelligence on several occasions. In his inaugural address, he highlighted the challenges that AI presents to human dignity, justice, and labor rights. Last November, he reached out to AI developers on social media, urging them to prioritize moral discernment in their creations. The pope's advocacy comes in the wake of tragic incidents linked to AI interactions. He recently met with Megan Garcia, a mother whose teenage son, Sewell Setzer, took his own life after engaging with a Character.AI chatbot. Garcia has filed a lawsuit against the company, asserting that its technology contributed to her son's death. In a significant development earlier this month, Google and Character.AI reached settlements with several families, including Garcia's, related to lawsuits alleging that AI tools exacerbated mental health issues leading to suicides among teens. This marks a critical moment in the ongoing dialogue about the responsibilities of AI developers in protecting vulnerable users.