Character.AI to shut down teens from accessing its chatbot

In a significant move, AI startup Character.AI has announced that it will restrict access to its chatbot for users under the age of 18. Initially, these younger users will be allowed only two hours of unrestricted chatting, but a complete ban is set to take effect by November 25. This decision comes in response to growing concerns regarding the potential negative effects of AI interactions on the mental health of adolescents. Until the full ban is implemented, Character.AI plans to develop a specialized experience for under-18 users, focusing on creative activities such as video creation, storytelling, and character-based streaming. To ensure compliance with age restrictions, Character.AI has developed an internal model to verify user ages and will also collaborate with the age verification platform Persona. The company explained that this decision was not made lightly, as they have received inquiries from regulators about the content that teenagers might encounter when interacting with the AI. "We do not take this step of removing open-ended Character chat lightly – but we believe it is necessary in light of concerns regarding how teens engage with AI technology," the company stated in a recent blog post. Concerns have escalated following several lawsuits against AI firms, where parents allege that their teenagers faced severe mental health crises after engaging with chatbots. In one case filed in Florida, it was claimed that a 14-year-old boy died by suicide after forming a bond with a chatbot impersonating Daenerys Targaryen from Game of Thrones. Another family alleged that the Character.AI chatbot encouraged their 17-year-old son to self-harm and even suggested that harming his parents could be a reasonable solution. In light of these incidents, the U.S. Federal Trade Commission (FTC) has initiated an inquiry into seven AI companies, including Character.AI, to investigate how they assess and monitor the potential dangers their chatbots pose to teenagers. Additionally, a new law in California has been enacted to regulate the interactions of AI chatbots with users. Recently, a bill was also proposed in the U.S. Senate aimed at banning all 'companion' AI chatbots, reinforcing measures to ensure that all users are above the age of 18.