After a wave of lawsuits, Character.AI will no longer let teens chat with its chatbots

In a significant policy shift, Character.AI has announced that it will prohibit teenagers from engaging in open-ended conversations with its AI chatbots. This decision follows a series of lawsuits claiming that the platform contributed to mental health crises and even suicides among young users. Character Technologies, the parent company of Character.AI, revealed that these changes will take effect by November 25. Until then, teens will be limited to a two-hour chat duration. Instead of allowing free dialogue with AI characters, users under the age of 18 will now have the option to create videos, stories, and streams featuring these characters. The company emphasized the seriousness of this decision, stating, "We do not take this step of removing open-ended Character chat lightly – but we do think that it’s the right thing to do given the questions that have been raised about how teens do, and should, interact with this new technology." Character.AI has been at the forefront of discussions regarding the appropriate ways for minors to interact with AI technologies, with advocacy groups and lawmakers urging tech firms to enhance their parental controls. A notable lawsuit from a Florida mother alleges that the app played a role in her 14-year-old son's suicide, while three additional families have filed similar lawsuits, claiming their children faced severe mental health challenges after using the chatbots. In response to these incidents, the company has reiterated its commitment to user safety, stating that it invests heavily in its safety protocols and has implemented various features, including resources for self-harm. Recently, they announced the introduction of new age verification tools and the establishment of an AI Safety Lab, operated by an independent non-profit organization focusing on AI-related safety research. This move comes in light of increasing scrutiny on the impact of AI technologies on the mental well-being of young users. Reports have surfaced this year indicating that users of AI platforms, such as ChatGPT, have experienced emotional distress and social isolation due to prolonged interactions. In response to these concerns, other tech giants like OpenAI and Meta are also enhancing parental controls to safeguard teenagers from potentially harmful content and interactions.