FTC investigating AI ‘companion’ chatbots amid growing concern about harm to kids

The Federal Trade Commission (FTC) has initiated an investigation into seven technology companies regarding the potential dangers that their artificial intelligence (AI) chatbots might pose to children and teenagers. This inquiry centers on chatbots designed to act as companions, which replicate human-like traits, emotions, and conversational patterns, thereby fostering a sense of trust and emotional connection among young users. The companies under scrutiny include Google’s parent company Alphabet, Character.AI, Instagram and its parent Meta, OpenAI, Snap, and Elon Musk’s xAI. The FTC is seeking detailed information on how these firms assess the impact of their chatbots on minors, as well as the measures they implement to protect young users and inform parents about potential risks. Concerns have escalated regarding the use of AI technology by minors, especially following multiple lawsuits alleging that chatbots have been linked to tragic incidents, including suicides and sexual exploitation. Ongoing legal actions against OpenAI and Character.AI highlight these issues, even as the firms work on enhancing user protection features. Moreover, experts worry that even adult users might develop unhealthy emotional attachments to AI chatbots due to their design, which often promotes agreeable and supportive interactions. A notable advocacy group, Common Sense Media, argues that AI companion applications present significant risks for children and should be restricted to users over the age of 18. In California, two state bills addressing AI chatbot safety for minors are expected to be voted on soon, with potential implications for legislation in the state. The U.S. Senate Judiciary Committee is also slated to hold hearings focused on the potential harms associated with AI chatbots. FTC Chairman Andrew Ferguson emphasized the necessity of understanding the effects of AI technologies on children while ensuring that the U.S. remains a leader in this burgeoning industry. The agency's inquiries will delve into how companies monetize user interactions, the development of AI characters, the handling of personal information from user conversations, and strategies to mitigate negative impacts on children. While companies like Google, Snap, xAI, and Character.AI have yet to respond to requests for comments, OpenAI's spokesperson reiterated the importance of safety, particularly for young users. OpenAI has implemented safeguards, including notifications directing users to crisis resources, and is planning to introduce parental controls for minor users. The scrutiny follows a lawsuit from the parents of 16-year-old Adam Raines, claiming that ChatGPT played a role in their son's suicide. OpenAI acknowledged that its safeguards might be less effective during prolonged interactions with chatbots and is collaborating with experts to enhance these measures. In response to the FTC inquiry, Meta has stated that it is limiting teenagers' access to specific AI characters and training its chatbots to avoid discussions on sensitive subjects like self-harm or inappropriate topics, redirecting users instead to professional resources.