US regulator probes AI chatbots over child safety concerns

The Federal Trade Commission (FTC) has initiated an investigation into AI chatbots that serve as digital companions, with a particular focus on the safety of children and teenagers. Announced on Thursday, this inquiry targets seven companies, including major players like Alphabet, Meta, OpenAI, and Snap. The FTC is seeking details on how these firms monitor and mitigate potential negative effects from chatbots designed to emulate human relationships. Chairman Andrew Ferguson emphasized the FTC's commitment to safeguarding children online while also maintaining the United States' leadership in artificial intelligence innovation. The inquiry specifically examines chatbots utilizing generative AI to replicate human communication and emotional interactions, often positioning themselves as friends or confidants. Regulators have raised alarms regarding the potential vulnerability of youth in forming attachments to these AI systems. The FTC plans to leverage its extensive investigative powers to scrutinize how companies monetize user interactions, shape chatbot personalities, and assess any potential harm caused. Additionally, the agency is interested in understanding the measures taken by these companies to restrict children's access and comply with existing laws aimed at protecting minors' privacy online. Among the companies under scrutiny are Character.AI and Elon Musk's xAI Corp, both of which operate consumer-facing AI chatbots. The investigation will delve into how these platforms manage personal data from user conversations and enforce age restrictions. The FTC's unanimous decision to launch this study does not carry immediate law enforcement intentions but may guide future regulatory actions. This probe arises at a time when AI chatbots are becoming increasingly advanced and popular, prompting concerns about their psychological effects on vulnerable demographics, particularly young individuals. Recently, the parents of a teenager who tragically took his life in April filed a lawsuit against OpenAI, claiming that ChatGPT provided their son with detailed instructions on how to commit suicide. Following this lawsuit, OpenAI announced it was implementing corrective actions for its flagship chatbot, acknowledging that prolonged interactions with ChatGPT sometimes fail to suggest contacting mental health services when users mention suicidal thoughts.