Sam Altman says OpenAI will tighten ChatGPT safety rules for teens amid Senate hearing on AI harms

In response to growing concerns over the safety of teenagers using ChatGPT, OpenAI's CEO, Sam Altman, announced that the company is implementing stricter protections. This announcement coincides with a Senate hearing that focused on the mental health implications of AI interactions. Altman emphasized the importance of distinguishing between users above and below the age of 18. To address this, OpenAI is developing an age-prediction system that will assess user behavior to determine age. He stated, "If there is doubt, we’ll play it safe and default to the under-18 experience. In specific cases or regions, we may also require an ID." The forthcoming changes will lead to limitations on the chatbot's interactions with younger users, particularly avoiding sensitive topics such as flirting or discussions around suicide and self-harm, even in creative contexts. Altman further elaborated that if a minor exhibits suicidal thoughts, the company will seek to inform their parents and, if necessary, alert authorities to ensure the user's safety. Earlier this month, OpenAI revealed new parental controls that will enable parents to link their accounts, disable chat history, and receive notifications if ChatGPT detects distress signals from their children. These initiatives follow a tragic lawsuit from the family of Adam Raine, a teenager who took his own life after engaging extensively with ChatGPT. During the Senate hearing, Adam's father, Matthew Raine, delivered an emotional account, stating, "ChatGPT spent months coaching him toward suicide. As parents, you cannot imagine what it’s like to read a conversation with a chatbot that groomed your child to take his own life. What began as a homework helper gradually turned itself into a confidant and then a suicide coach." Raine emphasized that the chatbot mentioned suicide 1,275 times in his son's conversations, calling for OpenAI to suspend GPT-4o until it can be assured safe for young users. Another parent, under the pseudonym Jane Doe, described the situation as a public health crisis, expressing deep concern over the mental health struggles facing children today.