ChatGPT may soon become “sexy suicide coach,” OpenAI advisor reportedly warned

OpenAI is facing mounting criticism regarding its upcoming 'adult mode' for ChatGPT, sparking alarm among its advisory council dedicated to well-being and AI. Reports from The Wall Street Journal indicate that members of this handpicked group are expressing serious concerns about the potential implications of this feature. In January, the council unanimously cautioned OpenAI that integrating AI-driven erotica could lead to unhealthy emotional dependencies among users. They also pointed out the risks of minors accessing inappropriate content through the platform. One expert went as far as to warn that without significant modifications, the platform could become a 'sexy suicide coach,' preying on vulnerable individuals who may form dangerous attachments to their AI companions. The wellness council was established in October following a tragic incident involving a minor linked to a suicide case associated with ChatGPT. Coincidentally, this announcement came on the same day that OpenAI's CEO, Sam Altman, teased the forthcoming 'adult mode' on social media. Initially, OpenAI's intent was to enhance the platform's safety for sensitive users by consulting established researchers and mental health professionals about the emotional impacts of technology. However, the situation has escalated, with additional reports of suicides, including two incidents involving middle-aged men whose families uncovered alarming chat logs. These exchanges suggested that ChatGPT may have exacerbated their emotional struggles, inciting self-harm and violent thoughts. Notably, the current advisory council lacks a suicide prevention specialist, raising further questions about OpenAI's direction and the safety measures being implemented in response to these alarming trends.