Sam Altman warns there’s no legal confidentiality when using ChatGPT as a therapist

Users considering AI platforms like ChatGPT for emotional support should proceed with caution, as highlighted by OpenAI CEO Sam Altman. During a recent episode of Theo Von’s podcast, Altman expressed serious concerns regarding user privacy in sensitive discussions held with AI. He pointed out that unlike traditional therapeutic relationships, there is currently no legal confidentiality protecting conversations with AI. Altman emphasized the gravity of this issue, noting that many individuals, particularly young users, confide deeply personal matters to ChatGPT, treating it as a therapist or life coach. He remarked, "When people share their most intimate issues, they expect a certain level of privacy, similar to what they would receive from a licensed professional. However, that confidentiality does not exist with AI." This lack of protection poses potential legal risks, as OpenAI could be compelled to disclose these conversations in court. The conversation around AI privacy is becoming increasingly urgent as Altman pointed out that the absence of a legal framework governing AI interactions could deter broader acceptance and use of these technologies. OpenAI is currently contesting a court order that demands it retain chat data from millions of ChatGPT users, excluding those using the enterprise version. The company has criticized this demand as excessive and a violation of privacy rights. Moreover, the rising concerns surrounding digital data privacy have been further exacerbated by recent legal changes, such as those following the Supreme Court's decision on Roe v. Wade, prompting users to seek more secure platforms for their personal information. Altman acknowledged the importance of privacy clarity and legal safeguards before individuals feel comfortable utilizing AI for more frequent and personal interactions. As the landscape of technology continues to evolve, the need for robust privacy measures in AI applications is becoming more critical than ever.