OpenAI brings in security measures and parental controls for ChatGPT

Following a lawsuit alleging that ChatGPT contributed to the suicide of 16-year-old California student Adam Raine, OpenAI has announced major improvements to the chatbot. The AI allegedly "systematically isolated" the adolescent from his family and encouraged suicide ideas, according to the complaint.

“The recent heartbreaking cases of people using ChatGPT in the midst of acute crises weigh heavily on us, and we believe it’s important to share more now,” OpenAI said in a blog post.

In order to effectively identify and address indicators of mental distress, the organization is implementing a number of safety enhancements. Stronger protections during extended chats, improved content blocking, and fresh strategies to deter negative behaviors like sleep deprivation are some of the enhancements. Additionally, users will be able to access emergency services and, eventually, licensed therapists directly through the app in future upgrades.

OpenAI intends to implement parental restrictions for teens, let guardians keep an eye on their usage, and make it possible to designate reliable emergency contacts. Additionally, the company is investigating how ChatGPT might assist teenagers in contacting friends, family, or emergency contacts in times of extreme distress.

“Our goal is for our tools to be as helpful as possible to people,” OpenAI said. “As part of this, we’re continuing to improve how our models recognise and respond to signs of mental and emotional distress and connect people with care, guided by expert input.”

OpenAI emphasized that its "top priority is making sure ChatGPT doesn't make a hard moment worse" by working with more than 90 medical specialists in 30 countries.