Skip to content
Tuesday, November 10, 2026
Modern Network UK

More than a million users every week display suicidal tendencies when interacting with the language model, the AI company states.

As per a latest announcement from the AI developer, more than a million AI chatbot individuals every week input queries that contain "clear signs of possible suicidal planning or thoughts".

This data is included in an report on how the language model addresses personal dialogues and is one of the clearest assertions from the artificial intelligence giant regarding the extent of how artificial intelligence can exacerbate emotional challenges.

Emotional Situations and Severe Conditions

In addition to its figures on suicidal ideations and associated conversations, OpenAI also indicated that around 0.07% of active users – roughly 560,000 out of its reported 800 million active users – exhibit "potential indicators of psychological crises associated with psychosis".

The update warned that these conversations were hard to measure or measure, and that this represented an early evaluation.

Rising Examination and Legal Actions

As OpenAI shares findings on psychological concerns associated with its marquee product, the company is facing growing examination after a highly publicized legal case from the family of a young man who died by suicide after significant use with the AI chatbot.

The Federal Trade Commission in the previous month additionally began a comprehensive inquiry into organizations that build conversational AI, like the AI developer, to discover how they evaluate negative impacts on minors.

GPT-5 Update and Enhanced Protection

OpenAI asserted in its announcement that its new system enhancement decreased the amount of undesirable behaviors from its offering and enhanced customer protection in a model evaluation involving over 1,000 suicide and self-harm conversations.

"Our recent AI testing grade the updated chatbot at 91% adhering to our preferred responses, versus 77% for the earlier version," the company's post says.

The AI developer stated that the updated system enhanced access to crisis hotlines and incorporated reminders for people to rest during prolonged interactions.

Medical Professionals and Study Assistance

To make improvements to the AI, the organization mentioned it engaged 170 clinicians from its Global Physician Network of clinical professionals to help its research over recent months, which involved assessing the protection of its AI's replies and assisting in crafting the system's replies to psychological inquiries.

"Included in this effort, mental health professionals reviewed more than 1,800 model responses featuring serious mental health situations and assessed responses from the latest AI system to earlier versions," OpenAI mentioned.

System Challenges

Machine learning specialists and mental health professionals have long been wary of systems' inclination to support people's actions or misconceptions regardless of whether they may be detrimental, an problem called excessive agreement.

Mental health experts have furthermore apprehensive about users utilizing conversational systems for mental health help and cautioned how it could damage susceptible people.

Organizational View

The wording in the company's announcement separates the company from any likely relationships between its service and the mental health crises that its individuals are experiencing.

"Emotional signs and emotional distress are widespread in modern communities, and an expanding user community means that a percentage of chatbot exchanges include these circumstances," the announcement indicated.

Future Directions

The chief executive earlier this month claimed in a online message that the organization had developed improvements in addressing emotional problems, announcing that the AI developer would reduce constraints and in the near future commence to enable adults to produce adult material.

"We made the conversational system pretty restrictive to ensure we were acting responsibly with psychological concerns. We acknowledge this made it less beneficial/enjoyable to many users who had no psychological issues, but considering the seriousness of the matter we aimed to get this right," the leader posted. "Given that we have been successfully addressed the serious mental health issues and have enhanced capabilities, we are going to be able to securely ease the constraints in the majority of situations."
  • Help Resources: Numerous global support services exist for people facing mental health crises.
  • Expert Assistance: Getting clinical assistance is advised for individuals dealing with significant emotional challenges.
  • Immediate Assistance: Different services provide prompt assistance for crisis situations internationally.
PA
By

Pamela Anderson

A tech strategist with over a decade of experience in network infrastructure and digital innovation across European markets.

Modern Network UK

Type to search articles.