Braindead safety theatre or a self-harm safety net? Internet divided over ChatGPT’s “Trusted Contact” feature

OpenAI has begun rolling out a new safety feature for ChatGPT that allows adult users to nominate someone they know, who may be notified if the system detects signs of serious self harm risk, the company said.

The optional feature expands on existing parental controls for younger users and is now available to those over 18 (or 19 in some countries).

Users can designate one trusted adult – such as a friend, family member or carer – through their settings. The nominated person must accept the invite within a week before the feature becomes active.

How ChatGPT’s new “Trusted Safety” feature works

According to an OpenAI blog published on Thursday, if the chatbot's automated systems identify language that may indicate a serious safety concern, the user is informed that their Trusted Contact could be notified and is encouraged to reach out directly.

OpenAI says that the case may then be reviewed by a small team of trained human staff. If reviewers determine the risk credible, a brief alert is sent to the allotted contact via email, text or in-app notification.

Sam Altman’s AI-maker adds that the alert does not include chat transcripts but does provide a general explanation and guidance on how to respond.

According to OpenAI, the system has been developed in collaboration with clinicians, researchers and organizations including the American Psychological Association.

The rollout follows a series of lawsuits filed by families alleging that chatbot interactions have contributed to self-harm.

OpenAI has previously disputed claims that its systems encourage harmful behavior, but has faced increasing scrutiny over AI safety practices.

At least some of the reaction on social media acknowledged its intent to make good.

As one Reddit poster wrote on the strand: /r/ChatGPTcomplaints, that, if done right, it might help some adults get the help they need.

“I don’t hate this. Part of being an adult is knowing when you need help and calling on people you trust. Of course the real test will be in how OAI actually implements this feature"

Reddit poster, on /r/ChatGPTcomplaints

Despite its best efforts, however, the first wave of discussion on social media was largely critical of the new safety feature, voicing concerns about privacy and implementation.

A widely-shared thread on X argued that privacy includes who interprets users’ mental states, escalates concerns, and shares sensitive information with untrained third parties.

“Clearly, the source of control here is the platform. OpenAI controls detection, interpretation, whether a case is escalated to human review, whether a third party is notified. But the person who may actually have to face the user’s crisis could be a friend or family member with no professional training at all," Ivywen wrote on X.

The same poster also warned of the “single-contact problem”, noting that in some cases the nominated contact could be part of a coercive or unsafe relationship, which could expose vulnerable users to further harm rather than support.

Responding to the same thread, poster @cicaptn added that the feature was little more than political safety posturing.

“More braindead safety theater for a problem that never existed in the first place.”

@cicaptn, X

As an expansion of parental controls, a Reddit user wondered whether it would be of any actual help to adults.

“It’s great for parental control, but useless for adults. I don't believe people who are truly struggling will leave any contact info. Usually, those who need help the most are the ones who stay silent about their problems.”

Reddit poster

OpenAI said users can remove or change their Trusted Contact at any time, and that contacts can opt out. The company added that notifications are designed to be limited in scope to balance safety with user privacy.

Unlock more exclusive Cybernews content on YouTube.