Sam Altman talks about ChatGPT for young people in a blog post

OpenAI wants to better protect teenage users of ChatGPT, CEO Sam Altman announced in a blog post. In contrast to adults, the AI chatbot should not, for example, help with the writing of texts depicting suicide under any circumstances—even if these are exclusively fictional stories.

After a boy from California committed suicide, his parents blamed OpenAI and sued the company. The chat logs revealed, among other things, that ChatGPT had allegedly offered to write a suicide note to the 16-year-old. However, to better protect young people, ChatGPT needs to know their age: A system for estimating age is currently being developed, Altman writes, without giving further details. How this system is supposed to work and how reliably it can estimate the age of users remains open. In case of doubt, however, the system always assumes a young person.

“Treat our adult users like adults”

When it comes to data protection, OpenAI wants to make an exception in extreme cases. Conversations in which people entrust the most personal things to ChatGPT daily must be treated confidentially, writes Altman. Nevertheless, there are automated systems that report serious abuses or warn of critical risks and dangers. If human lives are in danger or social damage such as massive cybersecurity incidents is to be feared, such suspicions should be escalated to humans for review. OpenAI then tries to contact parents or authorities, for example.

Altman, on the other hand, does not want to restrict adult users. Although the AI does not provide them with instructions on suicide, it can still provide tips for an imaginary story that deals with suicide as a topic on request. Altman emphasizes that OpenAI is aware that no solution is perfect. These are difficult decisions that have been made after consultation with experts.

In Germany, you can find help and support for problems of all kinds, including questions about bullying and suicide, at telefonseelsorge.de and by calling 0800 1110111. The number against grief (children's and youth helpline) is 116 111. In Austria, there are also free help services, including the children's helpline on 0800 567 567 and Rat auf Draht on 147, especially for children. The same telephone number in Switzerland leads to Pro Juventute.

(aki)