klicksafe brochure: My Child and AI. Growing up with artificial closeness

Uncritical and always available: klicksafe explains why AI chatbots and companions can be dangerous for young people on Safer Internet Day.

listen Print view

(Image: klicksafe)

4 min. read

AI chatbots and companions appear empathetic and omniscient because they are trained to do so. The fact that children and adolescents in particular can develop unhealthy relationships with them is addressed in a new brochure from klicksafe and Nummer gegen Kummer. It was published a few days before this year's Safer Internet Day (February 10th) and thus underpins the campaign theme “Growing up with artificial closeness” with in-depth information material and recommendations for action.

The brochure titled “My Child and AI: Growing up with Artificial Closeness” is aimed at parents, but can also be used as a guide in educational institutions for young children. For teachers from secondary level I, klicksafe, in cooperation with the Freiwillige Selbstkontrolle Multimedia-Diensteanbieter (FSM), released teaching materials titled “AI and Me. How Artificial Intelligence Shapes Our Lives” just a few days earlier, which goes into even greater depth.

The parent brochure explains what AI chatbots and companions are and in what way they can pose a danger. AI chatbots such as ChatGPT (OpenAI) or Gemini (Google) are therefore systems that “are intended to simulate human conversations – in writing or orally. They answer questions and provide tips and advice for all situations in life.” AI companions also simulate human conversations, “but are more focused on relationship, emotional feedback, and continuous interaction with users.” Among other things, they take on the roles of well-known game or film characters. Providers of such companions or tools for creating your own companions include, for example, Character.AI, nomi.AI, or Replika.

Videos by heise

Meanwhile, both AI chatbots and companions have become so sophisticated that they can provide answers “that appear very natural and human-like,” explains the brochure. They are now also capable of “interpreting the emotional states of users and reacting to them.” This appears human-like. In addition, they are always available – “regardless of time, mood, or energy,” and the answers are “tailored to the person, confirming, usually friendly, unbiased, and patient.” Parents may take note at this point: Always have time and patience for critical conversations? Always be patient and affirming? This is precisely the sticking point: The fact that caregivers cannot always be available and supportive for children and adolescents could lead them to turn more to the uncritical bots and companions. Those who grow up this way might find real social contacts “more strenuous in comparison” because they are more conflict-ridden and not simply clickable. Ultimately, there is a risk that for some people, real relationships may take a back seat or even be partially replaced by AI interactions.

However, klicksafe and Nummer gegen Kummer do not advise in the brochure that children and adolescents should not use any AI chatbots or companions at all, but rather recommend open discussion and observation by parents. Caregivers and other significant adults should talk to the children about how chatbots and companions work, what they can and cannot do; they should inform themselves and also try out bots and companions. Subsequently, rules for use should be discussed with the young people, and youth protection settings should be made. In addition, data protection must be addressed. AI companions advertise themselves as being like a best friend to whom you can confide everything, but precisely this could lead to the disclosure of particularly sensitive data.

nomi.ai promises "Zero Judgement". It states, for example: "Talking to an AI is a great way to explore your personal interests without fear of judgment, rejection, or burdening others." Klicksage, on the other hand, warns that people should be careful about sharing their most intimate data. In addition, a stable social network should also be built or sought outside the virtual world.

(Image: nomi.ai)

(kbe)

Don't miss any news – follow us on Facebook, LinkedIn or Mastodon.

This article was originally published in German. It was translated with technical assistance and editorially reviewed before publication.