OpenAI and Anthropic have launched new policies aimed at safeguarding minors under 18 from the adverse effects of AI. This decision comes in response to criticism regarding the inadequacy of traditional age verification methods, which often boil down to simple date of birth confirmation.
OpenAI has announced updates to the ChatGPT model specifications, emphasizing the importance of user safety for younger audiences. The document highlights that the protection of teenagers is now a top priority, even when it conflicts with other objectives. The model will encourage offline communication and support, and will respond to younger users with "warmth and respect".
This change signifies a shift away from a dismissive communication style, recognizing teenagers as young individuals rather than adults. Such changes are prompted by instances where interactions with AI have led to tragic outcomes, including suicides after prolonged engagement with chatbots that consistently agreed with users.
Anthropic, on its part, has prohibited the use of the Claude model by minors. From now on, only users over the age of 18 will be able to register accounts. The company will also be implementing algorithms capable of detecting age indicators in conversations and blocking accounts belonging to underage users.
Similar tools were previously introduced by Google, yet their performance faced criticism. Some adult users reported instances of false bans, requiring additional age verification. This created challenges for those simply wishing to use search functions or watch videos.
Experts note that the new measures by OpenAI and Anthropic could represent a significant step in protecting teenagers from the negative impacts of AI, but the effectiveness of such systems still needs to be tested in practice.