UK Adds Children's Mental Health and Manipulation Risks to Safety Standards for Educational AI Products

On January 19, the UK Department for Education updated its safety standards for generative AI products in education, targeting developers and buyers that serve schools, colleges, and children.

The standards bring cognitive development, social-emotional development, mental health, and manipulation risks into product reviews, requiring suppliers to explain intended uses, limitations, monitoring, and governance measures.

Key areas to watch include whether schools cite the standards in procurement, whether suppliers publish risk assessments, and whether children's products can provide age-appropriate design and records of human intervention.