Robin. How should assess education AI safety risk be done in practice?. 2026-09-21.
Safety risk assessment should identify affected people, data, error, manipulation, psychological, deepfake, assessment, and cybersecurity risks for each use case and judge likelihood, impact, and current controls.
https://edu.hhhh.life/en/guide/ai-safety-risk-assessment/#answer
13direct citations
13source organizations
2026-09-10evidence through
READ THIS FIRST
Three judgments to remember
01
Identify multiple harms from the real use case
02
Controls span technology, process, and people
03
Residual risk determines whether use proceeds
ACTION PLAN
What to do
Work through five steps in order, preserving process records and the linked evidence. Return to an earlier step when conditions change.
01
Define the problem and boundary
Map users, data, model, output, human decisions, and external connections for each use case.
Is assess education AI safety risk tied to an observable task, covered population, and prohibited-use boundary?
UK Adds Children's Mental Health and Manipulation Risks to Safety Standards for Educational AI Products · Two National Guides Define the Boundary Between 'Learning About AI' and 'Using Generative AI Independently' · Massachusetts Directs Schools to Investigate Harmful Student Deepfakes and Defines a Victim-Support Process · 35 New Mexico Lawmakers Urge Education Department to Add Independent Testing and Parental Consent for Amira AI Literacy Tool · AI-Generated Text Enters Elementary Reading Classrooms as Researchers Flag Three Risks · New South Wales Limits Take-Home HSC Assessments to Address AI Use · UNESCO IITE Releases Global Study on AI and ICT for Inclusive Education of Students with Autism, ADHD and Learning Difficulties
□
Are owners, human review, data handling, incident reporting, and appeals explicit?
UK Expands Generative AI Data Guidance for Schools, Clarifying Personal Information, Bias, and Supplier Risks · SchoolAI Updates District-Level Capabilities with Unified Guardrails, Alert Routing, and Class Mastery · World Digital Education Alliance Releases Two Standards Covering the Full Educational AI Life Cycle and Smart Campuses
□
Do results include independent performance, sustained use, workload, safety events, and group differences?
UK Exams Regulator Continues to Ban AI-Only Scoring While Allowing Validated Supporting Uses · Teacher Generative AI Guidelines State That AI Grading Cannot Directly Serve as the Final Evaluation of Open-Ended Work · Ireland Establishes a Standing Advisory Group on AI in Schools, Initially Focusing on Exams and Assessment
□
Do continue, adjust, pause, and exit decisions each have a threshold, date, and owner?
UK Adds Children's Mental Health and Manipulation Risks to Safety Standards for Educational AI Products · UK Exams Regulator Continues to Ban AI-Only Scoring While Allowing Validated Supporting Uses
CURRENT ANSWER
How we answer today
Each judgment links to the relevant news and original sources. New evidence enters the corresponding dimension.
01
Identify multiple harms from the real use case
Child safety, age-based use, and deepfake guidance cover content, manipulation, psychological harm, privacy, and victim protection. New risks span early-age voice data, distorted reading text, assessment authenticity, and dignity for learners with disabilities. Each needs a control, owner, and appeal route.
These limits determine how strong a conclusion the page can support.
01
These steps are editorial recommendations informed by public sources. The full workflow has not been validated as an intervention; adapt it to local curricula, age, and resources.
02
Product features, coverage, and participation establish an implementation entry; learning effects require independent tasks, delayed measures, and disaggregated results.
RELATED QUESTIONS
What else do readers ask?
Each adjacent search question receives a concise answer linked to its supporting evidence.
01
Where should the assess education AI safety risk workflow begin?
+
Map users, data, model, output, human decisions, and external connections for each use case.
How should human responsibility and safety boundaries be preserved?
+
Data guidance, district alerts, and lifecycle standards support approval, permissions, monitoring, reporting, and response. Each step should name an owner, review point, data boundary, and appeal route.
A bipartisan group of 35 New Mexico state lawmakers sent a letter on Aug. 25 to Public Education Department Secretary Mariana Padilla, calling for greater transparency and additional independent testing to evaluate how accurately Amira, an AI literacy testing tool, measures students' reading proficiency. The tool has been required statewide for K-2 students since the 2025-26 school year, with students reading aloud to a digital avatar. Lawmakers said Amira has collected thousands of student voice recordings and has access to names, genders, birthdays, locations and other sensitive information, and asked that parental consent be required before children use the tool.
Education Week reports that AI-generated text has entered elementary school classrooms alongside classroom library books and early reading curricula. Tools for educators can rewrite articles to different reading levels or generate decodable text. Jean Gunderson, a Title I reading interventionist in South Dakota, said AI can write stories and comprehension questions in minutes, a task that used to take hours, but she must prompt precisely and sort through all output. Researchers flagged three risks: AI's middle-ground tone, tools struggling to hit requested grade levels, and weak alignment with academic standards and curricula.
The New South Wales government released new rules on 1 September 2026 limiting schools to a maximum of one take-home assessment task worth no more than 15 per cent of the school-based assessment mark, or 7.5 per cent of the total HSC mark. The advice from the NSW Education Standards Authority applies to the Class of 2027 beginning HSC studies in Term 4 this year and to students starting Year 11 in Term 1, 2027. HSC major works and some courses including creative arts, technologies and English Extension 2 are exempt, but schools must still authenticate students' work.
UNESCO IITE published a 2026 global study on the role of artificial intelligence and information and communication technologies in supporting inclusive education for students with autism, ADHD and learning difficulties. The research examines how digital technologies enhance participation and learning within digitized education systems, using literature review, expert interviews and case studies. The report is authored by May Agius with contributors including Alperen Sağdıç, David Banes and Jingying Chen, and is available for download in English.
SchoolAI announced its 2026–2027 product updates, extending the focus from individual teachers creating Spaces to unified district governance. Updates include district-level guardrails, school context, alert routing, Smart Groups, and a Class Mastery Score.
On July 16, Ofqual updated its approach to regulating AI in qualifications, continuing to prohibit AI as the sole scorer while allowing validated supporting and quality-assurance uses.
On July 9, the UK Department for Education updated its generative AI data-protection guidance for schools, requiring them to address risks involving personal data, bias, suppliers, and child protection.
On May 12, the World Digital Education Alliance released two AI education standards, respectively specifying full-life-cycle requirements for AI application systems in education and infrastructure for AI-enabled smart campuses.
Ministry of Education conference outcomesSchools / Product Teams
On April 15, the Massachusetts government issued guidance for schools responding to deepfake incidents, requiring them to investigate AI-generated intimate images and videos involving students.
On April 7, the Irish government announced an external advisory working group on AI in schools as an ongoing, multi-stakeholder governance mechanism to study AI's effects on teaching, learning, and assessment.
On January 19, the UK Department for Education updated its safety standards for generative AI products in education, targeting developers and buyers that serve schools, colleges, and children.
UK Department for Education standardsSchools / Product Teams
In December 2025, the Expert Steering Committee for Teacher Workforce Development under China's Ministry of Education released the Guidelines for Teachers' Use of Generative Artificial Intelligence (Version 1), covering learning, teaching, student development, evaluation, administration, and research.
Guidelines for Teachers' Use of Generative Artificial IntelligenceSchools / Educators
In May 2025, the Basic Education Teaching Steering Committee under China's Ministry of Education released the Guidelines for General Artificial Intelligence Education in Primary and Secondary Schools (2025 Edition) and the Guidelines for the Use of Generative Artificial Intelligence by Primary and Secondary School Students (2025 Edition). The former defines curriculum progression, while the latter governs generative AI use by students, teachers, schools, and education authorities.
Guidelines for General AI Education and Generative AI Use in Primary and Secondary SchoolsSchools / Educators
KEEP READING
Continue reading
Enter through an adjacent search question or return to a long-term topic for its full evidence base.
