Robin. How should measure AI-supported learning outcomes be done in practice?. 2026-09-21.
Learning outcomes should separate completion, immediate performance, mastery, independent work, delayed retention, and transfer. A Zhuji speaking-and-listening project reports reach across 16 schools, 92 classes, and more than 4,000 students together with organizer-reported stage gains, reinforcing the need to report usage, comparison conditions, attrition, and subgroup differences together.
https://edu.hhhh.life/en/guide/ai-learning-outcome-measurement/#answer
11direct citations
10source organizations
2026-09-06evidence through
READ THIS FIRST
Three judgments to remember
01
Use an outcome ladder to separate completion from learning
02
Measure actual use and human support together
03
Delayed and transfer tasks test durability
ACTION PLAN
What to do
Work through five steps in order, preserving process records and the linked evidence. Return to an earlier step when conditions change.
01
Define the problem and boundary
Build a six-level outcome ladder from participation through cross-context transfer.
Is measure AI-supported learning outcomes tied to an observable task, covered population, and prohibited-use boundary?
OECD Warns That Better AI-Assisted Task Performance Does Not Necessarily Mean Real Learning · OpenAI Releases Learning-Outcome Measurement Tools, Shifting Evaluation Toward Reasoning and Mastery · EU and OECD Release a Primary and Secondary AI Literacy Framework Defining 19 Competencies · Study: Chinese students' homework scores rise but exam scores fall after using generative AI
□
Are owners, human review, data handling, incident reporting, and appeals explicit?
Study in Tennessee Finds Low Usage of AI Tutor Khanmigo Among Middle Schoolers · Tutor CoPilot Gives Human Tutors Real-Time AI Suggestions, with Larger Improvements Among Lower-Rated Tutors · Google Lets Teachers Assign Constrained AI Activities and View Insights into Student Learning Processes · Zhuji AI English Listening and Speaking Practice Selected as 2026 Smart Education Excellent Case
□
Do results include independent performance, sustained use, workload, safety events, and group differences?
EduClaw-Bench Places AI Tutors in a Continuous 30-Day Simulated Learning Relationship · Google and Khan Academy Co-Develop Writing Coach, Using Gemini for Feedback During the Writing Process · Teachers and Students Need to Know Which Parts of Learning Should Not Use AI
□
Do continue, adjust, pause, and exit decisions each have a threshold, date, and owner?
OECD Warns That Better AI-Assisted Task Performance Does Not Necessarily Mean Real Learning · EduClaw-Bench Places AI Tutors in a Continuous 30-Day Simulated Learning Relationship
CURRENT ANSWER
How we answer today
Each judgment links to the relevant news and original sources. New evidence enters the corresponding dimension.
01
Use an outcome ladder to separate completion from learning
Evidence synthesis and new measurement tools separate answer quality, reasoning, mastery, and durable capability.
Khanmigo, Tutor CoPilot, and the Zhuji regional case show that access, sustained use, teacher support, and reach definitions all change outcome interpretation.
These limits determine how strong a conclusion the page can support.
01
These steps are editorial recommendations informed by public sources. The full workflow has not been validated as an intervention; adapt it to local curricula, age, and resources.
02
Product features, coverage, and participation establish an implementation entry; learning effects require independent tasks, delayed measures, and disaggregated results.
RELATED QUESTIONS
What else do readers ask?
Each adjacent search question receives a concise answer linked to its supporting evidence.
01
Where should the measure AI-supported learning outcomes workflow begin?
+
Build a six-level outcome ladder from participation through cross-context transfer.
How should human responsibility and safety boundaries be preserved?
+
Khanmigo, Tutor CoPilot, and the Zhuji regional case show that access, sustained use, teacher support, and reach definitions all change outcome interpretation. Each step should name an owner, review point, data boundary, and appeal route.
Recently, the practice of AI-empowered English listening and speaking teaching in Zhuji, submitted by the Zhuji Education Research Center, was selected for the public list of '2026 Smart Education Excellent Cases'. The case uses AI listening and speaking classrooms, now in regular use in 16 schools, covering 92 classes, 58 English teachers, and over 4,000 students. The project adopts a mechanism of pilot verification, scale-up, and dynamic optimization, and has established a tiered training system.
A study tracking about 27,000 students aged 12-18 in China for 30 months found that after adopting generative AI, homework scores rose by 18% while time per assignment fell from 64 to 45 minutes. However, in monthly closed-book exams without AI, scores dropped by 20% within six months, and high-stakes entrance exam performance also declined. The research was conducted by scholars from Stockholm University and the University of Hong Kong.
A two-year study in Tennessee randomly assigned low-performing students from 18 middle schools to use Khan Academy with AI tutor Khanmigo. Students used Khanmigo on only about a third of learning days, often sending off-topic messages or trying to get answers. Khan Academy students showed faster math gains, but researchers say benefits were not from AI. Khan Academy has redesigned its interface to better integrate Khanmigo.
EduClaw-Bench was submitted to arXiv on August 4. It uses a knowledge-tracing model trained on real student data to construct simulated learners, allowing AI tutors to interact continuously through an LMS for 30 days.
On August 4, Tech & Learning discussed learning contexts in which teachers and students should avoid AI. The criterion is the purpose of the task: when the practice itself is meant to build foundational ability, personal expression, or independent judgment, handing it directly to AI weakens the learning process.
On June 25, Google announced teacher-facing updates that will let Classroom teachers assign AI activities including Guided Learning, Study Notebook, and NotebookLM.
On June 18, the European Commission and OECD released the AILit framework for primary and secondary AI literacy, setting out four interconnected domains and 19 competencies with examples for primary and secondary education.
On March 4, OpenAI announced a set of tools for measuring learning outcomes, disclosed early research on Study Mode, and said it planned to continue validation through randomized trials.
On January 21, Google and Khan Academy announced a partnership to enhance Khan Academy's Writing Coach with Gemini models. The product is focused on guidance and feedback during the writing process.
On January 19, the OECD released the 247-page Digital Education Outlook 2026. The report reviews research evidence on generative AI in education and discusses education-specific models, teacher capabilities, and government governance.
In live K–12 mathematics tutoring, Tutor CoPilot suggests guiding questions, hints, and conceptual scaffolds to human tutors. A Stanford research summary reports that the randomized trial involved more than 700 tutors and more than 1,000 students.
Stanford SCALEEducators / Schools
KEEP READING
Continue reading
Enter through an adjacent search question or return to a long-term topic for its full evidence base.
