Instruction Partners Releases 16 Deep Dives on AI Learning Tools, Warns of General Chatbot Risks

Education consulting nonprofit Instruction Partners released a large-scale evaluation of AI-powered learning tools, including 16 deep dives into individual products, covering 20 tools and 16 school systems, with interviews of teachers, students, district and building leaders, and product developers. The analysis found the biggest risks from general-purpose chatbots, which students may use to avoid effortful thinking, while purpose-built instructional tools showed more promise but none was ready to do the pedagogical job independently.

Schools have long lacked comparable information on instructional quality when purchasing AI tools, and this evaluation gives district leaders a reference beyond marketing language. It directly affects school procurement decisions and classroom use, and signals to product developers that they need to clarify the division of labor between AI and teachers. The evaluation covers only 20 tools, and organizations such as EdReports have not yet published reviews of individual AI tools' instructional quality, so the industry representativeness of the findings remains to be expanded. Districts and schools can use the product profiles' instructional capabilities and limitations to inform AI tool procurement, reducing the risk of deciding solely on marketing materials. AI education product developers need to address issues identified in the evaluation, such as general chatbots reducing students' effortful thinking and tools lowering reading material difficulty.