AI tutoring can safely and effectively support students: An exploratory RCT in UK classrooms
This paper reports an exploratory RCT with 165 UK secondary school students evaluating LearnLM, a pedagogically fine-tuned AI tutor supervised by human experts, comparing its effectiveness to human-only tutoring for mathematics learning on the Eedi platform. Students receiving LearnLM support demonstrated equal or better learning outcomes, including superior knowledge transfer to novel problems.
One-to-one tutoring is widely considered the gold standard for personalized education, yet it remains prohibitively expensive to scale. To evaluate whether generative AI might help expand access to this resource, we conducted an exploratory randomized controlled trial (RCT) with $N = 165$ students across five UK secondary schools. We integrated LearnLM -- a generative AI model fine-tuned for pedagogy -- into chat-based tutoring sessions on the Eedi mathematics platform. In the RCT, expert tutors