AI Tutors

EduEval is a comprehensive hierarchical benchmark for evaluating LLMs in Chinese K-12 education, comprising 24 task types with over 11,000 questions organized across six cognitive dimensions (Memorization, Understanding, Application, Reasoning, Creativity, and Ethics) based on Bloom's Taxonomy and Webb's Depth of Knowledge. The benchmark incorporates authentic educational materials including real exam questions, classroom dialogues, student essays, and expert-designed prompts spanning primary through high school levels.

This paper presents LearnLM-Tutor, a fine-tuned Gemini model for education, and introduces a comprehensive evaluation framework consisting of seven diverse benchmarks (quantitative, qualitative, automatic, and human evaluations) grounded in learning science principles to assess pedagogical capabilities of AI tutoring systems. The work includes real-world deployment at Arizona State University's Study Hall and demonstrates that LearnLM-Tutor is consistently preferred by educators and learners over prompt-tuned Gemini across multiple pedagogical dimensions.

This paper reports an exploratory RCT with 165 UK secondary school students evaluating LearnLM, a pedagogically fine-tuned AI tutor supervised by human experts, comparing its effectiveness to human-only tutoring for mathematics learning on the Eedi platform. Students receiving LearnLM support demonstrated equal or better learning outcomes, including superior knowledge transfer to novel problems.

TutorBench is a benchmark dataset of 1,490 expert-curated samples evaluating LLMs' tutoring capabilities across three core tasks: generating adaptive explanations, providing actionable feedback, and creating effective hints for high-school and AP-level curricula. The benchmark uses sample-specific rubrics and LLM-judge evaluation to assess 16 frontier models, finding none achieve above 56% overall performance.

This paper presents PhysicsAssistant, a multimodal LLM-powered robot designed to assist 8th-grade students during physics lab experiments by combining YOLOv8 object detection with GPT-3.5-turbo for natural language interaction. The study evaluates the system through a user study with 10 students, comparing its performance against GPT-4 and human expert ratings using Bloom's taxonomy.

This paper describes the design and classroom evaluation of an LLM-based instructional module that teaches K-12 students prompting literacy through scenario-based practice with AI chatbots, including an AI auto-grader for evaluating student-written prompts. The study deployed the module across 11 secondary education classrooms in two iterations, measuring students' prompting performance improvements, confidence changes, and the effectiveness of different assessment question types.

This paper empirically evaluates the limitations of LLM-based tutoring systems for K-12 education by comparing a deep knowledge tracing (DKT) model against a widely-used LLM (with and without fine-tuning) on learner knowledge assessment accuracy, reliability, and temporal coherence using large-scale student interaction data. The study demonstrates that specialized learner modelling approaches substantially outperform LLMs in predicting student performance and maintaining consistent knowledge state estimates over time.

FoundationalASSIST is a K-12 educational dataset of 1.7M student interactions with full question text, actual student responses, and Common Core alignment, designed to evaluate LLMs on knowledge tracing (predicting student performance and exact answers) and pedagogical grounding (understanding properties that make assessment items effective). The paper demonstrates that current frontier LLMs struggle significantly on both task families, performing barely above trivial baselines on knowledge tracing and below random chance on item discrimination.

This paper presents Bridge, a method that translates expert math educators' decision-making processes into a model for LLMs to remediate student math mistakes. The authors construct and publish a dataset of 700 real K-12 tutoring conversations (grades 1-5) annotated with expert decisions and conduct human evaluations comparing expert, novice, and LLM responses to student errors.

This paper presents MWPTutor, an LLM-based tutoring system that combines GPT-4 with finite state transducers to provide pedagogically-structured tutoring for math word problems, with guardrails to prevent answer leakage and maintain desired teaching strategies. The system is evaluated through human assessment comparing it to unstructured GPT-4 tutoring on two math word problem datasets.

MathVC is an LLM-simulated multi-persona virtual classroom platform designed to facilitate collaborative problem-solving in middle school mathematics through simulated peer interactions with diverse mathematical thinking and intentional misconceptions. The paper evaluates the system with 14 U.S. middle-schoolers, measuring engagement, motivation, confidence, and collaborative learning outcomes.

This paper presents a Socratic chatbot built by fine-tuning and prompt-tuning small open-source LLMs (Llama2 7B/13B) to foster critical thinking through questioning rather than direct answers, validated through simulated student-chatbot interactions that measure reflection and critical thinking development.

This paper investigates how pedagogical instructions facilitate scaffolding in LLM-based intelligent tutoring systems through a case study of guiding children to describe images for language learning. The authors construct different tutoring systems grounded in four learning theories and develop a seven-dimension rubric to evaluate the scaffolding process, including both manual and automated evaluation approaches.

This paper presents Physics-STAR, an LLM-powered tutoring system for high school physics education, and evaluates it through a controlled experiment with 12 sophomore students, comparing it against traditional teacher-led lectures and generic LLM tutoring. The study measures learning outcomes (conceptual, computational, and informational problem scores) and efficiency, finding significant improvements especially on complex information problems (100% score increase, 5.95% efficiency gain).

Mentigo is an AI agent system designed to mentor middle school students through the Creative Problem Solving (CPS) process, providing structured guidance, adaptive feedback, and Socratic questioning. The system was evaluated through a comparative experiment with 12 students and reviewed by five expert teachers, demonstrating improvements in student engagement and creative outcomes.

This paper presents a classroom study with 9-10 year old Swedish children evaluating an LLM-enabled spherical visualization platform that allows natural language questions about Earth-related datasets with coordinated verbal and visual responses. The study examines children's expectations, engagement patterns, and post-interaction evaluations through structured observation and group discussions in a formal educational setting.

This paper develops a pedagogical framework for LLM-driven feedback generation in programming education and evaluates it through a mixed-methods study with eight secondary-school computer science teachers using a web-based Python programming application. The study assesses whether LLM-generated feedback aligned with pedagogical principles (mastery adaptation, progress adaptation) can match or exceed human teacher feedback quality.

This mixed-methods study examines 109 Greek secondary students' (age 16) attitudes, anxiety, and responses to hallucinated outputs when using ChatGPT-5 in classroom settings across multiple tasks. The research measures cognitive and behavioral attitudes toward AI, AI-related anxiety, and documents students' 'epistemic safeguarding' strategy of restricting AI use to domains where they can verify outputs after encountering hallucinations.

This paper describes the design and pilot evaluation of RockStartIT Tutor, a GPT-4-powered AI tutoring assistant for a secondary school programming course that uses structured prompts and a modular knowledge base to provide curriculum-constrained, pedagogically controlled support. The system was evaluated using the Technology Acceptance Model with 13 students and teachers, focusing on usability, learning support quality, and pedagogical appropriateness.

This case study evaluates ChatGPT as a substitute teacher for 11th-grade chemistry students in the UAE, comparing learning outcomes between experimental (ChatGPT) and control (traditional teacher) groups across Bloom's taxonomy cognitive domains. The study found that students in the control group performed significantly better (15% vs 7.5% good/outstanding ratings) and that ChatGPT faced challenges with student engagement and completion rates.

EduEval is a comprehensive hierarchical benchmark for evaluating LLMs in Chinese K-12 education, comprising 24 task types with over 11,000 questions organized across six cognitive dimensions (Memorization, Understanding, Application, Reasoning, Creativity, and Ethics) based on Bloom's Taxonomy and Webb's Depth of Knowledge. The benchmark incorporates authentic educational materials including real exam questions, classroom dialogues, student essays, and expert-designed prompts spanning primary through high school levels.

This paper presents LearnLM-Tutor, a fine-tuned Gemini model for education, and introduces a comprehensive evaluation framework consisting of seven diverse benchmarks (quantitative, qualitative, automatic, and human evaluations) grounded in learning science principles to assess pedagogical capabilities of AI tutoring systems. The work includes real-world deployment at Arizona State University's Study Hall and demonstrates that LearnLM-Tutor is consistently preferred by educators and learners over prompt-tuned Gemini across multiple pedagogical dimensions.

TutorBench is a benchmark dataset of 1,490 expert-curated samples evaluating LLMs' tutoring capabilities across three core tasks: generating adaptive explanations, providing actionable feedback, and creating effective hints for high-school and AP-level curricula. The benchmark uses sample-specific rubrics and LLM-judge evaluation to assess 16 frontier models, finding none achieve above 56% overall performance.

This paper describes the design and classroom evaluation of an LLM-based instructional module that teaches K-12 students prompting literacy through scenario-based practice with AI chatbots, including an AI auto-grader for evaluating student-written prompts. The study deployed the module across 11 secondary education classrooms in two iterations, measuring students' prompting performance improvements, confidence changes, and the effectiveness of different assessment question types.

This paper develops a pedagogical framework for LLM-driven feedback generation in programming education and evaluates it through a mixed-methods study with eight secondary-school computer science teachers using a web-based Python programming application. The study assesses whether LLM-generated feedback aligned with pedagogical principles (mastery adaptation, progress adaptation) can match or exceed human teacher feedback quality.

EducationQ is a multi-agent dialogue framework that evaluates LLMs' teaching capabilities through simulated teacher-student interactions, testing 14 LLMs across 1,498 questions spanning 13 disciplines and 10 difficulty levels. The framework incorporates formative assessment principles to measure pedagogical effectiveness including questioning strategies, adaptive feedback, and scaffolding behaviors.

EduGuardBench is a dual-component benchmark that evaluates LLMs as simulated teachers by measuring both professional fidelity (using Role-playing Fidelity Score to detect pedagogical harms like incompetence, indolence, and offensiveness) and adversarial safety (using persona-based jailbreak prompts to test vulnerability to harmful requests including academic misconduct). The benchmark tests 14 leading models and is publicly available with automated evaluation code.

This paper evaluates ChatGPT's ability to solve decimal problems, grade student self-explanation responses, and generate instructional feedback within the Decimal Point learning game, using over 5,000 real student responses from middle school students. The study finds ChatGPT can accurately assess 75% of student answers and generate high-quality feedback, though it struggles with specific decimal place value problems.

This paper presents a framework for finetuning LLMs to generate grade-appropriate educational content across six grade levels (lower elementary to adult), evaluated through readability metrics and human studies with 208 participants. The work addresses the challenge of making AI tutoring systems produce content matched to students' comprehension levels across K-12 grades.

This paper presents the BEA 2025 Shared Task which evaluates pedagogical abilities of AI tutors (powered by LLMs) in educational dialogues, specifically assessing mistake identification, guidance provision, and feedback actionability in math tutoring contexts. The benchmark includes five evaluation tracks with publicly released datasets and annotation guidelines, achieving macro F1 scores ranging from 58.34 to 71.81 across pedagogical dimensions.

This paper critically reviews evaluation practices for GenAI-powered Intelligent Tutoring Systems (ITSs), highlighting the lack of reliable, pedagogy-driven evaluation frameworks and benchmarks. It analyzes existing challenges through case studies and proposes three research directions for developing fair, unified, and scalable ITS evaluation methodologies grounded in learning science principles.

This paper introduces GuideEval, a benchmark for evaluating LLMs' ability to provide adaptive Socratic tutoring by assessing their capacity to perceive learner states, orchestrate instructional strategies, and elicit appropriate reflections based on authentic educational dialogues. The benchmark specifically measures whether LLMs can dynamically adjust pedagogical guidance in response to learners' cognitive states (confusion, comprehension, errors) rather than merely generating questions.

This paper introduces PedagogicalRL-Thinking, a reinforcement learning framework that trains LLM tutors by applying pedagogical rewards to both visible responses and internal reasoning traces, using domain-specific educational theory (Polya's problem-solving framework) to guide the model's thinking process. The approach is evaluated on mathematics tutoring dialogues with metrics measuring solution correctness, answer leakage prevention, and pedagogical helpfulness.

EduAlign is a framework that uses reinforcement learning to align large language models with three pedagogical principles: Helpfulness, Personalization, and Creativity (HPC). The authors develop HPC-RM, a multi-dimensional reward model trained on 8k annotated educational interactions, and use it to fine-tune an LLM via Group Relative Policy Optimization, demonstrating improved pedagogical alignment in AI tutoring responses.

This study evaluates the impact of Generative AI on writing skills of elementary school students in Indonesia, comparing experimental groups using Generative AI with control groups in language education across two schools, measuring improvements in completeness, structure, and creativity of student writing.

This paper evaluates multiple ChatGPT models (3.5 Turbo through o1-preview) as math tutors for college algebra using two approaches: problem-solving accuracy assessment via an intelligent tutoring system testbed, and interactive tutoring quality evaluation via human evaluators acting as students. The study finds that while LLMs achieve 85.5% correct final answers and 90% high-quality instructional support, only 56.6% of tutoring dialogues are entirely error-free, concluding that LLMs require human oversight for math tutoring.

This paper develops a method to learn tutor-specific personas for LLM-based tutors by using preference optimization to create steering vectors from human tutoring dialogues, enabling control over tutoring style (e.g., scaffolding level, affective support, instructional directiveness) without explicit prompting. The approach is evaluated on real math tutoring dialogues, showing improved alignment with individual tutor behaviors while maintaining pedagogical quality.

This paper presents CLASS, a design framework for building Intelligent Tutoring Systems using Large Language Models, and SPOCK, a proof-of-concept ITS for college-level biology that provides step-by-step guidance and conversational tutoring interactions grounded in learning science principles like scaffolding and socio-constructivist learning.

This paper proposes a reinforcement learning framework using direct preference optimization (DPO) to generate and evaluate automated feedback for incorrect student answers in math education, using GPT-4 annotations to train smaller models like Llama 2 to produce pedagogically valid feedback that explains misconceptions and encourages students.

This paper evaluates the effectiveness of LLMs (GPT-4o, Llama-3-8B) as teachers generating pedagogical hints for simulated student LLMs solving high-school mathematics problems designed using cognitive science principles. The study measures hint quality, error correction rates, and compares different prompting strategies across temperature settings.

EduEval is a comprehensive hierarchical benchmark for evaluating LLMs in Chinese K-12 education, comprising 24 task types with over 11,000 questions organized across six cognitive dimensions (Memorization, Understanding, Application, Reasoning, Creativity, and Ethics) based on Bloom's Taxonomy and Webb's Depth of Knowledge. The benchmark incorporates authentic educational materials including real exam questions, classroom dialogues, student essays, and expert-designed prompts spanning primary through high school levels.

This paper presents LearnLM-Tutor, a fine-tuned Gemini model for education, and introduces a comprehensive evaluation framework consisting of seven diverse benchmarks (quantitative, qualitative, automatic, and human evaluations) grounded in learning science principles to assess pedagogical capabilities of AI tutoring systems. The work includes real-world deployment at Arizona State University's Study Hall and demonstrates that LearnLM-Tutor is consistently preferred by educators and learners over prompt-tuned Gemini across multiple pedagogical dimensions.

TutorBench is a benchmark dataset of 1,490 expert-curated samples evaluating LLMs' tutoring capabilities across three core tasks: generating adaptive explanations, providing actionable feedback, and creating effective hints for high-school and AP-level curricula. The benchmark uses sample-specific rubrics and LLM-judge evaluation to assess 16 frontier models, finding none achieve above 56% overall performance.

This paper introduces AMMORE, a dataset of 53,000 middle-school math open-response question-answer pairs from an African WhatsApp-based tutoring platform, and evaluates LLM-based approaches (including chain-of-thought prompting) for automated grading of challenging student answers. The study demonstrates that LLM grading improves overall accuracy from 98.7% to 99.9% and significantly reduces misclassification of student mastery status in a Bayesian Knowledge Tracing model.

FoundationalASSIST is a K-12 educational dataset of 1.7M student interactions with full question text, actual student responses, and Common Core alignment, designed to evaluate LLMs on knowledge tracing (predicting student performance and exact answers) and pedagogical grounding (understanding properties that make assessment items effective). The paper demonstrates that current frontier LLMs struggle significantly on both task families, performing barely above trivial baselines on knowledge tracing and below random chance on item discrimination.

This paper presents Bridge, a method that translates expert math educators' decision-making processes into a model for LLMs to remediate student math mistakes. The authors construct and publish a dataset of 700 real K-12 tutoring conversations (grades 1-5) annotated with expert decisions and conduct human evaluations comparing expert, novice, and LLM responses to student errors.

This paper presents Physics-STAR, an LLM-powered tutoring system for high school physics education, and evaluates it through a controlled experiment with 12 sophomore students, comparing it against traditional teacher-led lectures and generic LLM tutoring. The study measures learning outcomes (conceptual, computational, and informational problem scores) and efficiency, finding significant improvements especially on complex information problems (100% score increase, 5.95% efficiency gain).

Mentigo is an AI agent system designed to mentor middle school students through the Creative Problem Solving (CPS) process, providing structured guidance, adaptive feedback, and Socratic questioning. The system was evaluated through a comparative experiment with 12 students and reviewed by five expert teachers, demonstrating improvements in student engagement and creative outcomes.

This paper develops a pedagogical framework for LLM-driven feedback generation in programming education and evaluates it through a mixed-methods study with eight secondary-school computer science teachers using a web-based Python programming application. The study assesses whether LLM-generated feedback aligned with pedagogical principles (mastery adaptation, progress adaptation) can match or exceed human teacher feedback quality.

EducationQ is a multi-agent dialogue framework that evaluates LLMs' teaching capabilities through simulated teacher-student interactions, testing 14 LLMs across 1,498 questions spanning 13 disciplines and 10 difficulty levels. The framework incorporates formative assessment principles to measure pedagogical effectiveness including questioning strategies, adaptive feedback, and scaffolding behaviors.

This paper evaluates ChatGPT's ability to solve decimal problems, grade student self-explanation responses, and generate instructional feedback within the Decimal Point learning game, using over 5,000 real student responses from middle school students. The study finds ChatGPT can accurately assess 75% of student answers and generate high-quality feedback, though it struggles with specific decimal place value problems.

This paper presents MRBench, a benchmark for evaluating LLM-powered AI tutors' pedagogical abilities in mathematical dialogues, featuring 192 conversations across eight pedagogical dimensions (mistake identification, guidance provision, answer revealing, etc.) with gold human annotations. The taxonomy and dataset enable systematic assessment of whether AI tutors demonstrate sound pedagogical practices when remediating student mistakes.

This paper trains an open-source LLM (Llama 3.1 8B) to generate tutor utterances that maximize student learning outcomes in math tutoring dialogues by optimizing for both student response correctness and pedagogical quality using direct preference optimization. The approach uses a student model to predict correctness and GPT-4o to evaluate pedagogical principles, demonstrating that the trained tutor increases correct student responses while maintaining high pedagogical quality.

This paper presents the BEA 2025 Shared Task which evaluates pedagogical abilities of AI tutors (powered by LLMs) in educational dialogues, specifically assessing mistake identification, guidance provision, and feedback actionability in math tutoring contexts. The benchmark includes five evaluation tracks with publicly released datasets and annotation guidelines, achieving macro F1 scores ranging from 58.34 to 71.81 across pedagogical dimensions.

This paper presents an MPNet ensemble system for the BEA 2025 Shared Task that automatically classifies AI tutor responses in educational dialogues across two tracks: whether tutors correctly identify student mistakes (Track 1) and whether they locate the mistakes (Track 2). The system uses fine-tuned Transformer models with grouped cross-validation and hard-voting ensemble to achieve macro-F1 scores of 0.7110 and 0.5543 on the respective tracks.

This paper critically reviews evaluation practices for GenAI-powered Intelligent Tutoring Systems (ITSs), highlighting the lack of reliable, pedagogy-driven evaluation frameworks and benchmarks. It analyzes existing challenges through case studies and proposes three research directions for developing fair, unified, and scalable ITS evaluation methodologies grounded in learning science principles.

This paper introduces Hierarchical Pedagogical Oversight (HPO), a multi-agent adversarial framework that uses structured debate between specialist agents to evaluate AI tutor responses for pedagogical quality, specifically detecting sycophancy and overly direct answers. The framework is evaluated on the MRBench dataset of 1,214 middle-school mathematics dialogues, achieving superior performance in classifying mistake identification and guidance quality compared to GPT-4o.

This paper presents a theoretical framework integrating Evidence-Centered Design with Social Cognitive Theory for adaptive scaffolding in LLM-based pedagogical agents, and demonstrates it through Inquizzitor, an LLM-based formative assessment agent tested with 104 middle school students in Earth Science STEM+C curriculum. The study evaluates the agent's scoring accuracy, interaction quality aligned with learning theories, and student perceptions of its value.

This paper presents a randomized controlled trial (RCT) evaluating GPT-4 as an interactive homework tutor for high-school ESL students, measuring its impact on learning outcomes (grammar gains) and student engagement compared to traditional homework. The study demonstrates significant improvements in learning outcomes and student satisfaction through Socratic-style interactive homework sessions.

This paper presents aiPlato, an AI-enabled homework platform for introductory physics, and reports on a pilot deployment studying student engagement patterns, learning outcomes (final exam scores), and perceptions of stepwise feedback tools including an AI tutor chat feature. The quasi-experimental study examines whether engagement with formative AI feedback correlates with improved performance while preserving productive struggle.

EduEval is a comprehensive hierarchical benchmark for evaluating LLMs in Chinese K-12 education, comprising 24 task types with over 11,000 questions organized across six cognitive dimensions (Memorization, Understanding, Application, Reasoning, Creativity, and Ethics) based on Bloom's Taxonomy and Webb's Depth of Knowledge. The benchmark incorporates authentic educational materials including real exam questions, classroom dialogues, student essays, and expert-designed prompts spanning primary through high school levels.

EduAdapt is a benchmark dataset of nearly 48k grade-labeled question-answer pairs spanning Grades 1-12 across nine science subjects, designed to evaluate whether LLMs can adapt their responses to different K-12 grade levels with age-appropriate vocabulary and explanations. The benchmark evaluates both multiple-choice and open-ended questions aligned to Next Generation Science Standards and includes publicly available code and datasets.

This paper presents LearnLM-Tutor, a fine-tuned Gemini model for education, and introduces a comprehensive evaluation framework consisting of seven diverse benchmarks (quantitative, qualitative, automatic, and human evaluations) grounded in learning science principles to assess pedagogical capabilities of AI tutoring systems. The work includes real-world deployment at Arizona State University's Study Hall and demonstrates that LearnLM-Tutor is consistently preferred by educators and learners over prompt-tuned Gemini across multiple pedagogical dimensions.

This paper reports an exploratory RCT with 165 UK secondary school students evaluating LearnLM, a pedagogically fine-tuned AI tutor supervised by human experts, comparing its effectiveness to human-only tutoring for mathematics learning on the Eedi platform. Students receiving LearnLM support demonstrated equal or better learning outcomes, including superior knowledge transfer to novel problems.

TutorBench is a benchmark dataset of 1,490 expert-curated samples evaluating LLMs' tutoring capabilities across three core tasks: generating adaptive explanations, providing actionable feedback, and creating effective hints for high-school and AP-level curricula. The benchmark uses sample-specific rubrics and LLM-judge evaluation to assess 16 frontier models, finding none achieve above 56% overall performance.

This paper presents PhysicsAssistant, a multimodal LLM-powered robot designed to assist 8th-grade students during physics lab experiments by combining YOLOv8 object detection with GPT-3.5-turbo for natural language interaction. The study evaluates the system through a user study with 10 students, comparing its performance against GPT-4 and human expert ratings using Bloom's taxonomy.

This paper introduces AMMORE, a dataset of 53,000 middle-school math open-response question-answer pairs from an African WhatsApp-based tutoring platform, and evaluates LLM-based approaches (including chain-of-thought prompting) for automated grading of challenging student answers. The study demonstrates that LLM grading improves overall accuracy from 98.7% to 99.9% and significantly reduces misclassification of student mastery status in a Bayesian Knowledge Tracing model.

FoundationalASSIST is a K-12 educational dataset of 1.7M student interactions with full question text, actual student responses, and Common Core alignment, designed to evaluate LLMs on knowledge tracing (predicting student performance and exact answers) and pedagogical grounding (understanding properties that make assessment items effective). The paper demonstrates that current frontier LLMs struggle significantly on both task families, performing barely above trivial baselines on knowledge tracing and below random chance on item discrimination.

This paper presents MWPTutor, an LLM-based tutoring system that combines GPT-4 with finite state transducers to provide pedagogically-structured tutoring for math word problems, with guardrails to prevent answer leakage and maintain desired teaching strategies. The system is evaluated through human assessment comparing it to unstructured GPT-4 tutoring on two math word problem datasets.

MathVC is an LLM-simulated multi-persona virtual classroom platform designed to facilitate collaborative problem-solving in middle school mathematics through simulated peer interactions with diverse mathematical thinking and intentional misconceptions. The paper evaluates the system with 14 U.S. middle-schoolers, measuring engagement, motivation, confidence, and collaborative learning outcomes.

This paper presents Physics-STAR, an LLM-powered tutoring system for high school physics education, and evaluates it through a controlled experiment with 12 sophomore students, comparing it against traditional teacher-led lectures and generic LLM tutoring. The study measures learning outcomes (conceptual, computational, and informational problem scores) and efficiency, finding significant improvements especially on complex information problems (100% score increase, 5.95% efficiency gain).

This quasi-experimental study with 110 secondary school students compares financial education outcomes between students using generative AI tools (ChatGPT) versus traditional teaching methods, finding significant improvements in financial literacy dimensions for the AI group.

This case study evaluates ChatGPT as a substitute teacher for 11th-grade chemistry students in the UAE, comparing learning outcomes between experimental (ChatGPT) and control (traditional teacher) groups across Bloom's taxonomy cognitive domains. The study found that students in the control group performed significantly better (15% vs 7.5% good/outstanding ratings) and that ChatGPT faced challenges with student engagement and completion rates.

This paper evaluates ChatGPT's ability to solve decimal problems, grade student self-explanation responses, and generate instructional feedback within the Decimal Point learning game, using over 5,000 real student responses from middle school students. The study finds ChatGPT can accurately assess 75% of student answers and generate high-quality feedback, though it struggles with specific decimal place value problems.

This paper presents a framework for finetuning LLMs to generate grade-appropriate educational content across six grade levels (lower elementary to adult), evaluated through readability metrics and human studies with 208 participants. The work addresses the challenge of making AI tutoring systems produce content matched to students' comprehension levels across K-12 grades.

This paper trains an open-source LLM (Llama 3.1 8B) to generate tutor utterances that maximize student learning outcomes in math tutoring dialogues by optimizing for both student response correctness and pedagogical quality using direct preference optimization. The approach uses a student model to predict correctness and GPT-4o to evaluate pedagogical principles, demonstrating that the trained tutor increases correct student responses while maintaining high pedagogical quality.

This paper develops and evaluates a dialogue-based mathematics intelligent tutoring system (ITS) for teaching multiplication and division of fractions to sixth graders, using diagnostic teaching methods to identify student misconceptions in real-time and provide adaptive instruction. A quasi-experimental study with 66 students showed the ITS significantly outperformed conventional classroom instruction, particularly for lower-performing students.

This paper proposes ERL4SIIP, an Evolutionary Reinforcement Learning framework for AI tutors that implements Socratic teaching methods in interdisciplinary STEM education, specifically designed to foster higher-order cognitive abilities like knowledge integration and critical thinking while avoiding 'spoon-feeding' behaviors. The system uses dynamic student modeling, hierarchical rewards, and combines evolutionary algorithms with PPO to generate diverse teaching strategies that promote active learning rather than passive answer delivery.

This paper presents a benchmarking framework that systematically evaluates whether LLMs can replicate the adaptivity of intelligent tutoring systems by testing three LLMs (Llama3-8B, Llama3-70B, GPT-4o) across 75 real-world tutoring scenarios, measuring both adaptivity to student context and pedagogical soundness of generated instructional moves. The authors use prompt variations that remove key contextual features (student errors, knowledge components) to assess whether LLMs adjust their responses appropriately, finding that current LLMs only marginally match ITS adaptivity.

This paper presents PACE, a personalized conversational AI tutoring agent for K-12 mathematics instruction that adapts teaching strategies based on students' learning styles (using the Felder-Silverman model) and employs Socratic teaching methods to provide individualized feedback and scaffolding.

EduEval is a comprehensive hierarchical benchmark for evaluating LLMs in Chinese K-12 education, comprising 24 task types with over 11,000 questions organized across six cognitive dimensions (Memorization, Understanding, Application, Reasoning, Creativity, and Ethics) based on Bloom's Taxonomy and Webb's Depth of Knowledge. The benchmark incorporates authentic educational materials including real exam questions, classroom dialogues, student essays, and expert-designed prompts spanning primary through high school levels.

EduAdapt is a benchmark dataset of nearly 48k grade-labeled question-answer pairs spanning Grades 1-12 across nine science subjects, designed to evaluate whether LLMs can adapt their responses to different K-12 grade levels with age-appropriate vocabulary and explanations. The benchmark evaluates both multiple-choice and open-ended questions aligned to Next Generation Science Standards and includes publicly available code and datasets.

This paper presents LearnLM-Tutor, a fine-tuned Gemini model for education, and introduces a comprehensive evaluation framework consisting of seven diverse benchmarks (quantitative, qualitative, automatic, and human evaluations) grounded in learning science principles to assess pedagogical capabilities of AI tutoring systems. The work includes real-world deployment at Arizona State University's Study Hall and demonstrates that LearnLM-Tutor is consistently preferred by educators and learners over prompt-tuned Gemini across multiple pedagogical dimensions.

This paper introduces AMMORE, a dataset of 53,000 middle-school math open-response question-answer pairs from an African WhatsApp-based tutoring platform, and evaluates LLM-based approaches (including chain-of-thought prompting) for automated grading of challenging student answers. The study demonstrates that LLM grading improves overall accuracy from 98.7% to 99.9% and significantly reduces misclassification of student mastery status in a Bayesian Knowledge Tracing model.

FoundationalASSIST is a K-12 educational dataset of 1.7M student interactions with full question text, actual student responses, and Common Core alignment, designed to evaluate LLMs on knowledge tracing (predicting student performance and exact answers) and pedagogical grounding (understanding properties that make assessment items effective). The paper demonstrates that current frontier LLMs struggle significantly on both task families, performing barely above trivial baselines on knowledge tracing and below random chance on item discrimination.

This paper presents a Socratic chatbot built by fine-tuning and prompt-tuning small open-source LLMs (Llama2 7B/13B) to foster critical thinking through questioning rather than direct answers, validated through simulated student-chatbot interactions that measure reflection and critical thinking development.

EducationQ is a multi-agent dialogue framework that evaluates LLMs' teaching capabilities through simulated teacher-student interactions, testing 14 LLMs across 1,498 questions spanning 13 disciplines and 10 difficulty levels. The framework incorporates formative assessment principles to measure pedagogical effectiveness including questioning strategies, adaptive feedback, and scaffolding behaviors.

ConvoLearn is a dataset of 1,250 semi-synthetic tutor-student dialogues in middle school Earth Science, grounded in constructivist knowledge-building theory and operationalizing six pedagogical dimensions (cognitive engagement, formative assessment, accountability, cultural responsiveness, metacognition, and power dynamics). The authors demonstrate that fine-tuning LLMs on this dataset shifts their behavior toward knowledge-building strategies, with their Mistral-7B model outperforming base models and Claude Sonnet 4.5 in teacher evaluations.

This paper introduces PedagogicalRL-Thinking, a reinforcement learning framework that trains LLM tutors by applying pedagogical rewards to both visible responses and internal reasoning traces, using domain-specific educational theory (Polya's problem-solving framework) to guide the model's thinking process. The approach is evaluated on mathematics tutoring dialogues with metrics measuring solution correctness, answer leakage prevention, and pedagogical helpfulness.

This paper proposes ERL4SIIP, an Evolutionary Reinforcement Learning framework for AI tutors that implements Socratic teaching methods in interdisciplinary STEM education, specifically designed to foster higher-order cognitive abilities like knowledge integration and critical thinking while avoiding 'spoon-feeding' behaviors. The system uses dynamic student modeling, hierarchical rewards, and combines evolutionary algorithms with PPO to generate diverse teaching strategies that promote active learning rather than passive answer delivery.

This qualitative case study evaluates ArtiBos, a gamified adaptive intelligent tutoring system, examining its impact on 9th-grade students' mathematical problem-solving skills through system logs, student interviews, and teacher interviews with 12 students and 6 teachers in Turkey.

This paper presents a theoretical framework integrating Evidence-Centered Design with Social Cognitive Theory for adaptive scaffolding in LLM-based pedagogical agents, and demonstrates it through Inquizzitor, an LLM-based formative assessment agent tested with 104 middle school students in Earth Science STEM+C curriculum. The study evaluates the agent's scoring accuracy, interaction quality aligned with learning theories, and student perceptions of its value.

This paper presents a randomized controlled trial (RCT) evaluating GPT-4 as an interactive homework tutor for high-school ESL students, measuring its impact on learning outcomes (grammar gains) and student engagement compared to traditional homework. The study demonstrates significant improvements in learning outcomes and student satisfaction through Socratic-style interactive homework sessions.

This study investigates middle school students' (ages 14-15) question-asking and answer-evaluation skills when using ChatGPT for science investigation tasks, analyzing 63 students' interactions and learning outcomes. The research finds students over-relied on ChatGPT, struggled with formulating effective questions and critically evaluating responses, resulting in moderate learning performance with vague or incomplete understanding of scientific concepts.

This action research study evaluates how ChatGPT-powered activities impact critical thinking skill application (mapped to Bloom's taxonomy) across three Chinese language classrooms (introductory L2, intermediate L2, and native speaker academic writing). The study examines which CT skills learners employ when interacting with ChatGPT and how task types relate to CT skill application.

This quasi-experimental study evaluates the impact of problem-based learning (PBL) assisted by an AI chatbot on higher-order thinking skills (HOTS) in Grade 4 elementary school students in Indonesia, comparing experimental and control groups using pre/post-tests and N-Gain scores.

This paper presents VATE (Virtual AI Teacher for Error Analysis), an LLM-based system deployed on Squirrel AI's platform that automatically analyzes student mathematical errors from their draft work, provides targeted feedback through multi-round dialogue, and guides students to correct mistakes. The system achieves 78.3% accuracy in error analysis for elementary mathematics and demonstrates improved learning efficiency compared to traditional methods.

EduAlign is a framework that uses reinforcement learning to align large language models with three pedagogical principles: Helpfulness, Personalization, and Creativity (HPC). The authors develop HPC-RM, a multi-dimensional reward model trained on 8k annotated educational interactions, and use it to fine-tune an LLM via Group Relative Policy Optimization, demonstrating improved pedagogical alignment in AI tutoring responses.

This paper introduces a probabilistic modeling framework using Item Response Theory and novel discrete variational inference to predict whether K-12 students will answer mathematics exam questions correctly, releasing the largest open dataset of professionally marked formal mathematics exam responses. The work achieves over 80% prediction accuracy and demonstrates that a single latent ability parameter may be sufficient for accurate predictions, with particular strength in low-data cold-start scenarios.

This study investigates how university physics students interact with ChatGPT versus search engines when solving physics problems, finding that students overly trusted ChatGPT's incorrect answers and used copy-paste strategies 42% of the time, indicating limited critical reflection and cognitive offloading.