Test Case-Informed Knowledge Tracing for Open-ended Coding Tasks

TIKTOC is a knowledge tracing framework for open-ended coding tasks that predicts both student code submissions and test case pass/fail outcomes using multi-task learning with LLMs, augmenting the CodeWorkout dataset with test case information to provide fine-grained insights into student knowledge states in computer science education.

Open-ended coding tasks, which ask students to construct programs according to certain specifications, are common in computer science education. Student modeling can be challenging since their open-ended nature means that student code can be diverse. Traditional knowledge tracing (KT) models that only analyze response correctness may not fully capture nuances in student knowledge from student code. In this paper, we introduce Test case-Informed Knowledge Tracing for Open-ended Coding (TIKTOC), a

Study Type

Source

Framework Categories

Tool Types

Tags