How to Teach Programming in the AI Era? Using LLMs as a Teachable Agent for Debugging

Relevance: 8/10 66 cited 2023 paper

HypoCompass is an LLM-powered intelligent tutoring system where students play teaching assistants who help debug LLM-generated buggy code, focusing on hypothesis construction skills in CS1 programming courses. The system was evaluated with 19 novices showing 12% improvement in debugging performance and 14% reduction in completion time.

Large Language Models (LLMs) excel at generating content at impeccable speeds. However, they are imperfect and still make various mistakes. In Computer Science education, as LLMs are widely recognized as "AI pair programmers," it becomes increasingly important to train students on evaluating and debugging LLM-generated codes. In this work, we introduce HypoCompass, a novel system to facilitate deliberate practice on debugging, where human novices play the role of Teaching Assistants and help LLM

Tool Types

AI Tutors 1-to-1 conversational tutoring systems.

Tags

large language model evaluation educationcomputer-science