Evaluating Reading Comprehension Exercises Generated by LLMs: A Showcase of ChatGPT in Education Applications
This paper develops and evaluates a ChatGPT-based system that automatically generates personalized reading comprehension exercises (passages and multiple-choice questions) for middle school English learners in China, with extensive human evaluation by students, teachers, and native speakers demonstrating the quality meets or exceeds human-written materials.
The recent advancement of pre-trained Large Language Models (LLMs), such as OpenAI’s ChatGPT, has led to transformative changes across fields. For example, developing intelligent systems in the educational sector that leverage the linguistic capabilities of LLMs demonstrates a visible potential. Though researchers have recently explored how ChatGPT could possibly assist in student learning, few studies have applied these techniques to real-world classroom settings involving teachers and students