TOWARDS EFFECTIVE ARGUMENTATION: DESIGN AND IMPLEMENTATION OF A GENERATIVE AI-BASED EVALUATION AND FEEDBACK SYSTEM

This paper develops and evaluates a generative AI-based system using ChatGPT to automatically assess and provide feedback on student argumentation writing by extracting argument components (claims, data, warrants, etc.). The system compares AI performance against human expert evaluation across scientific and non-scientific contexts for K-12 argumentation training.

This study aimed at examining the performance of generative artificial intelligence to extract argumentation elements from text. Thus, the researchers developed a web-based framework to provide automated assessment and feedback relying on a large language model, ChatGPT. The results produced by ChatGPT were compared to human experts across scientific and non-scientific contexts. The findings revealed marked discrepancies in the performance of AI for extracting argument components, with a signifi

Source

Framework Categories

Tool Types

Tags