Edu-Values: Towards Evaluating the Chinese Education Values of Large Language Models

Edu-Values is a Chinese education values evaluation benchmark with 1,418 questions testing LLMs on seven core educational values including professional philosophy, teachers' professional ethics, education laws and regulations, cultural literacy, educational knowledge and skills, basic competencies, and subject knowledge. The benchmark evaluates 21 state-of-the-art LLMs using multiple question types including multiple-choice, multi-modal, subjective analysis, adversarial prompts, and Chinese traditional culture questions.

In this paper, we present Edu-Values, the first Chinese education values evaluation benchmark that includes seven core values: professional philosophy, teachers' professional ethics, education laws and regulations, cultural literacy, educational knowledge and skills, basic competencies and subject knowledge. We meticulously design 1,418 questions, covering multiple-choice, multi-modal question answering, subjective analysis, adversarial prompts, and Chinese traditional culture (short answer) que

Source

Framework Categories

Tool Types

Tags