Skip to content

Evaluating the Pedagogical Quality of LLM-Generated Feedback: A Criterion-Based and Comparative Study

· 0 citations · 18 references

TL;DR

A multi-dimension 14-item rating instrument grounded in formative feedback theory is developed and used to compare feedback from a multi-agent system, a single-agent system, and an instructor and shows that a multidimensional approach identifies differences in feedback quality that a single overall rating could miss.

View source

Similar papers

Review Open access Sep 2026

Measuring the quality of AI-generated feedback

A theoretical three-level model is developed that establishes the necessary terminology for operationalizing feedback quality in AI-generated feedback on texts and shows the strongest predictors of the quality of the feedback texts were concreteness and explanation.

Maurice Fürstenberg · 0 citations
Open access Oct 2026

Human–AI Collaboration in Academic Writing Instruction: Calibrated Feedback Model for EAP

A hybrid model of feedback provision is put forward in which language instructors can leverage GenAI to support formative assessment while maintaining pedagogical oversight, and the findings offer guidance for integrating GenAI into academic writing instruction in ways that preserve instructional quality and student ag...

Reza Farzi · 0 citations
#small language model Open access Sep 2026

Human versus machine

Although LLM-based benchmark ratings can approximate expert judgments and reduce the need for labor-intensive human triple coding, limitations remain regarding cost, genre- and task specificity, and sensitivity to text presentation and student grade level—factors that constrain immediate classroom use, particularly for...

Afra Sturm, Valentin Unger, Fabian Grünig · 0 citations
#small language model Open access Sep 2026

Perceived usefulness and intention to use large language model-generated feedback across three educational levels: a user-centred study in programming

These findings characterise the correlates of perceived usefulness and intention to use within each feedback layer, supporting human-centred designs that preserve student judgement and instructor oversight.

Pedro C. Mendonça, Filipe Quintal, Mário A. T. Figueiredo et al. · 0 citations
Open access 2026

Using Large Language Models to Generate Feedback for Educational Assessments: A Comparative Exploratory Study

Feedback in online environments can be an essential learning tool. However, prior research indicates that poorly designed feedback, particularly when punitive or generic, can undermine student motivation and self-perception (Schartel, 2012). In educational assessment, high-quality feedback can provide learners with inf...

Lucy Gitiria, A. Nasyrova, Peter Tran et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.