Examination of coding accuracy for content errors in college student essays on criminological theories by comparing human-coded results with outputs from four LLMs indicates that LLM choice significantly influenced human-AI correspondence.
Overall, the findings suggest that LLMs can approximate human coding in this case-specific setting, particularly at the coding level, and may serve as a scalable support tool for inductive qualitative analysis.
Leonardo Bergmann, Renata Gheorghiu, Ana Gvritishvili et al.· Research Square· 0 citations
Although LLM-based benchmark ratings can approximate expert judgments and reduce the need for labor-intensive human triple coding, limitations remain regarding cost, genre- and task specificity, and sensitivity to text presentation and student grade level—factors that constrain immediate classroom use, particularly for...
How recognition accuracy varies across texts is analyzed and which characteristics make AI-generated physics texts more or less distinguishable from human-written ones are discussed, with implications for fostering AI literacy in physics education.
Péter Kosztyó, Márton Burkovics, Péter Jenei· Journal of Physics, Conferen...· 0 citations
The proliferation of AI text generation tools in educational settings has created unprecedented challenges for academic integrity. As AI-generated content grows more sophisticated, traditional assessment methods may no longer suffice to distinguish human from machine-authored work. This mixed-methods study compared hum...
Zafer Susoy· Pamukkale University Journal...· 0 citations
Large language models (LLMs) such as ChatGPT have been widely adopted by chemistry undergraduate university students as a learning tool, but few methods exist to measure the scope of their influence on essay writing. This report introduces a protocol based on monitoring the frequency of specific words used excessivel...
Keith Livingstone· Journal of Chemical Educatio...· 0 citations
This study examined how closely a large language model (LLM) agreed with expert human raters when scoring English argumentative essays by Turkish L1 university preparatory students, and whether human rater and LLM scores distinguished two proficiency groups. A total of 110 handwritten essays from an elementary and a pr...
Emrah Emirtekin, Melih Karasu· International journal of mod...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
