Oct 2026· Proceedings of the Human Factors and Ergonomics Society Annual Meeting· 0 citations· 14 references
Academic Writing and Publishing
TL;DR
The preliminary findings motivate examining degrees of AI involvement and using participant-grouped validation in future studies to examine structural and lexical features, readability, Sentence-BERT embeddings, exploratory writing-condition classification, technology acceptance, and perceived workload.
Abstract
Generative AI is increasingly used in academic writing, although many studies compare only human-written and AI-generated text. This within-subjects study examined manual, AI-revised, and AI-generated extended abstracts in a graduate human factors course. Text analyses included 96 abstracts from 32 participants, and repeated-measures survey analyses included 30 participants. We compared structural and lexical features, readability, Sentence-BERT embeddings, exploratory writing-condition classification, technology acceptance, and perceived workload. Manual abstracts showed the greatest variability. AI-generated abstracts showed less structural variability, higher lexical density, and greater estimated reading difficulty. AI-revised abstracts showed metric-specific overlap with both other conditions. A three-class classifier yielded 68.75% accuracy under abstract-level leave-one-out cross-validation, although participant and topic overlap limits generalization. Participants reported greater acceptance and lower workload in the AI-supported conditions. These preliminary findings motivate examining degrees of AI involvement and using participant-grouped validation in future studies.
AI-text detectors reach near-perfect scores in evaluations that contrast fully human-written texts with texts generated from researcher-designed prompts. In authentic student writing, however, AI use is voluntary and often partial. We study this setting with the PISA 2025 FLA dataset, in which 15-year-olds in Germany w...
Nils-Jonathan Schaller, Thorben Jansen, O. Köller et al.· 0 citations
Generative artificial intelligence (GenAI) is increasingly used by university EFL students for language learning and academic tasks, yet fluent output may be inaccurate. This study examined self-reported trust and verification practices and students’ judgments of selected AI-generated English content among undergraduat...
Asim Omar Salim Altarabulsi· Shihab Journal of Humanities· 0 citations
Abstract This study examines differences in lexico-syntactic complexity between human translation outputs and AI-generated texts under interpreting and translation conditions, with implications for computer-assisted language learning (CALL) and translator/interpreter education. The dataset comprises 60 source segments...
Yi-Li Dan· Journal of China Computer-As...· 0 citations
The results support the use of stylometric indicators as an interpretable supplementary signal for educational text analysis, while also emphasizing that detector outputs should not be treated as definitive proof of AI use in individual student work.
A. Sultanali, G. Kazbekova· NEWS of National Academy of...· 0 citations
Examination of coding accuracy for content errors in college student essays on criminological theories by comparing human-coded results with outputs from four LLMs indicates that LLM choice significantly influenced human-AI correspondence.
Shelley Keith, Philip I. Pavlik, Kristen L. Stives et al.· 0 citations
Findings indicate that the ChatGPT, Gemini, and Claude models generate academic Spanish through differentiated syntactic configurations, suggesting that dependency-based syntactic profiling can support the interpretation of AI-assisted academic writing, inform rubric refinement for academic Spanish, and provide transpa...
E. Vázquez-Cano· Language Education & Ass...· 0 citations
What can AI enable in medicine, and how do we get there? Microsoft Research lead Doug Burger, Microsoft Principal Research Manager Ava Amini, Microsoft Chief Scientific Officer Eric Horvitz, and physician-scientist Eric Topol of Scripps Research explore these questions and more. The post Can AI help build a healthier future? appeared first on Microsoft Research.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.