Skip to content
#generative ai Open access

The association between generative AI use and university students’ critical thinking: a moderated mediation model of GenAI feedback literacy and reflective thinking

Sep 2026 · Frontiers in Psychology · 0 citations · 67 references
Artificial Intelligence in Healthcare and Education

Abstract

Generative artificial intelligence (GenAI) has rapidly become an everyday learning resource for university students, yet evidence on whether such use is associated with stronger or weaker critical thinking is sharply divided. Recent work documents both cognitive scaffolding and “metacognitive laziness” effects, suggesting that the AI-cognition relationship is contingent on how students engage with AI-generated feedback. Drawing on the extended-mind framework, cognitive load theory and feedback-literacy theory, we test a cross-sectional moderated mediation model in which GenAI feedback literacy mediates the association between GenAI use and critical thinking, operationalised as self-reported critical analytical skills, and reflective thinking moderates both the direct path and the path from feedback literacy to critical thinking. A sample of 421 Chinese undergraduates (69.6% female) completed validated self-report measures, and partial least squares structural equation modelling (PLS-SEM, 5,000 bootstrap resamples) was used to estimate the model. GenAI use significantly predicted critical thinking ( β  = 0.257, p  < 0.001) and feedback literacy ( β  = 0.438, p  < 0.001), and feedback literacy in turn predicted critical thinking ( β  = 0.421, p  < 0.001). The indirect effect through feedback literacy was substantial ( β  = 0.185, 95% CI [0.134, 0.254]; VAF = 71.98%), and the direct effect dropped to non-significance once the mediator entered the model, a pattern consistent with near-complete mediation. Reflective thinking moderated the structure of the relationship: at low reflective thinking, GenAI use was directly associated with critical thinking; at high reflective thinking, the association was carried almost entirely by feedback literacy, and the conditional indirect effect was strongest. Because all variables were measured concurrently by self-report, the findings describe associations consistent with, but not demonstrative of, the proposed mechanism. They are nonetheless consistent with a view of GenAI use as a context-sensitive cognitive resource: its association with self-reported critical analytical skills depends on whether students can interpret, judge and act on AI-generated feedback, and whether they bring a reflective stance to the interaction. Implications for AI-pedagogy integration, feedback-literacy curricula and reflective course design in higher education are discussed.

Read PDF

Similar papers

#artificial intelligence Conference Open access Apr 2020

ECCOLA - a Method for Implementing Ethically Aligned AI Systems

The method, ECCOLA, is presented, which aims at making the high-level AI ethics principles more practical, making it possible for developers to more easily implement them in practice.

Ville Vakkuri, Kai-Kristian Kemell, P. Abrahamsson · 64 citations · ⚡6
#computer vision Review Apr 2024

AI-powered Code Review with LLMs: Early Results

The goal is to not only refine the accuracy of the LLM-based tool but also to underscore its potential in streamlining the software development lifecycle through proactive code improvement and education.

Z. Rasheed, Malik Abdul Sami, Muhammad Waseem et al. · 62 citations · ⚡3
#computer vision Open access Mar 2024

LLM-based agents for automating the enhancement of user story quality: An early report

The use of large language models to automatically improve the user story quality in Austrian Post Group IT agile teams is explored, with a reference model for an Autonomous LLM-based Agent System developed and implemented at the company.

Zheying Zhang, M. Rayhan, Tomas Herda et al. · 48 citations · ⚡4
#computer vision Review Mar 2024

System for systematic literature review using multiple AI agents: Concept and an empirical evaluation

This paper introduces a novel multi-AI-agent system designed to fully automate SLRs, and demonstrates how it substantially reduces the time and effort traditionally required for SLRs while maintaining comprehensiveness and precision.

Abdul Malik Sami, Z. Rasheed, Kai-Kristian Kemell et al. · 44 citations · ⚡2
#computer vision Feb 2024

Can Large Language Models Serve as Data Analysts? A Multi-Agent Assisted Approach for Qualitative Data Analysis

The proposed LLM-based multi-agent system automates qualitative data analysis process, creating opportunities for researchers and practitioners, and future improvements focus on enhancing multilingual performance and integrating continuous expert feedback.

Z. Rasheed, Muhammad Waseem, Aakash Ahmad et al. · 41 citations

Related blog posts

Microsoft Research Blog Oct 7, 2026

Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses

Training AI agents with reinforcement learning can be challenging because their tools, context, and decision-making are managed by complex frameworks. Agent Lightning connects existing agents to RL training, making it easier to improve them without rebuilding them. The post Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.