Skip to content
Review Open access

Reading With, Not Through, AI: A Human-Centered Framework for Multimodal Literature Education

Aug 2026 · Review of Artificial Intelligence in Education · Vol 7, pp. e01377 · 0 citations · 14 references

TL;DR

Multimodal Evidence-Bounded Interpretation (MEBI), a human-centered framework designed to preserve close reading, interpretive plurality, evidential accountability, and student authorship when multimodal GenAI is used with literary texts, is developed.

Abstract

Background: Multimodal generative artificial intelligence (GenAI) can process written language, images, typography, layout, and interface-like elements, creating opportunities for literature education but also new epistemic risks. Vision-capable models may combine accurate recognition, plausible inference, and invented visual detail in a single fluent interpretation. The central challenge is not access to multimodal information, but disciplined separation of observation, inference, interpretation, and human judgment. Objective: This perspective paper develops Multimodal Evidence-Bounded Interpretation (MEBI), a human-centered framework designed to preserve close reading, interpretive plurality, evidential accountability, and student authorship when multimodal GenAI is used with literary texts. Methods: The study uses an evidence-informed conceptual synthesis and a worked multimodal case. Recent peer-reviewed research on GenAI-supported learning, student agency, literary analysis, multimodal AI, and visual hallucination is integrated with established scholarship on multimodality and graphic narrative and with human-centered AI guidance. The framework is demonstrated through selected scan locations from Nora Dåsnes’s Czech graphic narrative Na kočičí svědomí (2024). Results: MEBI comprises five design propositions—human-first encounter, modal traceability, observation–inference separation, preserved interpretive plurality, and human adjudication and authorship—and a five-phase sequence: Encounter, Describe, Hypothesize, Audit, and Adjudicate & Author. Five evidence tags track verbal, image, sequential-spatial, typographic-graphic, and digital-interface evidence. A worked case, classroom sequence, evidence ledger, and assessment heuristic operationalize the framework. Conclusion: MEBI positions AI as a generator of descriptions, hypotheses, counter-readings, and questions rather than as interpretive authority. It offers a researchable design for multimodal literature education while requiring empirical validation across genres, languages, age groups, and educational contexts.

Read PDF

Similar papers

Open access Aug 2026

AI-Assisted Multimodal Discourse Analysis Learning Model to Enhance Critical Literacy Skills

The DISCERN-AI model demonstrates strong theoretical validity, practical feasibility, and pedagogical effectiveness in enhacing students’ multimodal critical literacy, and can be positioned as an innovative pedagogical model that addresses the demands of critical literacy in the digital era.

I. Dwipayana, I. Sutama, I. W. Rasna et al. · 0 citations
Open access Aug 2026

Supporting Young Foreign Language Learners With Image Generative AI in Digital Multimodal Composing: Benefits and Challenges

Integrating generative artificial intelligence (GenAI) into digital multimodal composing (DMC) offers promising avenues for young Foreign Language (FL) learners' learning experiences. Image‐based GenAI tools enable students to generate personalized images from written prompts to help convey meanings, and DMC combin...

A. Lam · 0 citations
Review Open access Aug 2026

Visuo-spatial cognition and the redesign of human-AI interaction in generative artificial intelligence

The visuo-spatial AI interaction model (VSAI), a conceptual framework organized around three dimensions—Input, Processing, and Output—that reconceptualizes human-AI interaction beyond the constraints of linear text is proposed, grounded in principles of modality equivalence, cognitive sovereignty, and design from the m...

B. Galasso · 0 citations
Open access Sep 2026

Integrating AI into pre-service teacher training for reflective interpretation of fine art: a qualitative study in Kazakhstan

Artificial intelligence (AI) is increasingly integrated into education, yet its role in supporting multimodal reflective processes in discipline-specific learning, particularly in fine arts, remains underexplored. This study examines how AI can mediate reflective engagement among pre-service teachers in the interpretat...

S. Rustemova, Zhanar Nebessayeva, D. Bolysbaev et al. · 0 citations
Conference Aug 2026

AI-Assisted Content Adaptation for Personalized Learning in a Multimodal Narrated Digital Picture Book Prototype for Early Childhood Marine Environmental Literacy

Marine environmental literacy in early childhood requires learning media that can convey ecological issues in a simple, visual way and align with the characteristics of child development. Topics such as marine pollution, changing ecosystem conditions, and human responsibility for the environment are often abstract for...

Dwi Atinda Aneri, E. Irwandi · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.