Skip to content
#explainable ai Book Open access

ECHO: Explainable Co-editing with Human-in-the-loop Operations for Presentation Slide Refinement

Oct 2026 · Proceedings of the 28th International Conference On Multimodal Interaction · 0 citations · 19 references

Abstract

Authoring and refining presentation slides is time-consuming in academic and professional settings. Although generative AI lowers the barrier to creating initial drafts, its black-box, one-way workflow often limits fine-grained control. A formative study with 10 frequent presentation authors identified trial-and-error anxiety, invisible intermediate decisions, cross-slide inconsistency, ambiguous spatial references, and fear of irreversible edits. We present ECHO, an interactive slide-refinement system that combines natural-language instructions with direct visual selection. ECHO translates multimodal intent into schema-constrained operation plans through a Plan-Confirm-Execute loop, maintains global style and user habit memory, routes spatially ambiguous requests to a vision-language model, and supports byte-exact rollback. We further introduce CoEdit-Eval, a multi-level framework for evaluating intent mapping, spatial grounding, execution safety, and rendered visual quality. Across four foundation models, ECHO raises Target Hit@1 from 0% for text-only baselines to 55–85%. A within-subjects study with 14 participants shows a 25.8% reduction in completion time and a 20.8% reduction in NASA-TLX workload. These results demonstrate how explicit execution boundaries can make AI-assisted document refinement more controllable, transparent, and reversible.

Read PDF

Similar papers

Preprint Aug 2026

Beyond Trial-and-Error: Agentic Optimization for Image-to-Video Adherence

This work provides a practical and extensible methodology for enhancing the predictability and control of state-of-the-art video generation models, moving the field beyond speculative curiosities toward reliable, production-ready tools.

Aman Tyagi, Hemanth Boinpally, Jonathan Chen et al. · 1 citation

Beyond Instruction-Driven Editing: Source-Grounded Problem Discovery with User-Governed Repair for Scientific Posters

This work introduces PROS (Proactive Refinement Of Scientific Posters), which separates epistemic initiative from behavioral authority: the system can surface source-grounded candidate problems, while users decide which become repair goals and whether resulting changes are committed.

Xingda Lyu, Hong-Ling Lu, Xin-ye Luo et al. · 0 citations
Preprint Aug 2026

ACE: A Self-Correcting Agentic Canvas Editor for Multi-Slide Presentation Automation

Commercial design platforms increasingly edit documents through large language model (LLM) agents, but two practical problems block reliable deployment: legacy document formats expose only \emph{flat}, absolutely positioned elements, so agents must recompute coordinates and routinely break layouts; and design has no un...

Jooyoung Jang, Taegyeong Lee, Jihyeon Park et al. · 0 citations
#generative ai Book Open access Oct 2026

BranchVis: Interactive Exploration of Generative Image Editing Histories

BranchVis is presented, a prototype that represents prompts and generated images as nodes in a tree-based visualization, enabling direct navigation, unambiguous revisitation, integrated comparison, and management of complex histories.

Rifat Mehreen Amin, Alexander Nuss, M. Dutoit et al. · 0 citations
Preprint Aug 2026

Thinking With Tools, Not With Pixels: Tool Calls as Text Scaffolds for Visual Reasoning

Tool-augmented vision-language models increasingly"think with images": they call crop, zoom, or code tools and reason over the returned pixels. However, recent work using blind tests, gain decompositions, and attention analyses has shown that returned images contribute little, raising the question: if pixels do not car...

Jiahao Shao, Yuanbo Yang, Yi-Yi Liao et al. · 3 citations

Related blog posts

MIT News · Artificial Intelligence Oct 23, 2026

Q&A: How AI came to model the “messy” human mind

Assistant Professor Benjamin Lindquist studies how engineers deliberately injected randomness into early AI, giving rise to deep-learning models that sometimes hallucinate.

Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.