Skip to content

InsightToast: Proactive Information Retrieval&Glanceable Visualization in the Side Channel of Data-Rich Meetings

Aug 2026 · 0 citations · 130 references
Computer Science

TL;DR

InsightToast is introduced, a mixed-initiative application that monitors verbal discourse in real time, identifies topics and informational needs as they emerge, and proactively retrieves relevant information through a multi-agent large language model (LLM)-based pipeline integrating retrieval-augmented generation (RAG) to produce source-grounded insights.

Abstract

Missing institutional context during meetings can impede effective participation. Retrieving relevant information, often scattered across heterogeneous internal and external sources, requires costly task-switching that disrupts both individual focus and collective conversational flow, particularly detrimental during cognitively demanding tasks such as decision-making. We introduce InsightToast, a mixed-initiative application that monitors verbal discourse in real time, identifies topics and informational needs as they emerge, and proactively retrieves relevant information through a multi-agent large language model (LLM)-based pipeline integrating retrieval-augmented generation (RAG) to produce source-grounded insights as succinct text and glanceable interactive charts, delivered through a peripheral interface as ephemeral toasts in the conversation's side channel. To demonstrate the potential for yielding serendipitous insights, we showcase a usage scenario involving a knowledge base of legislative documents as the meeting's context. We then report on a comparative study (N=16), in which participants arrived at informed policy decisions while maintaining natural conversation flow.

View source

Similar papers

2026

GLANCE: Strategy-Based Visual Mediation for LLM Interaction

This work formalizes LLM interface augmentation as the mediation strategy framework GLANCE, that defines an interpretive task context, an evidence derivation procedure operating on prompt–response artifacts, and visual encodings that externalize the resulting evidence.

Raphael Buchmüller · 0 citations
#human-computer interacti... Preprint Sep 2026

Targeted and Traceable Investigation of Multi-Agent LLM Dialogue via Semantic Bundling of Knowledge Graphs

This work presents a targeted and traceable approach to investigating multi-agent LLM dialogue, applied to the VAST Challenge 2026 MC1 dataset, and finds that the KG structure enables users to identify actors worth investigating faster and summarizing only the region surrounding an actor of interest better supports per...

Ze-Yu Hua, Adam Coscia, Alex Endert · 0 citations
#generative ai Book Open access Sep 2026

Travel Literature as Hypertext: Definition and Case Study of AI-enabled Interactive Explorations

Travel literature is a unique form of hypertext that extends beyond its medium into real-world physical exploration. While conventional computational methods can easily extract surface-level ontological entities (e.g., locations, dates), the deeper epistemic and judgmental subtext that guides the discovery and evaluati...

Virginia Orlando, Alessandro Adamou, Alessio Antonini · 0 citations
Book Open access Sep 2026

Beyond Exploration: AI-facilitated Information Visualization Structure for Complex Context Exploration and Decision-Making in Environmental Sustainability

Investigation of how different information visualization structures shape sustainability planning by comparing three interfaces refine the design of AI-enhanced decision support tools for personal sustainability and other multi-criteria personal informatics domains.

Qi-Ming Sun, S. Hsiao, Shih-Yi Chien · 0 citations
Open access Sep 2026

Convo-Ease: A Policy-as-Prompt Gatekeeper for Real-Time Multimodal Moderation in Enterprise Communication

Enterprise communication platforms carry text, image, and audio content across organizational contexts that public-facing moderation systems were never designed to serve. Existing moderation acts after content reaches recipients, depends on fixed harm taxonomies that cannot be updated without retraining, and rarely cov...

Soham S. Jadhav, Omkar N. Gadakh, Atharv Gaikwad et al. · 0 citations
#natural language process... Preprint Aug 2026

You Know What I Mean: A Benchmark for Agentic Conversational Reference Grounding

The results show that CoRG remains challenging for current agents, even the best agent reaches only 67.0% success rate, leaving one third of references unresolved, and position CoRG as a concrete benchmark for studying how agents search, inspect, and verify information in realistic multi-tool environments.

Karen Fuchs, Uri Katz, Yoav Goldberg · 0 citations

Related blog posts

MIT News · Artificial Intelligence Oct 7, 2026

Discovering the value of humanistic inquiry

Students in MIT’s Concourse program delve deeply into the human condition, debate challenging questions, and learn to develop judgment about issues that can’t be quantified.

Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

MIT News · Artificial Intelligence Sep 30, 2026

This game-playing AI is the new champ at Stratego

Able to defeat top-ranked human players and more efficient than other models, the new system could help decision-makers in military maneuvers or business negotiations.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.