InsightToast is introduced, a mixed-initiative application that monitors verbal discourse in real time, identifies topics and informational needs as they emerge, and proactively retrieves relevant information through a multi-agent large language model (LLM)-based pipeline integrating retrieval-augmented generation (RAG) to produce source-grounded insights.
Abstract
Missing institutional context during meetings can impede effective participation. Retrieving relevant information, often scattered across heterogeneous internal and external sources, requires costly task-switching that disrupts both individual focus and collective conversational flow, particularly detrimental during cognitively demanding tasks such as decision-making. We introduce InsightToast, a mixed-initiative application that monitors verbal discourse in real time, identifies topics and informational needs as they emerge, and proactively retrieves relevant information through a multi-agent large language model (LLM)-based pipeline integrating retrieval-augmented generation (RAG) to produce source-grounded insights as succinct text and glanceable interactive charts, delivered through a peripheral interface as ephemeral toasts in the conversation's side channel. To demonstrate the potential for yielding serendipitous insights, we showcase a usage scenario involving a knowledge base of legislative documents as the meeting's context. We then report on a comparative study (N=16), in which participants arrived at informed policy decisions while maintaining natural conversation flow.
This work formalizes LLM interface augmentation as the mediation strategy framework GLANCE, that defines an interpretive task context, an evidence derivation procedure operating on prompt–response artifacts, and visual encodings that externalize the resulting evidence.
This work presents a targeted and traceable approach to investigating multi-agent LLM dialogue, applied to the VAST Challenge 2026 MC1 dataset, and finds that the KG structure enables users to identify actors worth investigating faster and summarizing only the region surrounding an actor of interest better supports per...
Travel literature is a unique form of hypertext that extends beyond its medium into real-world physical exploration. While conventional computational methods can easily extract surface-level ontological entities (e.g., locations, dates), the deeper epistemic and judgmental subtext that guides the discovery and evaluati...
Virginia Orlando, Alessandro Adamou, Alessio Antonini· Proceedings of the 37th ACM...· 0 citations
Investigation of how different information visualization structures shape sustainability planning by comparing three interfaces refine the design of AI-enhanced decision support tools for personal sustainability and other multi-criteria personal informatics domains.
Qi-Ming Sun, S. Hsiao, Shih-Yi Chien· Proceedings of the 37th ACM...· 0 citations
Enterprise communication platforms carry text, image, and audio content across organizational contexts that public-facing moderation systems were never designed to serve. Existing moderation acts after content reaches recipients, depends on fixed harm taxonomies that cannot be updated without retraining, and rarely cov...
Soham S. Jadhav, Omkar N. Gadakh, Atharv Gaikwad et al.· Cureus Journal of Computer S...· 0 citations
The results show that CoRG remains challenging for current agents, even the best agent reaches only 67.0% success rate, leaving one third of references unresolved, and position CoRG as a concrete benchmark for studying how agents search, inspect, and verify information in realistic multi-tool environments.
Students in MIT’s Concourse program delve deeply into the human condition, debate challenging questions, and learn to develop judgment about issues that can’t be quantified.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
MIT News · Artificial Intelligence· news.mit.eduSep 30, 2026
Able to defeat top-ranked human players and more efficient than other models, the new system could help decision-makers in military maneuvers or business negotiations.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.