Skip to content

Category

human-computer interaction

2,089 papers

#human-computer interacti... Preprint Open access Oct 2026

AI Assistance for Discretionary Work: Increasing Feedback Provision in Higher Education

AI assistance can increase the efficiency and accuracy of human work, but can it also encourage people to undertake valuable tasks they might otherwise skip? Here, we investigate whether AI assistance can improve participation in discretionary but beneficial work in the context of personalized feedback provision in hig...

Romina Mahinpei, Victoria Dean, Ruth Fong et al. · 0 citations
#artificial intelligence Preprint Apr 2026

Explorable Proofs: Making Written Proofs Explorable by Grounding Them in Formal Representations

It is argued that grounding explanations in a formalized representation enables interactive affordances beyond what static text supports, and is instantiated for mathematical proof comprehension with explorable theorems, a system that uses LLMs to translate a theorem and its written proof into Lean, a programming langu...

Hita Kambhamettu, Will Crichton, S. Welleck et al. · 0 citations
#computer vision Preprint Open access Oct 2026

Quantifying the Impact of Motion on 2D Gaze Estimation in Real-World Mobile Interactions

Mobile gaze tracking on handheld devices commonly relies on \emph{appearance-based 2D gaze estimation} from the device's \emph{front-facing RGB camera}. Although this approach makes eye tracking more accessible by avoiding dedicated infrared hardware, maintaining accuracy remains difficult because the spatial relations...

Yaxiong Lei, Yuheng Wang, Fergus Buchanan et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Player-1: Learning to Play from Synthetic Experience

Computer-use agents have demonstrated strong capabilities in interpreting screens and executing keyboard and mouse actions. However, games, with their visually rich worlds and diverse mechanics, remain challenging and offer a demanding next step toward general digital control. Current game-agent learning pipelines ofte...

Ming-Yu Ouyang, Yi-Ran Wang, Si-Yuan Hu et al. · 0 citations
#computer vision Preprint Oct 2026

Speculative Sampling in Interactive Video Generation

Speculative Sampling is proposed, a strategy that combines the modeling power of large bidirectional windows with the low-latency interaction of small ones, opening a path to serving large bidirectional models in interactive streaming systems without complex streaming post-training.

Yu-Bo Huang, Yuxuan Zhang, Jia-Ming Liu et al. · 0 citations
#artificial intelligence Preprint Oct 2026

DeltaStreamer: Towards Human-Like Agentic Streaming Video Understanding

We propose DeltaStreamer, a novel agentic framework for streaming video understanding inspired by how humans observe, remember, and investigate. Streaming video understanding requires a system to retain evidence before knowing which details future queries will need. Existing approaches often obscure event transitions a...

Bo-Yuan Sun, De-Shui Miao, Wen-Zhao Gao et al. · 0 citations
#human-computer interacti... Preprint Open access Oct 2026

From Semantic Editing Intentions to Persistent Parametric Controls for AI-Assisted Image Editing

AI-powered image editing increasingly allows users to express high-level editing intentions, yet how these intentions are translated into concrete editing actions often remains difficult to understand. We present Atelier, a semantic image editing tool that uses image semantics and user intent to determine which editing...

Rifat Mehreen Amin, Michelle Dutoit, Anton Rockenstein et al. · 0 citations
#human-computer interacti... Preprint Oct 2026

Let Me Clarify: Interactive Modeling of Soft Attributes

People commonly express preferences through soft attributes such as is interesting,''which are difficult to operationalize for computational preference modeling. Latent representations can obscure how such attributes are interpreted, limiting transparency and user control. We formalize softness as the diversity of vali...

Steffen Holter, Rita Sevastjanova, Michaela Benk et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

What and Where in Identifying and Quantifying Conventions in Humans and AI Agents

Cooperative success rests in part on implicit communication. Partners converge on conventions: regularities that give an action meaning beyond its direct effect. Yet conventions are usually observed only indirectly: a score drop when partners are swapped shows that a convention existed, but not what it was or where it...

Makoto Fukushima, Tim Puphal · 0 citations
#human-computer interacti... Preprint Oct 2026

The Body-Algorithm-Emotion Loop: Making Emotion AI Misrecognition Visible through Artistic Practice

This pictorial presents The Body in Algorithmic Colonialism, a screen-based interactive installation that critically examines Emotion-AI through artistic practice. The work uses facial tracking to simulate how commercial Emotion-AI systems translate facial movement into emotional categories and verdicts of compliance o...

Chun-Ying Shen · 0 citations
#artificial intelligence Preprint Oct 2026

Task-State Governance: A Virtual Machine for Verifiable and Recoverable GUI Agent Execution

This work introduces task-state governance, an interaction paradigm that represents a task as an editable contract linking desired outcomes, facts that must be preserved, and observed application state in TaskVM, which projects live state into editable task controls.

Wen-Kui Yang, Yi-Ming Hao, Kai Zhou et al. · 0 citations

Scoping the Landscape of Large Language Model-based Affective Personal Informatics: Review, Reflection, Future Direction

This synthesis of 45 papers published between January 2020 and June 2026 reveals an overreliance on multi-stage, text-centric pipelines, a predominance of active, screen-bound interactions, and a severe demographic skew toward young, university-campus-based cohorts in empirical evaluations.

Min-Jie Liu, Li-Huan Li, Xu-Ran Li et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 5, 2026

Formally verifying agent-written full-stack web apps with PDD Kit

AI agents can generate code at a scale that’s hard for humans to review line-by-line. PDD Kit helps ensure the code is doing what the developer intended by creating formal specifications and testing against them. It converts developer intent into a Verus specification, proves AI-generated code meets it for every input, and uses tests where proofs aren't practical. Developers review intent, not every line. The post Formally verifying agent-written full-stack web apps with PDD Kit appeared first o…

MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

MIT News · Artificial Intelligence Oct 23, 2026

Reinforcing the value of human understanding at MIT

During the School of Humanities, Arts, and Social Sciences’ 75th Anniversary Symposium, President Sally Kornbluth said “MIT has never needed your particular insight and guidance more than we do now.”

MIT News · Artificial Intelligence Oct 23, 2026

Q&A: How AI came to model the “messy” human mind

Assistant Professor Benjamin Lindquist studies how engineers deliberately injected randomness into early AI, giving rise to deep-learning models that sometimes hallucinate.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.