Skip to content

Human-AI Teaming Under Deception: An Implicit BCI Safeguards Drone Team Performance in Virtual Reality

Nov 2025 · arXiv.org · Vol abs/2511.19312 · 0 citations · 50 references
Computer Science

TL;DR

It is concluded that an implicit BCI provides resilience by learning to bypass a compromised executive networks and access the preserved sensory representation of ground truth, defending against AI-induced error in high-stakes environments.

Abstract

Human-AI teams can be vulnerable to catastrophic failure when feedback from the AI is incorrect, especially under high cognitive workload. Traditional team aggregation methods, such as voting, are susceptible to these AI errors, which can actively bias the behaviour of each individual and inflate the likelihood of an erroneous group decision. We hypothesised that a collaborative Brain-Computer Interface (cBCI) using neural activity collected before a behavioural decision is made can provide a source of information that is"decoupled"from this biased behaviour, thereby protecting the team from the deleterious influence of AI error. We tested this in a VR drone surveillance task where teams of operators faced high workload and systematically misleading AI cues. Using a passive BCI (pBCI) framework validated via offline simulation, we compared traditional behaviour-based team strategies against a purely Neuro-Decoupled Team (NDT) that used only BCI confidence scores derived from pre-response EEG. Under AI deception, behaviour-based teams catastrophically failed, with Majority Vote accuracy collapsing to 42.6% (worse than chance). The NDT, however, maintained a robust 68.3% accuracy. While this did not exceed the best individual's theoretical maximum, it provided a critical +25.7%"Safety Net Delta"that prevented the team from succumbing to the correlated error. This resilience was explained by a neuro-behavioural decoupling, where the BCI's predictions relied on preserved posterior-visual processing ("The Truth Signal") while the operators'executive monitoring systems collapsed. We conclude that an implicit BCI provides resilience by learning to bypass a compromised executive networks and access the preserved sensory representation of ground truth, defending against AI-induced error in high-stakes environments.

View source

Similar papers

#human-computer interacti... Preprint Sep 2026

Confident, Not Wiser: The Dunning-Kruger Effect in Human-AI Interaction

This study compares Human alone and Human+AI performance on reasoning tasks, for which the AI model is benchmarked on the same items, and distinguishes performance augmentation from metacognitive augmentation and motivate interfaces that support verification, communicate task-specific AI model performance, and help use...

Daniela Fernandes, Michelle Rausch, A. M. Kloft et al. · 0 citations
Oct 2026

Designing for Predictability: How Mental Models of AI Error Boundaries Shape Human-AI Team Performance in High-Stakes Decision Making

As artificial intelligence systems are increasingly deployed to advise human decision-makers in high-stakes domains—including healthcare, criminal justice, and financial services—organizations face a critical but often overlooked challenge: the accuracy of an AI system alone does not determine the performance of the hu...

Jonathan H. Westover · 0 citations
Open access Sep 2026

Balancing Trust and Deliberation in Human–AI Decision Support: The Effects of Explainable AI and Cognitive Forcing Functions

This work examines how six decision-support mechanisms affect engagement, trust, and collaborative task performance in a diabetes meal-planning scenario and argues for a contextual, balanced pairing of CFF and XAI design that accounts for interactivity, decision frequency, and task complexity.

Oliver Henderson · 0 citations
#human-computer interacti... Preprint Oct 2026

Think Once, Reflect Twice: How Feedback Shapes Human-AI Collaboration

As artificial intelligence (AI) increasingly supports human decision-making in high-stakes domains, designing effective human-AI collaboration becomes critical. Successful collaboration requires humans to reflect on decision-making processes and adjust their strategies accordingly. Current research typically investigat...

Joshua Holstein, Philipp Spitzer, Sebastian Schäfer et al. · 0 citations
Open access Sep 2026

Confidence Amplification in Human–AI Moral Decision-Making

As artificial intelligence (AI) systems increasingly engage users in value-laden discussions, a key concern is whether they shape not only what people decide but how confident they feel. We examined confidence amplification, shifts in certainty without decision reversals, in human–AI moral decision-making. In a 2 (Time...

Meng-Yao Li, Trevor Patten, Nishthaa Lekhi et al. · 0 citations

Related blog posts

MIT News · Artificial Intelligence Oct 23, 2026

Q&A: How AI came to model the “messy” human mind

Assistant Professor Benjamin Lindquist studies how engineers deliberately injected randomness into early AI, giving rise to deep-learning models that sometimes hallucinate.

MIT News · Artificial Intelligence Oct 7, 2026

Discovering the value of humanistic inquiry

Students in MIT’s Concourse program delve deeply into the human condition, debate challenging questions, and learn to develop judgment about issues that can’t be quantified.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.