Skip to content

Composable Trust for Language Models: A proven boundary and a measured defense

Jul 2026 · arXiv.org · Vol abs/2607.13149 · 1 citation · 31 references
Computer Science

TL;DR

A trust model is developed that places the authority to act outside the model, in code: a source's standing, not its content, decides which operation runs and whether it acts, and an unmodified model runs inside a deterministic pipeline.

Abstract

In a language model, instructions and data share one token stream, so nothing inside the model's generation can keep untrusted text from steering it. We develop a trust model that places the authority to act outside the model, in code: a source's standing, not its content, decides which operation runs and whether it acts. A lower-trust source may inform an answer but not override a higher one. An unmodified model runs inside a deterministic pipeline that ranks inputs by source integrity, and a fixed non-model monitor provably chooses the operation and any outside action from trusted inputs alone. We can measure but not prove the pipeline's resistance to injection; we prompt-tune it and report the rate. On a one-shot held-out set with an unmodified Gemma~4 26B model, passivation and a wrapper (the cascade) raise the genuine-leak defended rate from $27\%$ to $94\%$ at roughly a $4\%$ clean-quality cost ($Q_{\mathrm{rel}}{=}0.96$). Under adaptive red-teaming the proved boundary holds unconditionally, and the measured defense stays at $87\%$. The cascade also attributes a lower-trust source's fact rather than dropping it, raising attribution from $0\%$ to $92\%$, and follows the higher-trust source on a conflict.

View source

Similar papers

Preprint Aug 2026

Don't Trust the Code, Check Its Effects: Runtime Refinement for Regenerated Systems Code Under an Adversarial Generator

Recent work uses large language models to generate systems code from specifications, treating the specification as the durable artifact and the implementation as disposable. Regenerating the implementation specializes it to each workload and device. However, that work lives in a forgiving setting: a component's externa...

Jin-Hao Hu, Ashvin Goel, Laurent Bindschaedler · 2 citations
#machine learning Preprint Sep 2026

Backdoor Mitigation in Decentralized LLM Fine-Tuning

Chorus is presented, a decentralized mechanism that lets each node detect and reject backdoored adapters from its neighbors before aggregation, without requiring shared validation data or any knowledge of the attacker's trigger or target.

Sayan Biswas, Jade Garcia Bourrée, R. Guerraoui et al. · 0 citations
#artificial intelligence Preprint Sep 2026

From Capability to Assurance in Autonomous Penetration-Testing Harnesses: A Framework and Reference Implementation

This paper defines a framework of five assurance properties and claims an initial existence argument that the properties are realizable together, not a comparative performance result, and specifies the multi target, ablation, and adversarial evaluation protocol required to turn the framework obligations into measuremen...

Joas Antonio dos Santos Barbosa · 1 citation
#artificial intelligence Preprint Sep 2026

API Secrets Should Never Become Tokens in the LLM's Vocabulary: A Threat Analysis of API Credential Handling in LLM Agent Systems and an Empirical Evaluation of a Vault-Mediated Execution Boundary

Tool-using large language model (LLM) agents turn credential hygiene from a storage problem into an execution-security problem. A key pasted into a prompt, or embedded in a system prompt or tool configuration, crosses from an authentication boundary into a data pipeline, where it may persist in conversation history, lo...

P. Kenney, Hadi Ahmadi, Denis Lusson et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Certified Multi-Source Integrity for Structured Agent Actions

Two robustness notions are formalized, each mechanism by ablation is validated by ablation, and how often the multi-source precondition holds on sanctions designations and software supply-chain provenance is measured.

Anmol Pandey, A. Jain, Liang-Wei Chen et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.