A trust model is developed that places the authority to act outside the model, in code: a source's standing, not its content, decides which operation runs and whether it acts, and an unmodified model runs inside a deterministic pipeline.
Abstract
In a language model, instructions and data share one token stream, so nothing inside the model's generation can keep untrusted text from steering it. We develop a trust model that places the authority to act outside the model, in code: a source's standing, not its content, decides which operation runs and whether it acts. A lower-trust source may inform an answer but not override a higher one. An unmodified model runs inside a deterministic pipeline that ranks inputs by source integrity, and a fixed non-model monitor provably chooses the operation and any outside action from trusted inputs alone. We can measure but not prove the pipeline's resistance to injection; we prompt-tune it and report the rate. On a one-shot held-out set with an unmodified Gemma~4 26B model, passivation and a wrapper (the cascade) raise the genuine-leak defended rate from $27\%$ to $94\%$ at roughly a $4\%$ clean-quality cost ($Q_{\mathrm{rel}}{=}0.96$). Under adaptive red-teaming the proved boundary holds unconditionally, and the measured defense stays at $87\%$. The cascade also attributes a lower-trust source's fact rather than dropping it, raising attribution from $0\%$ to $92\%$, and follows the higher-trust source on a conflict.
Recent work uses large language models to generate systems code from specifications, treating the specification as the durable artifact and the implementation as disposable. Regenerating the implementation specializes it to each workload and device. However, that work lives in a forgiving setting: a component's externa...
Chorus is presented, a decentralized mechanism that lets each node detect and reject backdoored adapters from its neighbors before aggregation, without requiring shared validation data or any knowledge of the attacker's trigger or target.
Sayan Biswas, Jade Garcia Bourrée, R. Guerraoui et al.· 0 citations
This paper defines a framework of five assurance properties and claims an initial existence argument that the properties are realizable together, not a comparative performance result, and specifies the multi target, ablation, and adversarial evaluation protocol required to turn the framework obligations into measuremen...
Tool-using large language model (LLM) agents turn credential hygiene from a storage problem into an execution-security problem. A key pasted into a prompt, or embedded in a system prompt or tool configuration, crosses from an authentication boundary into a data pipeline, where it may persist in conversation history, lo...
P. Kenney, Hadi Ahmadi, Denis Lusson et al.· 0 citations
Two robustness notions are formalized, each mechanism by ablation is validated by ablation, and how often the multi-source precondition holds on sanctions designations and software supply-chain provenance is measured.
Anmol Pandey, A. Jain, Liang-Wei Chen et al.· 0 citations
CoDeL is presented, a defense that hardens agent against an attack distribution it reshapes as it trains, and reduces attack success rate (ASR) by 88.5% and outperforms other baselines largely (+38.0%).
Xiao Yang, Yang-Chen Ou, Yu-Han Gao et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.