Guillaume Dion

Textual World Models for Agent Security: Modelling the Internal State of an LLM Agent from Text Alone

An AI agent chooses its own path to reach an objective, so its security and compliance depend on its internal state, not only on its inputs and outputs. We ask whether the activations of the agent's large language model (LLM), produced when it reads the context, are a sufficient observation of this state to build a mod...