Latent space monitors aim to detect undesired behaviors in LLM agents by inspecting an agent's internal activations rather than its outputs. However, interactive monitoring creates a feedback channel where each verdict the monitor delivers leaks information to the model about how its internal states are being evaluated...
Hugo Lyons Keenan, Christopher Leckie, S. Erfani· 0 citations
Theoretical analysis shows that under this anisotropic structure, adversarial attacks increase the expected geometric separation between clean and adversarial examples (AEs), and proposes GeoDetect, which leverages these off-manifold deviations via geometric scores to identify AEs.
Afsaneh Hasanebrahimi, Hanxun Huang, Christopher Leckie et al.· arXiv.org· 0 citations
VisER is proposed, a training-free two-sided metric for object-level hallucination detection that improves AUROC and AUPR over a range of baselines and measures whether object-context compatibility is backed by object-specific evidence from image tokens.
Afsaneh Hasanebrahimi, Hanxun Huang, Christopher Leckie et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.