Speculative decoding emerged as a way to break the sequential autoregressive decoding of Large Language Models (LLMs), based on the idea that a lightweight model produces draft completions, to be efficiently verified in parallel by the actual LLM. Building on recent work where a hybrid speculative decoding strategy was...
Gianni van de Velde, Cédric Goemaere, François Remy et al.· IEEE Access· 0 citations
It is found that merely warning the agents of potential imposter presence is not beneficial: it degrades decisions when no imposter is present, provokes reactions ranging from self-accusation to scapegoating, inflates token use, and reveals to the imposter how it was uncovered.
A. Mercier, Chris Develder, Thomas Demeester· 1 citation
This paper studies the phenomenon whereby specific short input phrases induce a partial amnesia effect in state space models, by irreversibly overwriting information in their hidden states, referred to as a Hidden State Poisoning Attack (HiSPA).
A. Mercier, Chris Develder, Thomas Demeester· arXiv.org· 3 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.