VOLOKHOVYCH STANISLAV

Modern large language models

Observation: Benign, long-form context can induce a persistent drift in model activations. This drift persists across the session and decouples behavior from RLHF alignment, regardless of whether the model agrees with the context We identify and characterize a failure mode in large language models aligned with RLHF. We...