It is proposed that factual sycophancy arises when in-context updating gives a user's assertion excessive weight relative to its evidence, a trade-off that calls for evaluations measuring both behaviors and mitigations that decouple them.
This work characterize precisely the geometry of computation in a number-comparison task, as an abstraction of comparison for decision making, and how models utilize geometry in an elegant fashion to implement it, demonstrating that the manifold hypothesis can co-exist with linear representations.
Sai Sumedh R. Hindupur, Hadas Orgad, Thomas Fel et al.· 0 citations
ProbeDrift is introduced, a systematic evaluation framework for supervised uncertainty probes covering a wide range of OOD settings across models, tasks, and distributional shifts, and it is argued that robust uncertainty estimation requires robust evaluation.
Joe Stacey, Hadas Orgad, Kentaro Inui et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.