This work introduces a reasoning-guided translation framework for constructing multilingual evaluations designed to preserve the structure and intended meaning of diverse benchmark tasks, and develops a source-aligned evaluation collection spanning seven safety, conversational, and mathematical reasoning resources acro...
Zahraa Al Sahili, I. Patras, Matthew Purver· 0 citations
Activation steering controls large language model behavior by adding a direction to hidden activations during inference. For steering to work well, that direction must be a pure signal for the target concept: any confound entangled with it, such as an incidental topic or writing style, is injected into the residual str...
Alexandros Xenos, Manos Plitsis, N. Foteinopoulou et al.· 0 citations
The Distributional Answer Commitment Score (DACS) is proposed, a distributional confidence estimator that measures the entropy of the model's probability distribution over answer commitment at each reasoning step to capture how concentrated the model's answer belief is without requiring ground-truth answers or task-spe...
Zhao-Han Zhang, Jun-Jie Liu, Chengzhengxu Li et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.