SYNTH is the first open-source synthetic corpus derived from 58,698 Wikipedia articles that collapses pre, mid, and post-training into a single training stage via structured amplification of curated encyclopedic seeds, and opens up possibilities for both generalist models with significantly increased data efficiency, a...
Pierre-Carl Langlais, Pieter Delobelle, Yannick Detrois et al.· 0 citations
These findings show that aggregate detection metrics conceal persistent, model dependent heterogeneity in language model failures and motivate regime conditioned evaluation.
Pranav Darshan, A. Pranav, T. SravanKarthick et al.· 0 citations
It is concluded that only by grounding oversight in realistic assumptions about human cognition and institutional incentives can it fulfill its intended role in ensuring trustworthy AI.
A. Henestrosa, A. Grinbaum, Ivan P. Yamshchikov· 0 citations
BenCheck is proposed, a package for benchmark validity analysis that encapsulates the main checks performed in a case study on HellaSwag and can be used to audit commonsense reasoning benchmarks, including PIQA, Global PIQA, and Winogrande.
Pavel Chizhov, Anton Changalidis, Vishnu Prasad Vijaya Kumar et al.· 9 citations· ⚡2
Large language models (LLMs) are increasingly deployed for translation tasks, yet their implicit political positioning in such contexts remains understudied. We ask whether a single politically charged framing term, such as aggressor, enemy, neighbour, or coloniser is sufficient to trigger implicit political alignment...
Svetlana Gorovaia, A. Henestrosa, Ivan P. Yamshchikov· 0 citations
LeakageBench provides a diagnostic benchmark for high-recall, spatially grounded PII redaction in document images and shows that stronger detection and tool assistance improve localization without making most pages safe for release.
V. Kumar, Santhosh Venkatesh, Ivan P. Yamshchikov· 0 citations
This work examines how LLMs respond to user prompts expressing varying degrees of Dark Triad traits (Machiavellianism, Narcissism, and Psychopathy) using a curated dataset, revealing systematic differences across models.
Zeyi Lu, A. Henestrosa, Pavel Chizhov et al.· arXiv.org· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.