As LLMs increasingly assist scientific writing and peer review, detecting who wrote the text is no longer sufficient: we need to determine who contributed the underlying insight. We introduce Insight Provenance, the task of identifying whether a review insight originates from a human, an LLM, or their hybrid contributi...
Zhuo-Yang Zou, Abolfazl Ansari, Jia-Xi Yang et al.· 0 citations
TRILOGUE (TRIlingual spoken diaLOGUE fact-checking) is introduced, a large-scale trilingual benchmark of source-grounded spoken dialogues in English, Russian, and Kazakh that supports claim check-worthiness detection, source-article evidence retrieval, and claim verification with claim-only, gold-evidence, and retrieve...
Chaewan Chun, Meruyert Aristombayeva, Jiyoung Choi et al.· 0 citations
This work identifies a class of user-issued instructions, Session Constraints, that are meant to constrain LLM's behavior for the remainder of a session but are silently dropped during compaction, and introduces COMPINT, an evaluation suite that evaluates compactors across three long-context scenarios: multi-turn chat,...
Zhiqi Wang, Yichi Zhang, Dongwon Lee et al.· 2 citations
This work presents the first multilingual spoken hallucination benchmark comprising 12,013 news samples across English, Russian, and Kazakh with controlled hallucinations of three types and three severity levels, and assesses fine-tuned multilingual encoders and, in zero-shot in-context settings, multimodal decoder mod...
Meruyert Aristombayeva, Jason Samuel Lucas, Chaewan Chun et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.