Current image-text evaluation often relies on a global score, which gives limited insight into which semantic details are supported by the image. Explainable metrics provide rationales, but the visual evidence supporting those rationales can still be difficult to verify. We introduce VisExMEM, a reference-free evaluato...
Subhadeep Roy, Christoph Leiter, S. Eger· 0 citations
SciFigBench is introduced, a diagnostic VLM benchmark for scientific figure understanding that jointly evaluates perception, reasoning, and behavioral reliability under uncertainty and proposes the Admittance-Resistance-Inductance (A-R-I) framework to evaluate whether models acknowledge insufficient evidence, resist mi...
Paul Osemudiame Oamen, Owusu-Banahene Osei, Ananya Mukherjee et al.· 0 citations
This work constructs DaTikZ-V4, a dataset more than four times larger and substantially higher in quality than DaTikZ-V3, enriched with LLM-generated figure descriptions, and trains TikZilla, a family of small open-source Qwen models with a two-stage pipeline of SFT followed by reinforcement learning (RL).
DaEdiTikZ is introduced, the first large-scale dataset of revision-derived scientific figure edits, constructed by mining 391K plausible TikZ edit pairs from arXiv, GitHub, and TeX SE and inferring 781K directed edit instructions with a VLM conditioned on rendered figures and TikZ code.
C. Greisinger, Zhixue Zhao, Steffen Eger· 0 citations
AVShift is introduced, the first German benchmark for systematically evaluating AV under multiple distribution shifts, and feature analysis reveals stylistic features that remain stable across genres, while their relative importance varies depending on the specific genre transition.
Lotta Kiefer, Brisca Balthes, Christoph Leiter et al.· 0 citations
ChronoLens is introduced, a framework that combines frozen multilingual language models, feature-aligned crosscoders, and post-hoc linguistic interventions, and applies it to 44.98 million documents and approximately 17.2 billion tokens from five parliamentary traditions spanning 1803--2026, showing that historical lan...
Gagan Bhatia, Julian Schlenker, S. Ponzetto et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.