Skip to content

Author

Patrícia Schmidtová

We have 5 of 34 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Conference Open access 2026

Findings of the WMT26 Multilingual Instruction Shared Task: Small Models Are Not Yet Polyglots

It is demonstrated that small models are not yet polyglots: while leading systems perform well on high-resource languages, performance drops sharply on low-resource varieties, and comprehension degrades significantly when transferring across non-English language pairs.

Patrícia Schmidtová, Ekaterina Artemova, Seth Aycock et al. · 0 citations

Distributional Metrics for Evaluating Spoken Conversational Systems

The Conversational Distribution Score (CDS) is introduced, which compares distributions of conversational behaviour using human conversations as a reference, and how many minutes and conversations are required before rankings stabilize is examined.

S. Satish, Erica Cooper, Patrícia Schmidtová et al. · 0 citations

Calibrating LLM Judges for Human and AI Conversations

This work evaluates state-of-the-art LLMs as pointwise and pairwise judges of conversational success on CANDOR, finding pointwise scoring correlates moderately with human ratings, while pairwise comparison suffers from long transcripts and positional bias.

Maike Zufle, Patrícia Schmidtová, Vilém Zouhar et al. · 1 citation

Last Translation Benchmark

The Last Translation Benchmark is introduced, a collection of human-authored and peer-reviewed examples that break leading machine translation models and a new evaluation approach: each example comes with handcrafted verification rules describing concrete failure cases on that example, therefore allowing reliable and a...

Vilém Zouhar, Niyati Bafna, Mukund Choudhary et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.