Giuseppe Attanasio

Challenging the Abilities of Large Language Models in Italian: a Community Initiative

CALAMITA is conceived as a rolling benchmark, enabling continuous integration of new tasks and models, and argues that this combination offers a blueprint for other languages and communities seeking inclusive and rigorous LLM evaluation practices.