The Unreasonable Benchmark

Automatic evaluation of assessments using large language models

Reproducibility in the era of large language models

The rise of large language models adds new layers of complexity, underscoring the need for clearer reporting standards and community-wide best practices.

Croatian Language in the Transition from Neural Machine

provide high–quality translation capabilities for Croatian across dozens, if not hundreds, of language pairs.

Towards conversational artificial intelligence for disease management

Advances to the artificial intelligence system AMIE enable it to manage disease across multiple visits while reasoning over a corpus of clinical guidelines and patient history, outperforming primary care physicians on management reasoning tasks.

Do humans and large language models agree on the quality of synthesis plans?

This work evaluated the agreement between LLMs and expert chemists on holistic evaluations of the retrosynthetic routes and found no agreement on holistic evaluations of the retrosynthetic routes.

Nuts and Bolts of AI: A Conceptual Explanation

This seminar explores the conceptual foundations of artificial intelligence and offers practical guidance on using and evaluating AI tools responsibly in academic research.