It is demonstrated that smaller models can efficiently handle complex language assessments, suggesting dynamic routing to balance performance with sustainable deployment in educational technology.
A comparative benchmarking study evaluating the regulatory comprehension of four open-source large language models, TinyLlama-1.1B-Chat, Gemma-2B-Instruct, Llama-3.1-8B-Instruct, and Mistral-7B-Instruct-v0.3, contributes an empirical characterization of small and medium language model regulatory comprehension and a reu...
Eleni Tsalera, Gerasimos K. Pagiatakis, Andreas E. Papadakis· Future Internet· 0 citations
BabelFlow is introduced, a benchmark-general agentic workflow that adapts existing agent benchmarks to new languages by analyzing runtime dependencies, coordinating structure-preserving translation, and combining multi-layer verification with human review to preserve task and evaluation semantics.
Peng Kuang, Yu-Chun Fan, Jiang-Nan Li et al.· 1 citation
The effect of introducing the manager-worker scaffold over a shared filesystem workspace, with no training and no per-benchmark tuning, measured against the same model answering in a single pass is investigated, finding several mechanisms behind the gains.
Victor Gao, Vida Khosrowshahi, Ali Khosrowshahi et al.· 0 citations
The environmental cost of adapting Large Language Models (LLMs) is a growing concern in artificial intelligence research. We present a systematic comparison between gradient-based fine-tuning and a rule-based prompt optimization framework for financial tabular reasoning. Using the TAT-QA dataset, we demonstrate that ou...
Róbert Lakatos, Árpád Pándy, András Hajdu· 2026 IEEE 4th Conference on...· 0 citations
MOSCOPT is proposed, a text-native, parameter-free algorithm that jointly optimizes a pool of skills and a gating skill that dynamically selects skills per step and demonstrates that MOSCOPT consistently outperforms all baselines.
WorldBench is presented: a comprehensive, multilingual benchmark of genuine, persona-grounded everyday workflows, where agents can act in a sandbox via structured actions, and Constrained Task Success (CTS), which combines natural language instructions and testbeds to score task completion, minimal modification, and ot...
Leonardo Ranaldi, Sherrie Shen, Jushi Kai et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.