Skip to content

When Faster Decisions Do Not Make Better Agents: An Empirical Study of Jev in Agent Workflows

Oct 2026 · 2 citations · 28 references
Computer Science

TL;DR

Experimental results show that Jev integration substantially reduces decision cost and latency across all five agents, with task-level gains varying by workflow, and highlight the importance of preserving progress, supporting recovery, and verifying completion when integrating efficient decision models into agent workflows.

Abstract

AI agents depend on repeated decisions to accomplish tasks, with large language models (LLMs) commonly serving as their core decision makers. The recent emergence of Jev offers an opportunity to make these decisions faster and at lower cost. However, it remains unclear whether such local savings can be translated into efficient and reliable task completion. In this paper, we investigate this efficiency transfer across five agents in two representative application settings, embodied tasks in ALFWorld and mobile app use in AndroidWorld. Across 4,500 task executions, we jointly evaluate task effectiveness, decision-level and task-level resource use, and execution behavior. Experimental results show that Jev integration substantially reduces decision cost and latency across all five agents, with task-level gains varying by workflow. Task success remains close to baseline levels on ALFWorld and declines more substantially in two mobile agents. Auxiliary reasoning and additional interactions absorb decision savings, while failed recovery and premature completion limit successful delivery. Mean cost per successful outcome increases in one agent even as spending per attempt falls. These findings highlight the importance of preserving progress, supporting recovery, and verifying completion when integrating efficient decision models into agent workflows. Their practical value should be assessed through successful task delivery, recovery behavior, and resources per delivered outcome.

View source

Similar papers

Not All AI Agents Are Equal: Characterizing Resource and Performance Dynamics

The latency with respect to the resource dynamics of processing multiple requests and tasks concurrently is characterized and new optimization opportunities that exploit the resource dynamics of tasks are demonstrated: CPU-aware tool admission and task-aware CPU allocation.

Wonmi Choi, Minuk Park, Zhi-Xiong Niu et al. · 1 citation
#artificial intelligence Preprint Oct 2026

Think Before You Act: Decision Gate for LLM Agents

LLM agents increasingly perform consequential actions through external tools, yet their proposed actions are often executed without independent verification of policy compliance or task completion. We introduce JevAct, a runtime verification framework that intercepts selected agent actions before execution and enables...

Iftach Shoham, Yuval David, Offer Akrabi et al. · 0 citations
Preprint Oct 2026

Ask Your Advisor: Learning When to Consult Stronger Models in Agentic Systems

To balance task performance and computational cost, agentic workflows can use a lower-cost model for execution and selectively consult a stronger model. In such executor-advisor systems, the executor decides when to seek advice, making escalation depend on self-assessment, although current language models struggle to d...

Pascal Sowietzki, Steffen Holter, Yannick Metz et al. · 0 citations
#natural language process... Open access Sep 2026

When Better Turns Do Not Make Better Agents: Diagnosing the Gap Between Next-Turn Metrics and Workflow Success

It is found that SFT consistently improves text-turn success, and that overall next-turn success increases for every model under gold-history evaluation, but these improvements do not transfer to autonomous workflow execution.

Md Tahmid Rahman Laskar, Xue-Yong Fu, Gundeep Singh et al. · 1 citation · ⚡1

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.